2023-11-18T23:29:47.544 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-18T23:29:47.544 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461799 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_yuriw@teuthology --name yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461799/orig.config.yaml 2023-11-18T23:29:47.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-18T23:29:47.667 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461799 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7461799' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1491 sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDv1UA29E/bd2moLgdPGqzblNqMWJNY6RKhfINpNqLEUsAY5hRBk/p0/+Ml5LpIogY48MO5AKdKsK8BsyqrcCIY= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2Tj7DI+fVI4kmFUuOvnTBZ0/JLt4QUnRWsOG6iOs8cv48ouF+piGrpfGcmdNx4yjVsdwiPYb4mUgB1gvNJZbg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-18_13:51:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-18T23:29:47.667 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa; will attempt to use it 2023-11-18T23:29:47.668 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks 2023-11-18T23:29:47.668 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-18T23:29:47.670 INFO:teuthology.task.internal:Checking packages... 2023-11-18T23:29:47.697 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe' 2023-11-18T23:29:47.697 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-18T23:29:47.697 INFO:teuthology.packaging:ref: None 2023-11-18T23:29:47.697 INFO:teuthology.packaging:tag: None 2023-11-18T23:29:47.697 INFO:teuthology.packaging:branch: main 2023-11-18T23:29:47.697 INFO:teuthology.packaging:sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T23:29:47.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-18T23:29:48.057 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7426.g35dfedef 2023-11-18T23:29:48.058 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-18T23:29:48.066 INFO:teuthology.task.internal:no buildpackages task found 2023-11-18T23:29:48.066 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-18T23:29:48.152 INFO:teuthology.task.internal:Saving configuration 2023-11-18T23:29:48.168 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-18T23:29:48.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T23:29:48.293 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461799', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 23:24:48.874931', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDv1UA29E/bd2moLgdPGqzblNqMWJNY6RKhfINpNqLEUsAY5hRBk/p0/+Ml5LpIogY48MO5AKdKsK8BsyqrcCIY='} 2023-11-18T23:29:48.314 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461799', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 23:24:48.876339', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2Tj7DI+fVI4kmFUuOvnTBZ0/JLt4QUnRWsOG6iOs8cv48ouF+piGrpfGcmdNx4yjVsdwiPYb4mUgB1gvNJZbg='} 2023-11-18T23:29:48.314 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-18T23:29:48.365 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-18T23:29:48.366 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-18T23:29:48.366 INFO:teuthology.run_tasks:Running task console_log... 2023-11-18T23:29:48.551 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f81a9dfb0d0>, signals=[15]) 2023-11-18T23:29:48.551 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-18T23:29:48.601 INFO:teuthology.task.internal:Opening connections... 2023-11-18T23:29:48.601 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:29:48.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:29:48.702 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:29:48.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:29:48.787 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-18T23:29:48.792 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-11-18T23:29:48.809 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-11-18T23:29:48.810 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-11-18T23:29:48.867 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-11-18T23:29:48.867 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2023-11-18T23:29:48.867 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-11-18T23:29:48.867 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-11-18T23:29:48.867 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2023-11-18T23:29:48.868 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2023-11-18T23:29:48.868 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-18T23:29:48.868 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-11-18T23:29:48.868 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2023-11-18T23:29:48.868 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-18T23:29:48.868 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-11-18T23:29:48.868 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-18T23:29:48.869 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-18T23:29:48.869 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-18T23:29:48.870 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-11-18T23:29:48.892 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-11-18T23:29:48.910 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-11-18T23:29:48.910 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-11-18T23:29:48.969 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-11-18T23:29:48.969 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-11-18T23:29:48.969 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-11-18T23:29:48.969 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-11-18T23:29:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-11-18T23:29:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-11-18T23:29:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-18T23:29:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-11-18T23:29:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-11-18T23:29:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-18T23:29:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-11-18T23:29:48.971 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-18T23:29:48.971 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-18T23:29:48.971 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-18T23:29:48.971 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-11-18T23:29:48.993 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-18T23:29:49.001 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-18T23:29:49.092 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-18T23:29:49.092 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-11-18T23:29:49.095 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2023-11-18T23:29:49.112 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-18T23:29:49.196 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-18T23:29:49.196 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-11-18T23:29:49.198 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2023-11-18T23:29:49.223 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-18T23:29:49.358 INFO:teuthology.run_tasks:Running task kernel... 2023-11-18T23:29:49.466 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-18T23:29:49.466 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-18T23:29:49.467 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T23:29:49.467 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T23:29:49.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T23:29:49.484 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2023-11-18T23:29:49.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T23:29:49.485 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-11-18T23:29:49.543 INFO:teuthology.orchestra.run.smithi008.stdout:5.14.0-361.el9.x86_64 2023-11-18T23:29:49.544 INFO:teuthology.task.kernel:Running kernel on smithi008: 5.14.0-361.el9.x86_64 2023-11-18T23:29:49.544 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2023-11-18T23:29:49.545 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-361.el9.x86_64 2023-11-18T23:29:49.545 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-361.el9.x86_64 2023-11-18T23:29:49.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2023-11-18T23:29:51.790 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-11-18T23:29:51.812 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-11-18T23:29:53.324 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2023-11-18T23:29:53.346 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2023-11-18T23:29:55.222 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 7.9 MB 00:01 2023-11-18T23:29:55.225 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 7.9 MB 00:01 2023-11-18T23:29:57.279 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-11-18T23:30:00.098 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 18 MB 00:03 2023-11-18T23:30:02.163 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 5.8 MB 00:01 2023-11-18T23:30:03.522 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 15 kB 00:00 2023-11-18T23:30:05.615 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2023-11-18T23:30:05.890 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 5.8 MB 00:02 2023-11-18T23:30:07.308 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 15 kB 00:00 2023-11-18T23:30:10.523 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-18T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-18T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-18T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-11-18T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-11-18T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: kernel x86_64 5.14.0-384.el9 CentOS-BaseOS 5.5 M 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-core x86_64 5.14.0-384.el9 CentOS-BaseOS 20 M 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules x86_64 5.14.0-384.el9 CentOS-BaseOS 38 M 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-core x86_64 5.14.0-384.el9 CentOS-BaseOS 32 M 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout:Install 4 Packages 2023-11-18T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 95 M 2023-11-18T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 121 M 2023-11-18T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-11-18T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout:(1/4): kernel-5.14.0-384.el9.x86_64.rpm 23 MB/s | 5.5 MB 00:00 2023-11-18T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout:(2/4): kernel-core-5.14.0-384.el9.x86_64.rpm 41 MB/s | 20 MB 00:00 2023-11-18T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout:(3/4): kernel-modules-core-5.14.0-384.el9.x86_6 51 MB/s | 32 MB 00:00 2023-11-18T23:30:14.401 INFO:teuthology.orchestra.run.smithi008.stdout:(4/4): kernel-modules-5.14.0-384.el9.x86_64.rpm 29 MB/s | 38 MB 00:01 2023-11-18T23:30:14.404 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-11-18T23:30:14.404 INFO:teuthology.orchestra.run.smithi008.stdout:Total 74 MB/s | 95 MB 00:01 2023-11-18T23:30:14.404 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-11-18T23:30:14.841 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-11-18T23:30:14.841 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-11-18T23:30:15.859 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-11-18T23:30:15.860 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-11-18T23:30:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-11-18T23:30:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-modules-core-5.14.0-384.el9.x86_64 1/4 2023-11-18T23:30:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-18T23:30:22.114 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-18T23:30:22.299 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-18T23:30:25.609 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 20 MB 00:18 2023-11-18T23:30:27.240 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-18T23:30:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:30:30.323 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-11-18T23:30:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:30:32.638 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-18T23:30:32.638 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-18T23:30:32.724 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-11-18T23:30:32.736 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-11-18T23:30:32.736 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-11-18T23:30:32.736 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-11-18T23:30:32.736 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-11-18T23:30:32.736 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-384.el9 CentOS-BaseOS 5.5 M 2023-11-18T23:30:32.736 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-384.el9 CentOS-BaseOS 20 M 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-384.el9 CentOS-BaseOS 38 M 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-384.el9 CentOS-BaseOS 32 M 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 95 M 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 121 M 2023-11-18T23:30:32.737 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-11-18T23:30:32.958 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-384.el9.x86_64.rpm 25 MB/s | 5.5 MB 00:00 2023-11-18T23:30:33.225 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-core-5.14.0-384.el9.x86_64.rpm 41 MB/s | 20 MB 00:00 2023-11-18T23:30:33.601 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-modules-5.14.0-384.el9.x86_64.rpm 44 MB/s | 38 MB 00:00 2023-11-18T23:30:33.901 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-core-5.14.0-384.el9.x86_6 34 MB/s | 32 MB 00:00 2023-11-18T23:30:33.903 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-11-18T23:30:33.904 INFO:teuthology.orchestra.run.smithi116.stdout:Total 82 MB/s | 95 MB 00:01 2023-11-18T23:30:33.904 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-11-18T23:30:34.281 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-11-18T23:30:34.282 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-11-18T23:30:35.272 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-11-18T23:30:35.273 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-11-18T23:30:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-11-18T23:30:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-384.el9.x86_64 1/4 2023-11-18T23:30:38.634 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-18T23:30:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-18T23:30:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-18T23:30:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-18T23:30:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:30:50.950 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:02.780 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:03.145 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:03.145 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-5.14.0-384.el9.x86_64 1/4 2023-11-18T23:31:03.145 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-18T23:31:03.145 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-18T23:31:03.581 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-5.14.0-384.el9.x86_64 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-core-5.14.0-384.el9.x86_64 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-5.14.0-384.el9.x86_64 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-core-5.14.0-384.el9.x86_64 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:31:03.582 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-11-18T23:31:04.118 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-11-18T23:31:04.248 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-18T23:31:04.249 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-18T23:31:04.249 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-384.el9.x86_64 2023-11-18T23:31:04.249 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-18T23:31:04.249 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-18T23:31:04.249 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-18T23:31:04.249 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=None, version=distro) 2023-11-18T23:31:04.249 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-11-18T23:31:04.359 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-18T23:31:04.360 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-18T23:31:04.360 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-11-18T23:31:04.397 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.06 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 68.el9 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Group : Unspecified 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 8264254 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-18T23:31:04.398 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : builder@centos.org 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-18T23:31:04.399 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-18T23:31:04.400 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-18T23:31:04.400 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-11-18T23:31:04.400 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:31:04.400 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-11-18T23:31:04.401 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-18T23:31:04.401 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 5.14.0-384.el9.x86_64 2023-11-18T23:31:04.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-18T23:31:05.026 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-11-18T23:31:06.457 INFO:teuthology.orchestra.run.smithi008.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-18T23:31:06.498 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-11-18T23:31:06.503 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-11-18T23:31:06.519 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.gp2BYDvBma 2023-11-18T23:31:06.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gp2BYDvBma 2023-11-18T23:31:06.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.gp2BYDvBma 2023-11-18T23:31:06.737 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.gp2BYDvBma is 6KB 2023-11-18T23:31:06.785 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.gp2BYDvBma 2023-11-18T23:31:06.800 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-11-18T23:31:06.868 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-18T23:31:06.868 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-18T23:31:06.868 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-18T23:31:06.868 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64.conf 2023-11-18T23:31:06.869 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64 2023-11-18T23:31:07.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-11-18T23:31:20.008 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-384.el9.x86_64 1/4 2023-11-18T23:31:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-18T23:31:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-18T23:31:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-18T23:31:20.879 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:31:20.879 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-11-18T23:31:20.880 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-384.el9.x86_64 2023-11-18T23:31:20.880 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-384.el9.x86_64 2023-11-18T23:31:20.880 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-384.el9.x86_64 2023-11-18T23:31:20.880 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-384.el9.x86_64 2023-11-18T23:31:20.880 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:31:20.880 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-11-18T23:31:21.358 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2023-11-18T23:31:21.485 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-18T23:31:21.486 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-18T23:31:21.486 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-384.el9.x86_64 2023-11-18T23:31:21.486 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-18T23:31:21.487 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-18T23:31:21.487 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-18T23:31:21.487 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2023-11-18T23:31:21.487 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2023-11-18T23:31:21.592 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-18T23:31:21.593 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-18T23:31:21.593 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2023-11-18T23:31:21.626 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2023-11-18T23:31:21.627 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2023-11-18T23:31:21.627 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2023-11-18T23:31:21.627 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 68.el9 2023-11-18T23:31:21.628 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2023-11-18T23:31:21.628 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-18T23:31:21.628 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2023-11-18T23:31:21.628 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8264254 2023-11-18T23:31:21.629 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2023-11-18T23:31:21.629 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-18T23:31:21.629 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-18T23:31:21.629 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:31:21.630 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-18T23:31:21.631 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-18T23:31:21.631 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-18T23:31:21.631 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2023-11-18T23:31:21.631 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:31:21.631 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2023-11-18T23:31:21.632 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-18T23:31:21.632 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-384.el9.x86_64 2023-11-18T23:31:21.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-18T23:31:22.236 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2023-11-18T23:31:23.582 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-18T23:31:23.610 INFO:teuthology.orchestra.run.smithi116.stderr:done 2023-11-18T23:31:23.612 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2023-11-18T23:31:23.628 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.aoonU7A6Om 2023-11-18T23:31:23.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aoonU7A6Om 2023-11-18T23:31:23.697 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.aoonU7A6Om 2023-11-18T23:31:23.839 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.aoonU7A6Om is 6KB 2023-11-18T23:31:23.890 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.aoonU7A6Om 2023-11-18T23:31:23.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2023-11-18T23:31:23.978 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-18T23:31:23.978 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-18T23:31:23.978 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-18T23:31:23.979 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64.conf 2023-11-18T23:31:23.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64 2023-11-18T23:31:24.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2023-11-18T23:31:37.046 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-18T23:31:37.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-11-18T23:31:37.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:31:54.153 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-18T23:31:54.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-18T23:31:54.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:31:55.366 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-11-18T23:32:04.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-11-18T23:32:04.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:32:07.430 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-11-18T23:32:12.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-18T23:32:19.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-11-18T23:32:19.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:32:21.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-18T23:32:21.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:32:24.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-11-18T23:32:36.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-18T23:32:36.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:32:51.177 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-11-18T23:32:51.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-11-18T23:32:51.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-384.el9.x86_64"... 2023-11-18T23:32:51.629 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-11-18T23:32:51.643 INFO:teuthology.orchestra.run.smithi008.stdout:5.14.0-384.el9.x86_64 2023-11-18T23:32:51.644 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-384.el9.x86_64 vs 5.14.0-384.el9.x86_64 2023-11-18T23:32:51.644 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T23:32:51.644 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-18T23:32:52.645 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-18T23:32:52.646 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-18T23:32:52.737 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-11-18T23:32:52.773 DEBUG:teuthology.parallel:result is None 2023-11-18T23:33:08.457 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-11-18T23:33:08.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-18T23:33:08.945 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-384.el9.x86_64"... 2023-11-18T23:33:08.945 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2023-11-18T23:33:08.959 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-384.el9.x86_64 2023-11-18T23:33:08.959 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-384.el9.x86_64 vs 5.14.0-384.el9.x86_64 2023-11-18T23:33:08.960 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T23:33:08.960 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-18T23:33:09.961 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-18T23:33:09.961 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-18T23:33:10.045 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2023-11-18T23:33:10.096 DEBUG:teuthology.parallel:result is None 2023-11-18T23:33:10.097 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-18T23:33:10.103 INFO:teuthology.task.internal:Creating test directory... 2023-11-18T23:33:10.104 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T23:33:10.107 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T23:33:10.123 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-18T23:33:10.181 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-18T23:33:10.276 INFO:teuthology.task.internal:Creating archive directory... 2023-11-18T23:33:10.277 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T23:33:10.279 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T23:33:10.321 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-18T23:33:10.417 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-18T23:33:10.417 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T23:33:10.420 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T23:33:10.460 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T23:33:10.477 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T23:33:10.559 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T23:33:10.573 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T23:33:10.574 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-18T23:33:10.585 INFO:teuthology.task.internal:Configuring sudo... 2023-11-18T23:33:10.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T23:33:10.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T23:33:10.621 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-18T23:33:10.701 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-18T23:33:10.701 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T23:33:10.704 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T23:33:10.720 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T23:33:10.807 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T23:33:10.867 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T23:33:10.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T23:33:10.959 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:33:10.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T23:33:11.031 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T23:33:11.073 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T23:33:11.130 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T23:33:11.216 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T23:33:11.261 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:33:11.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T23:33:11.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-11-18T23:33:11.334 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2023-11-18T23:33:11.401 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T23:33:11.423 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T23:33:11.969 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-18T23:33:11.979 INFO:teuthology.task.internal:Starting timer... 2023-11-18T23:33:11.980 INFO:teuthology.run_tasks:Running task pcp... 2023-11-18T23:33:12.044 INFO:teuthology.run_tasks:Running task selinux... 2023-11-18T23:33:12.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-11-18T23:33:12.213 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-11-18T23:33:12.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2023-11-18T23:33:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2023-11-18T23:33:12.281 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-18T23:33:12.281 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-11-18T23:33:12.307 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-11-18T23:33:12.307 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2023-11-18T23:33:12.332 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2023-11-18T23:33:12.332 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive'} 2023-11-18T23:33:12.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T23:33:12.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T23:33:12.380 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T23:33:12.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T23:33:12.408 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-18T23:33:12.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-11-18T23:33:12.458 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2023-11-18T23:33:12.492 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-18T23:33:12.502 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-18T23:33:12.506 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-18T23:33:12.637 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-18T23:33:12.656 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-18T23:33:12.658 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-18T23:38:36.621 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2023-11-18T23:38:36.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-11-18T23:38:36.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:38:36.721 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-11-18T23:38:36.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-11-18T23:38:36.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-18T23:38:36.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T23:38:36.876 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-11-18T23:38:36.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-11-18T23:38:36.941 INFO:teuthology.run_tasks:Running task clock... 2023-11-18T23:38:36.953 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-18T23:38:36.954 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T23:38:36.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T23:38:36.957 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T23:38:36.957 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T23:38:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-18T23:38:37.010 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-18T23:38:37.011 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-18T23:38:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-18T23:38:37.046 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-11-18T23:38:37.056 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2023-11-18T23:38:37.063 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-11-18T23:38:37.070 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2023-11-18T23:38:37.083 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-18T23:38:37.086 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-18T23:38:37.102 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-18T23:38:37.103 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-18T23:38:37.145 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2023-11-18T23:38:37.149 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T23:38:37.149 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2023-11-18T23:38:37.150 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.150 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.150 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.150 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.151 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2023-11-18T23:38:37.153 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T23:38:37.153 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-11-18T23:38:37.153 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.154 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.154 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.154 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T23:38:37.155 INFO:teuthology.run_tasks:Running task install... 2023-11-18T23:38:37.164 DEBUG:teuthology.task.install:project ceph 2023-11-18T23:38:37.164 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}} 2023-11-18T23:38:37.164 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'} 2023-11-18T23:38:37.164 INFO:teuthology.task.install:Using flavor: default 2023-11-18T23:38:37.170 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-18T23:38:37.170 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-18T23:38:37.171 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-18T23:38:37.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T23:38:37.173 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-18T23:38:37.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T23:38:37.391 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-18T23:38:37.391 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-18T23:38:37.395 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-18T23:38:37.396 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-18T23:38:37.499 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-18T23:38:37.500 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:38:37.500 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-18T23:38:37.531 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-18T23:38:37.532 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-18T23:38:37.562 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-18T23:38:37.563 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:38:37.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-18T23:38:37.591 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-18T23:38:37.592 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-18T23:38:37.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-18T23:38:37.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-18T23:38:37.692 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-18T23:38:37.723 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-11-18T23:38:37.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-11-18T23:38:37.741 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-18T23:38:37.807 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2023-11-18T23:38:37.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2023-11-18T23:38:37.986 INFO:teuthology.orchestra.run.smithi008.stdout:72 files removed 2023-11-18T23:38:38.013 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-18T23:38:38.052 INFO:teuthology.orchestra.run.smithi116.stdout:72 files removed 2023-11-18T23:38:38.080 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-18T23:38:38.749 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 196 kB/s | 78 kB 00:00 2023-11-18T23:38:38.853 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 172 kB/s | 78 kB 00:00 2023-11-18T23:38:39.191 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 24 kB/s | 9.5 kB 00:00 2023-11-18T23:38:39.320 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-11-18T23:38:39.550 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2023-11-18T23:38:39.696 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2023-11-18T23:38:40.120 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-11-18T23:38:40.123 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-11-18T23:38:41.604 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2023-11-18T23:38:41.649 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.0 MB 00:00 2023-11-18T23:38:42.686 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-11-18T23:38:43.550 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 7.9 MB 00:01 2023-11-18T23:38:45.470 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-11-18T23:38:46.199 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-11-18T23:38:49.771 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 5.8 MB 00:00 2023-11-18T23:38:50.441 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 5.8 MB 00:00 2023-11-18T23:38:51.255 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2023-11-18T23:38:52.092 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2023-11-18T23:38:52.840 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2023-11-18T23:38:53.588 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-11-18T23:38:57.749 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-11-18T23:38:58.327 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-11-18T23:39:00.520 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T23:39:00.521 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T23:39:00.534 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-18T23:39:00.535 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-18T23:39:00.536 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-18T23:39:00.537 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-18T23:39:00.539 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-18T23:39:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-18T23:39:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-18T23:39:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-11-18T23:39:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-18T23:39:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 217 k 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 18 k 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-18T23:39:00.630 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-18T23:39:00.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-18T23:39:00.632 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-18T23:39:00.633 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-18T23:39:00.634 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-18T23:39:00.635 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-18T23:39:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-18T23:39:00.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-18T23:39:00.638 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-18T23:39:00.639 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-18T23:39:00.640 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:Installing weak dependencies: 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:Install 132 Packages 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 13 Packages 2023-11-18T23:39:00.641 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 200 M 2023-11-18T23:39:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-11-18T23:39:01.013 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T23:39:01.013 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T23:39:01.024 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-18T23:39:01.025 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-18T23:39:01.026 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-18T23:39:01.027 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-18T23:39:01.029 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-18T23:39:01.031 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-18T23:39:01.032 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-18T23:39:01.050 INFO:teuthology.orchestra.run.smithi008.stdout:(1/145): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 38 kB/s | 6.5 kB 00:00 2023-11-18T23:39:01.102 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-11-18T23:39:01.120 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================================ 2023-11-18T23:39:01.120 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-11-18T23:39:01.120 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================================ 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-18T23:39:01.121 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 217 k 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 18 k 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-18T23:39:01.122 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-18T23:39:01.123 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-18T23:39:01.124 INFO:teuthology.orchestra.run.smithi116.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-18T23:39:01.125 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-18T23:39:01.126 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-18T23:39:01.127 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-18T23:39:01.128 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-18T23:39:01.129 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-18T23:39:01.130 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-18T23:39:01.130 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-18T23:39:01.130 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-18T23:39:01.130 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-18T23:39:01.130 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-18T23:39:01.130 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-18T23:39:01.130 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-18T23:39:01.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-18T23:39:01.132 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-18T23:39:01.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-18T23:39:01.134 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-18T23:39:01.135 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-18T23:39:01.135 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-18T23:39:01.135 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-18T23:39:01.135 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2023-11-18T23:39:01.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-18T23:39:01.136 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:01.136 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-11-18T23:39:01.136 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================================ 2023-11-18T23:39:01.136 INFO:teuthology.orchestra.run.smithi116.stdout:Install 132 Packages 2023-11-18T23:39:01.136 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 13 Packages 2023-11-18T23:39:01.136 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:01.137 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 200 M 2023-11-18T23:39:01.137 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-11-18T23:39:01.242 INFO:teuthology.orchestra.run.smithi008.stdout:(2/145): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 4.4 MB/s | 860 kB 00:00 2023-11-18T23:39:01.309 INFO:teuthology.orchestra.run.smithi008.stdout:(3/145): ceph-immutable-object-cache-18.0.0-741 2.1 MB/s | 141 kB 00:00 2023-11-18T23:39:01.626 INFO:teuthology.orchestra.run.smithi008.stdout:(4/145): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 6.6 MB/s | 2.1 MB 00:00 2023-11-18T23:39:01.795 INFO:teuthology.orchestra.run.smithi116.stdout:(1/145): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2023-11-18T23:39:01.826 INFO:teuthology.orchestra.run.smithi008.stdout:(5/145): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 5.5 MB/s | 5.2 MB 00:00 2023-11-18T23:39:01.884 INFO:teuthology.orchestra.run.smithi008.stdout:(6/145): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 5.7 MB/s | 1.5 MB 00:00 2023-11-18T23:39:02.568 INFO:teuthology.orchestra.run.smithi008.stdout:(7/145): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 5.9 MB/s | 4.4 MB 00:00 2023-11-18T23:39:02.703 INFO:teuthology.orchestra.run.smithi116.stdout:(2/145): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 947 kB/s | 860 kB 00:00 2023-11-18T23:39:02.862 INFO:teuthology.orchestra.run.smithi116.stdout:(3/145): ceph-immutable-object-cache-18.0.0-741 889 kB/s | 141 kB 00:00 2023-11-18T23:39:02.960 INFO:teuthology.orchestra.run.smithi008.stdout:(8/145): ceph-common-18.0.0-7418.gb0f45a51.el9. 9.1 MB/s | 19 MB 00:02 2023-11-18T23:39:03.018 INFO:teuthology.orchestra.run.smithi008.stdout:(9/145): ceph-selinux-18.0.0-7418.gb0f45a51.el9 415 kB/s | 24 kB 00:00 2023-11-18T23:39:03.904 INFO:teuthology.orchestra.run.smithi116.stdout:(4/145): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 2.0 MB/s | 2.1 MB 00:01 2023-11-18T23:39:04.060 INFO:teuthology.orchestra.run.smithi008.stdout:(10/145): ceph-radosgw-18.0.0-7418.gb0f45a51.el 5.8 MB/s | 8.6 MB 00:01 2023-11-18T23:39:04.152 INFO:teuthology.orchestra.run.smithi008.stdout:(11/145): cephfs-mirror-18.0.0-7418.gb0f45a51.e 2.3 MB/s | 217 kB 00:00 2023-11-18T23:39:04.337 INFO:teuthology.orchestra.run.smithi116.stdout:(5/145): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 3.4 MB/s | 1.5 MB 00:00 2023-11-18T23:39:04.378 INFO:teuthology.orchestra.run.smithi008.stdout:(12/145): ceph-osd-18.0.0-7418.gb0f45a51.el9.x8 7.1 MB/s | 18 MB 00:02 2023-11-18T23:39:04.403 INFO:teuthology.orchestra.run.smithi008.stdout:(13/145): libcephfs-devel-18.0.0-7418.gb0f45a51 124 kB/s | 31 kB 00:00 2023-11-18T23:39:04.487 INFO:teuthology.orchestra.run.smithi008.stdout:(14/145): libcephsqlite-18.0.0-7418.gb0f45a51.e 1.9 MB/s | 163 kB 00:00 2023-11-18T23:39:04.512 INFO:teuthology.orchestra.run.smithi008.stdout:(15/145): libcephfs2-18.0.0-7418.gb0f45a51.el9. 5.3 MB/s | 718 kB 00:00 2023-11-18T23:39:04.554 INFO:teuthology.orchestra.run.smithi008.stdout:(16/145): librados-devel-18.0.0-7418.gb0f45a51. 1.9 MB/s | 127 kB 00:00 2023-11-18T23:39:04.604 INFO:teuthology.orchestra.run.smithi008.stdout:(17/145): libradosstriper1-18.0.0-7418.gb0f45a5 5.1 MB/s | 475 kB 00:00 2023-11-18T23:39:04.687 INFO:teuthology.orchestra.run.smithi008.stdout:(18/145): python3-ceph-argparse-18.0.0-7418.gb0 542 kB/s | 45 kB 00:00 2023-11-18T23:39:04.796 INFO:teuthology.orchestra.run.smithi008.stdout:(19/145): python3-ceph-common-18.0.0-7418.gb0f4 1.2 MB/s | 129 kB 00:00 2023-11-18T23:39:04.880 INFO:teuthology.orchestra.run.smithi008.stdout:(20/145): python3-cephfs-18.0.0-7418.gb0f45a51. 1.9 MB/s | 162 kB 00:00 2023-11-18T23:39:04.980 INFO:teuthology.orchestra.run.smithi008.stdout:(21/145): python3-rados-18.0.0-7418.gb0f45a51.e 3.1 MB/s | 321 kB 00:00 2023-11-18T23:39:05.080 INFO:teuthology.orchestra.run.smithi008.stdout:(22/145): python3-rbd-18.0.0-7418.gb0f45a51.el9 2.9 MB/s | 299 kB 00:00 2023-11-18T23:39:05.172 INFO:teuthology.orchestra.run.smithi008.stdout:(23/145): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.1 MB/s | 99 kB 00:00 2023-11-18T23:39:05.264 INFO:teuthology.orchestra.run.smithi008.stdout:(24/145): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 932 kB/s | 85 kB 00:00 2023-11-18T23:39:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:(6/145): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 4.4 MB/s | 4.4 MB 00:00 2023-11-18T23:39:05.381 INFO:teuthology.orchestra.run.smithi008.stdout:(25/145): librgw2-18.0.0-7418.gb0f45a51.el9.x86 5.8 MB/s | 4.8 MB 00:00 2023-11-18T23:39:05.473 INFO:teuthology.orchestra.run.smithi008.stdout:(26/145): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 1.8 MB/s | 170 kB 00:00 2023-11-18T23:39:05.557 INFO:teuthology.orchestra.run.smithi008.stdout:(27/145): ceph-grafana-dashboards-18.0.0-7418.g 281 kB/s | 23 kB 00:00 2023-11-18T23:39:05.649 INFO:teuthology.orchestra.run.smithi008.stdout:(28/145): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 1.4 MB/s | 133 kB 00:00 2023-11-18T23:39:05.741 INFO:teuthology.orchestra.run.smithi008.stdout:(29/145): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 6.3 MB/s | 3.0 MB 00:00 2023-11-18T23:39:06.099 INFO:teuthology.orchestra.run.smithi008.stdout:(30/145): ceph-mgr-dashboard-18.0.0-7418.gb0f45 3.9 MB/s | 1.8 MB 00:00 2023-11-18T23:39:06.183 INFO:teuthology.orchestra.run.smithi008.stdout:(31/145): ceph-mgr-modules-core-18.0.0-7418.gb0 2.9 MB/s | 243 kB 00:00 2023-11-18T23:39:06.204 INFO:teuthology.orchestra.run.smithi116.stdout:(7/145): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 1.1 MB/s | 5.2 MB 00:04 2023-11-18T23:39:06.241 INFO:teuthology.orchestra.run.smithi008.stdout:(32/145): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 864 kB/s | 50 kB 00:00 2023-11-18T23:39:06.309 INFO:teuthology.orchestra.run.smithi008.stdout:(33/145): ceph-prometheus-alerts-18.0.0-7418.gb 227 kB/s | 15 kB 00:00 2023-11-18T23:39:06.792 INFO:teuthology.orchestra.run.smithi008.stdout:(34/145): ceph-test-18.0.0-7418.gb0f45a51.el9.x 11 MB/s | 41 MB 00:03 2023-11-18T23:39:06.817 INFO:teuthology.orchestra.run.smithi008.stdout:(35/145): ceph-volume-18.0.0-7418.gb0f45a51.el9 516 kB/s | 262 kB 00:00 2023-11-18T23:39:06.918 INFO:teuthology.orchestra.run.smithi008.stdout:(36/145): ceph-mgr-diskprediction-local-18.0.0- 6.3 MB/s | 7.4 MB 00:01 2023-11-18T23:39:06.943 INFO:teuthology.orchestra.run.smithi008.stdout:(37/145): cephfs-top-18.0.0-7418.gb0f45a51.el9. 146 kB/s | 18 kB 00:00 2023-11-18T23:39:06.985 INFO:teuthology.orchestra.run.smithi008.stdout:(38/145): cephadm-18.0.0-7418.gb0f45a51.el9.noa 3.9 MB/s | 774 kB 00:00 2023-11-18T23:39:07.135 INFO:teuthology.orchestra.run.smithi008.stdout:(39/145): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2023-11-18T23:39:07.169 INFO:teuthology.orchestra.run.smithi008.stdout:(40/145): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2023-11-18T23:39:07.194 INFO:teuthology.orchestra.run.smithi008.stdout:(41/145): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 920 kB 00:00 2023-11-18T23:39:07.219 INFO:teuthology.orchestra.run.smithi008.stdout:(42/145): elfutils-libelf-devel-0.190-1.el9.x86 261 kB/s | 21 kB 00:00 2023-11-18T23:39:07.244 INFO:teuthology.orchestra.run.smithi008.stdout:(43/145): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2023-11-18T23:39:07.270 INFO:teuthology.orchestra.run.smithi008.stdout:(44/145): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2023-11-18T23:39:07.288 INFO:teuthology.orchestra.run.smithi116.stdout:(8/145): ceph-common-18.0.0-7418.gb0f45a51.el9. 3.3 MB/s | 19 MB 00:05 2023-11-18T23:39:07.328 INFO:teuthology.orchestra.run.smithi008.stdout:(45/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-11-18T23:39:07.338 INFO:teuthology.orchestra.run.smithi116.stdout:(9/145): ceph-selinux-18.0.0-7418.gb0f45a51.el9 485 kB/s | 24 kB 00:00 2023-11-18T23:39:07.353 INFO:teuthology.orchestra.run.smithi008.stdout:(46/145): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 17 kB 00:00 2023-11-18T23:39:07.379 INFO:teuthology.orchestra.run.smithi008.stdout:(47/145): jq-1.6-16.el9.x86_64.rpm 1.7 MB/s | 186 kB 00:00 2023-11-18T23:39:07.405 INFO:teuthology.orchestra.run.smithi008.stdout:(48/145): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2023-11-18T23:39:07.429 INFO:teuthology.orchestra.run.smithi008.stdout:(49/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-11-18T23:39:07.455 INFO:teuthology.orchestra.run.smithi008.stdout:(50/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 585 kB/s | 44 kB 00:00 2023-11-18T23:39:07.488 INFO:teuthology.orchestra.run.smithi008.stdout:(51/145): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-11-18T23:39:07.522 INFO:teuthology.orchestra.run.smithi008.stdout:(52/145): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 578 kB 00:00 2023-11-18T23:39:07.539 INFO:teuthology.orchestra.run.smithi008.stdout:(53/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 299 kB/s | 24 kB 00:00 2023-11-18T23:39:07.564 INFO:teuthology.orchestra.run.smithi008.stdout:(54/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-11-18T23:39:07.581 INFO:teuthology.orchestra.run.smithi008.stdout:(55/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 793 kB/s | 46 kB 00:00 2023-11-18T23:39:07.606 INFO:teuthology.orchestra.run.smithi008.stdout:(56/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2023-11-18T23:39:07.623 INFO:teuthology.orchestra.run.smithi008.stdout:(57/145): openblas-0.3.21-2.el9.x86_64.rpm 588 kB/s | 34 kB 00:00 2023-11-18T23:39:07.698 INFO:teuthology.orchestra.run.smithi008.stdout:(58/145): openssl-devel-3.0.7-24.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2023-11-18T23:39:07.740 INFO:teuthology.orchestra.run.smithi008.stdout:(59/145): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2023-11-18T23:39:07.807 INFO:teuthology.orchestra.run.smithi008.stdout:(60/145): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2023-11-18T23:39:07.841 INFO:teuthology.orchestra.run.smithi008.stdout:(61/145): postgresql-contrib-13.11-1.el9.x86_64 5.8 MB/s | 811 kB 00:00 2023-11-18T23:39:07.858 INFO:teuthology.orchestra.run.smithi008.stdout:(62/145): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2023-11-18T23:39:07.958 INFO:teuthology.orchestra.run.smithi008.stdout:(63/145): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2023-11-18T23:39:07.983 INFO:teuthology.orchestra.run.smithi008.stdout:(64/145): python3-jinja2-2.11.3-4.el9.noarch.rp 1.8 MB/s | 228 kB 00:00 2023-11-18T23:39:08.075 INFO:teuthology.orchestra.run.smithi008.stdout:(65/145): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 5.8 MB 00:00 2023-11-18T23:39:08.092 INFO:teuthology.orchestra.run.smithi008.stdout:(66/145): python3-jsonpatch-1.21-16.el9.noarch. 183 kB/s | 24 kB 00:00 2023-11-18T23:39:08.109 INFO:teuthology.orchestra.run.smithi008.stdout:(67/145): python3-jsonpointer-2.0-4.el9.noarch. 148 kB/s | 18 kB 00:00 2023-11-18T23:39:08.126 INFO:teuthology.orchestra.run.smithi008.stdout:(68/145): python3-markupsafe-1.1.1-12.el9.x86_6 955 kB/s | 32 kB 00:00 2023-11-18T23:39:08.151 INFO:teuthology.orchestra.run.smithi008.stdout:(69/145): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-11-18T23:39:08.227 INFO:teuthology.orchestra.run.smithi008.stdout:(70/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2023-11-18T23:39:08.252 INFO:teuthology.orchestra.run.smithi008.stdout:(71/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2023-11-18T23:39:08.277 INFO:teuthology.orchestra.run.smithi008.stdout:(72/145): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 174 kB 00:00 2023-11-18T23:39:08.294 INFO:teuthology.orchestra.run.smithi008.stdout:(73/145): python3-prettytable-0.7.2-27.el9.noar 621 kB/s | 41 kB 00:00 2023-11-18T23:39:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:(74/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.9 MB/s | 132 kB 00:00 2023-11-18T23:39:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:(75/145): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-11-18T23:39:08.378 INFO:teuthology.orchestra.run.smithi008.stdout:(76/145): python3-pytz-2021.1-5.el9.noarch.rpm 566 kB/s | 47 kB 00:00 2023-11-18T23:39:08.403 INFO:teuthology.orchestra.run.smithi008.stdout:(77/145): python3-requests-oauthlib-1.3.0-12.el 858 kB/s | 43 kB 00:00 2023-11-18T23:39:08.413 INFO:teuthology.orchestra.run.smithi116.stdout:(10/145): ceph-osd-18.0.0-7418.gb0f45a51.el9.x8 5.7 MB/s | 18 MB 00:03 2023-11-18T23:39:08.428 INFO:teuthology.orchestra.run.smithi008.stdout:(78/145): python3-toml-0.10.2-6.el9.noarch.rpm 819 kB/s | 39 kB 00:00 2023-11-18T23:39:08.462 INFO:teuthology.orchestra.run.smithi008.stdout:(79/145): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 300 kB 00:00 2023-11-18T23:39:08.480 INFO:teuthology.orchestra.run.smithi116.stdout:(11/145): cephfs-mirror-18.0.0-7418.gb0f45a51.e 3.2 MB/s | 217 kB 00:00 2023-11-18T23:39:08.495 INFO:teuthology.orchestra.run.smithi008.stdout:(80/145): uuid-1.6.2-55.el9.x86_64.rpm 881 kB/s | 56 kB 00:00 2023-11-18T23:39:08.521 INFO:teuthology.orchestra.run.smithi008.stdout:(81/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.5 MB/s | 85 kB 00:00 2023-11-18T23:39:08.539 INFO:teuthology.orchestra.run.smithi116.stdout:(12/145): libcephfs-devel-18.0.0-7418.gb0f45a51 535 kB/s | 31 kB 00:00 2023-11-18T23:39:08.571 INFO:teuthology.orchestra.run.smithi008.stdout:(82/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 859 kB/s | 63 kB 00:00 2023-11-18T23:39:08.689 INFO:teuthology.orchestra.run.smithi116.stdout:(13/145): libcephfs2-18.0.0-7418.gb0f45a51.el9. 4.7 MB/s | 718 kB 00:00 2023-11-18T23:39:08.730 INFO:teuthology.orchestra.run.smithi008.stdout:(83/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2023-11-18T23:39:08.755 INFO:teuthology.orchestra.run.smithi008.stdout:(84/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 190 kB/s | 44 kB 00:00 2023-11-18T23:39:08.756 INFO:teuthology.orchestra.run.smithi116.stdout:(14/145): libcephsqlite-18.0.0-7418.gb0f45a51.e 2.4 MB/s | 163 kB 00:00 2023-11-18T23:39:08.780 INFO:teuthology.orchestra.run.smithi008.stdout:(85/145): fuse-2.9.9-15.el9.x86_64.rpm 380 kB/s | 79 kB 00:00 2023-11-18T23:39:08.822 INFO:teuthology.orchestra.run.smithi008.stdout:(86/145): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-18T23:39:08.823 INFO:teuthology.orchestra.run.smithi116.stdout:(15/145): librados-devel-18.0.0-7418.gb0f45a51. 1.9 MB/s | 127 kB 00:00 2023-11-18T23:39:08.848 INFO:teuthology.orchestra.run.smithi008.stdout:(87/145): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2023-11-18T23:39:08.873 INFO:teuthology.orchestra.run.smithi008.stdout:(88/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-11-18T23:39:08.898 INFO:teuthology.orchestra.run.smithi008.stdout:(89/145): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-11-18T23:39:08.931 INFO:teuthology.orchestra.run.smithi116.stdout:(16/145): libradosstriper1-18.0.0-7418.gb0f45a5 4.3 MB/s | 475 kB 00:00 2023-11-18T23:39:08.940 INFO:teuthology.orchestra.run.smithi008.stdout:(90/145): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-11-18T23:39:08.965 INFO:teuthology.orchestra.run.smithi008.stdout:(91/145): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2023-11-18T23:39:08.990 INFO:teuthology.orchestra.run.smithi008.stdout:(92/145): python3-requests-2.25.1-7.el9.noarch. 1.2 MB/s | 113 kB 00:00 2023-11-18T23:39:09.016 INFO:teuthology.orchestra.run.smithi008.stdout:(93/145): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-18T23:39:09.199 INFO:teuthology.orchestra.run.smithi116.stdout:(17/145): ceph-radosgw-18.0.0-7418.gb0f45a51.el 2.9 MB/s | 8.6 MB 00:02 2023-11-18T23:39:09.224 INFO:teuthology.orchestra.run.smithi008.stdout:(94/145): python3-devel-3.9.17-2.el9.x86_64.rpm 951 kB/s | 245 kB 00:00 2023-11-18T23:39:09.250 INFO:teuthology.orchestra.run.smithi008.stdout:(95/145): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2023-11-18T23:39:09.265 INFO:teuthology.orchestra.run.smithi116.stdout:(18/145): python3-ceph-argparse-18.0.0-7418.gb0 681 kB/s | 45 kB 00:00 2023-11-18T23:39:09.317 INFO:teuthology.orchestra.run.smithi008.stdout:(96/145): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2023-11-18T23:39:09.341 INFO:teuthology.orchestra.run.smithi116.stdout:(19/145): python3-ceph-common-18.0.0-7418.gb0f4 1.7 MB/s | 129 kB 00:00 2023-11-18T23:39:09.367 INFO:teuthology.orchestra.run.smithi008.stdout:(97/145): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2023-11-18T23:39:09.400 INFO:teuthology.orchestra.run.smithi008.stdout:(98/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 139 kB/s | 24 kB 00:00 2023-11-18T23:39:09.449 INFO:teuthology.orchestra.run.smithi116.stdout:(20/145): python3-cephfs-18.0.0-7418.gb0f45a51. 1.5 MB/s | 162 kB 00:00 2023-11-18T23:39:09.567 INFO:teuthology.orchestra.run.smithi008.stdout:(99/145): python3-asyncssh-2.13.2-3.el9.noarch. 3.2 MB/s | 548 kB 00:00 2023-11-18T23:39:09.592 INFO:teuthology.orchestra.run.smithi008.stdout:(100/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.6 MB/s | 837 kB 00:00 2023-11-18T23:39:09.599 INFO:teuthology.orchestra.run.smithi116.stdout:(21/145): python3-rados-18.0.0-7418.gb0f45a51.e 2.1 MB/s | 321 kB 00:00 2023-11-18T23:39:09.610 INFO:teuthology.orchestra.run.smithi008.stdout:(101/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2023-11-18T23:39:09.627 INFO:teuthology.orchestra.run.smithi008.stdout:(102/145): python3-cachetools-4.2.4-1.el9.noarc 951 kB/s | 32 kB 00:00 2023-11-18T23:39:09.652 INFO:teuthology.orchestra.run.smithi008.stdout:(103/145): python3-certifi-2021.10.8-2.el9.noar 357 kB/s | 15 kB 00:00 2023-11-18T23:39:09.702 INFO:teuthology.orchestra.run.smithi008.stdout:(104/145): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2023-11-18T23:39:09.716 INFO:teuthology.orchestra.run.smithi116.stdout:(22/145): librgw2-18.0.0-7418.gb0f45a51.el9.x86 6.1 MB/s | 4.8 MB 00:00 2023-11-18T23:39:09.775 INFO:teuthology.orchestra.run.smithi116.stdout:(23/145): python3-rbd-18.0.0-7418.gb0f45a51.el9 1.7 MB/s | 299 kB 00:00 2023-11-18T23:39:09.778 INFO:teuthology.orchestra.run.smithi008.stdout:(105/145): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-11-18T23:39:09.800 INFO:teuthology.orchestra.run.smithi116.stdout:(24/145): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.2 MB/s | 99 kB 00:00 2023-11-18T23:39:09.803 INFO:teuthology.orchestra.run.smithi008.stdout:(106/145): python3-google-auth-2.23.4-1.el9.noa 1.9 MB/s | 197 kB 00:00 2023-11-18T23:39:09.828 INFO:teuthology.orchestra.run.smithi008.stdout:(107/145): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2023-11-18T23:39:09.834 INFO:teuthology.orchestra.run.smithi116.stdout:(25/145): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.4 MB/s | 85 kB 00:00 2023-11-18T23:39:09.845 INFO:teuthology.orchestra.run.smithi008.stdout:(108/145): python3-jaraco-classes-3.2.1-5.el9.n 421 kB/s | 18 kB 00:00 2023-11-18T23:39:09.862 INFO:teuthology.orchestra.run.smithi008.stdout:(109/145): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2023-11-18T23:39:09.879 INFO:teuthology.orchestra.run.smithi008.stdout:(110/145): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2023-11-18T23:39:09.896 INFO:teuthology.orchestra.run.smithi008.stdout:(111/145): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2023-11-18T23:39:09.913 INFO:teuthology.orchestra.run.smithi008.stdout:(112/145): python3-jwt+crypto-2.4.0-1.el9.noarc 269 kB/s | 9.0 kB 00:00 2023-11-18T23:39:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:(113/145): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2023-11-18T23:39:09.934 INFO:teuthology.orchestra.run.smithi116.stdout:(26/145): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 1.7 MB/s | 170 kB 00:00 2023-11-18T23:39:09.964 INFO:teuthology.orchestra.run.smithi008.stdout:(114/145): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2023-11-18T23:39:10.001 INFO:teuthology.orchestra.run.smithi116.stdout:(27/145): ceph-grafana-dashboards-18.0.0-7418.g 351 kB/s | 23 kB 00:00 2023-11-18T23:39:10.014 INFO:teuthology.orchestra.run.smithi008.stdout:(115/145): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-11-18T23:39:10.048 INFO:teuthology.orchestra.run.smithi008.stdout:(116/145): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2023-11-18T23:39:10.068 INFO:teuthology.orchestra.run.smithi116.stdout:(28/145): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 1.9 MB/s | 133 kB 00:00 2023-11-18T23:39:10.148 INFO:teuthology.orchestra.run.smithi008.stdout:(117/145): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-11-18T23:39:10.231 INFO:teuthology.orchestra.run.smithi008.stdout:(118/145): libarrow-9.0.0-9.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2023-11-18T23:39:10.248 INFO:teuthology.orchestra.run.smithi008.stdout:(119/145): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-11-18T23:39:10.269 INFO:teuthology.orchestra.run.smithi116.stdout:(29/145): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 6.4 MB/s | 3.0 MB 00:00 2023-11-18T23:39:10.282 INFO:teuthology.orchestra.run.smithi008.stdout:(120/145): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2023-11-18T23:39:10.299 INFO:teuthology.orchestra.run.smithi008.stdout:(121/145): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2023-11-18T23:39:10.324 INFO:teuthology.orchestra.run.smithi008.stdout:(122/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 974 kB/s | 90 kB 00:00 2023-11-18T23:39:10.383 INFO:teuthology.orchestra.run.smithi008.stdout:(123/145): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-11-18T23:39:10.408 INFO:teuthology.orchestra.run.smithi008.stdout:(124/145): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2023-11-18T23:39:10.426 INFO:teuthology.orchestra.run.smithi008.stdout:(125/145): python3-rsa-4.9-2.el9.noarch.rpm 469 kB/s | 59 kB 00:00 2023-11-18T23:39:10.443 INFO:teuthology.orchestra.run.smithi008.stdout:(126/145): python3-typing-extensions-4.4.0-2.el 864 kB/s | 51 kB 00:00 2023-11-18T23:39:10.534 INFO:teuthology.orchestra.run.smithi008.stdout:(127/145): python3-websocket-client-1.2.3-2.el9 828 kB/s | 90 kB 00:00 2023-11-18T23:39:10.560 INFO:teuthology.orchestra.run.smithi008.stdout:(128/145): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2023-11-18T23:39:10.576 INFO:teuthology.orchestra.run.smithi008.stdout:(129/145): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2023-11-18T23:39:10.585 INFO:teuthology.orchestra.run.smithi116.stdout:(30/145): ceph-mgr-dashboard-18.0.0-7418.gb0f45 3.4 MB/s | 1.8 MB 00:00 2023-11-18T23:39:10.601 INFO:teuthology.orchestra.run.smithi008.stdout:(130/145): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2023-11-18T23:39:10.719 INFO:teuthology.orchestra.run.smithi116.stdout:(31/145): ceph-mgr-modules-core-18.0.0-7418.gb0 1.8 MB/s | 243 kB 00:00 2023-11-18T23:39:10.778 INFO:teuthology.orchestra.run.smithi116.stdout:(32/145): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 864 kB/s | 50 kB 00:00 2023-11-18T23:39:10.785 INFO:teuthology.orchestra.run.smithi008.stdout:(131/145): re2-20211101-3.el9.x86_64.rpm 850 kB/s | 192 kB 00:00 2023-11-18T23:39:10.836 INFO:teuthology.orchestra.run.smithi116.stdout:(33/145): ceph-prometheus-alerts-18.0.0-7418.gb 260 kB/s | 15 kB 00:00 2023-11-18T23:39:10.987 INFO:teuthology.orchestra.run.smithi116.stdout:(34/145): ceph-volume-18.0.0-7418.gb0f45a51.el9 1.7 MB/s | 262 kB 00:00 2023-11-18T23:39:11.011 INFO:teuthology.orchestra.run.smithi008.stdout:(132/145): librados2-18.0.0-7418.gb0f45a51.el9. 8.1 MB/s | 3.3 MB 00:00 2023-11-18T23:39:11.044 INFO:teuthology.orchestra.run.smithi008.stdout:(133/145): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-18T23:39:11.111 INFO:teuthology.orchestra.run.smithi008.stdout:(134/145): NetworkManager-1.45.6-1.el9.x86_64.r 34 MB/s | 2.2 MB 00:00 2023-11-18T23:39:11.170 INFO:teuthology.orchestra.run.smithi008.stdout:(135/145): NetworkManager-libnm-1.45.6-1.el9.x8 30 MB/s | 1.8 MB 00:00 2023-11-18T23:39:11.203 INFO:teuthology.orchestra.run.smithi008.stdout:(136/145): NetworkManager-team-1.45.6-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-11-18T23:39:11.237 INFO:teuthology.orchestra.run.smithi008.stdout:(137/145): NetworkManager-tui-1.45.6-1.el9.x86_ 7.3 MB/s | 245 kB 00:00 2023-11-18T23:39:11.237 INFO:teuthology.orchestra.run.smithi116.stdout:(35/145): cephadm-18.0.0-7418.gb0f45a51.el9.noa 3.0 MB/s | 774 kB 00:00 2023-11-18T23:39:11.270 INFO:teuthology.orchestra.run.smithi008.stdout:(138/145): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-11-18T23:39:11.304 INFO:teuthology.orchestra.run.smithi008.stdout:(139/145): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-11-18T23:39:11.338 INFO:teuthology.orchestra.run.smithi008.stdout:(140/145): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-11-18T23:39:11.371 INFO:teuthology.orchestra.run.smithi008.stdout:(141/145): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-11-18T23:39:11.387 INFO:teuthology.orchestra.run.smithi116.stdout:(36/145): ceph-mgr-diskprediction-local-18.0.0- 6.6 MB/s | 7.4 MB 00:01 2023-11-18T23:39:11.404 INFO:teuthology.orchestra.run.smithi116.stdout:(37/145): cephfs-top-18.0.0-7418.gb0f45a51.el9. 109 kB/s | 18 kB 00:00 2023-11-18T23:39:11.422 INFO:teuthology.orchestra.run.smithi008.stdout:(142/145): librbd1-18.0.0-7418.gb0f45a51.el9.x8 4.7 MB/s | 3.0 MB 00:00 2023-11-18T23:39:11.447 INFO:teuthology.orchestra.run.smithi008.stdout:(143/145): libacl-2.3.1-4.el9.x86_64.rpm 292 kB/s | 22 kB 00:00 2023-11-18T23:39:11.472 INFO:teuthology.orchestra.run.smithi008.stdout:(144/145): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-11-18T23:39:11.514 INFO:teuthology.orchestra.run.smithi008.stdout:(145/145): thrift-0.15.0-2.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2023-11-18T23:39:11.522 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-11-18T23:39:11.522 INFO:teuthology.orchestra.run.smithi008.stdout:Total 18 MB/s | 200 MB 00:10 2023-11-18T23:39:11.537 INFO:teuthology.orchestra.run.smithi116.stdout:(38/145): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2023-11-18T23:39:11.542 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-11-18T23:39:11.571 INFO:teuthology.orchestra.run.smithi116.stdout:(39/145): bison-3.7.4-5.el9.x86_64.rpm 5.4 MB/s | 920 kB 00:00 2023-11-18T23:39:11.596 INFO:teuthology.orchestra.run.smithi116.stdout:(40/145): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-11-18T23:39:11.621 INFO:teuthology.orchestra.run.smithi116.stdout:(41/145): elfutils-libelf-devel-0.190-1.el9.x86 429 kB/s | 21 kB 00:00 2023-11-18T23:39:11.647 INFO:teuthology.orchestra.run.smithi116.stdout:(42/145): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-11-18T23:39:11.672 INFO:teuthology.orchestra.run.smithi116.stdout:(43/145): flexiblas-3.0.4-8.el9.x86_64.rpm 635 kB/s | 32 kB 00:00 2023-11-18T23:39:11.738 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-11-18T23:39:11.738 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-11-18T23:39:11.747 INFO:teuthology.orchestra.run.smithi116.stdout:(44/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2023-11-18T23:39:11.773 INFO:teuthology.orchestra.run.smithi116.stdout:(45/145): flexiblas-openblas-openmp-3.0.4-8.el9 174 kB/s | 17 kB 00:00 2023-11-18T23:39:12.157 INFO:teuthology.orchestra.run.smithi116.stdout:(46/145): ceph-test-18.0.0-7418.gb0f45a51.el9.x 8.6 MB/s | 41 MB 00:04 2023-11-18T23:39:12.182 INFO:teuthology.orchestra.run.smithi116.stdout:(47/145): libaio-devel-0.3.111-13.el9.x86_64.rp 25 kB/s | 10 kB 00:00 2023-11-18T23:39:12.207 INFO:teuthology.orchestra.run.smithi116.stdout:(48/145): jq-1.6-16.el9.x86_64.rpm 429 kB/s | 186 kB 00:00 2023-11-18T23:39:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:(49/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2023-11-18T23:39:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:(50/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 532 kB/s | 44 kB 00:00 2023-11-18T23:39:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:(51/145): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-11-18T23:39:12.316 INFO:teuthology.orchestra.run.smithi116.stdout:(52/145): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-11-18T23:39:12.342 INFO:teuthology.orchestra.run.smithi116.stdout:(53/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 327 kB/s | 24 kB 00:00 2023-11-18T23:39:12.367 INFO:teuthology.orchestra.run.smithi116.stdout:(54/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 618 kB/s | 46 kB 00:00 2023-11-18T23:39:12.392 INFO:teuthology.orchestra.run.smithi116.stdout:(55/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-11-18T23:39:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:(56/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-11-18T23:39:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:(57/145): openblas-0.3.21-2.el9.x86_64.rpm 453 kB/s | 34 kB 00:00 2023-11-18T23:39:12.526 INFO:teuthology.orchestra.run.smithi116.stdout:(58/145): openblas-openmp-0.3.21-2.el9.x86_64.r 44 MB/s | 4.7 MB 00:00 2023-11-18T23:39:12.618 INFO:teuthology.orchestra.run.smithi116.stdout:(59/145): openssl-devel-3.0.7-24.el9.x86_64.rpm 15 MB/s | 3.0 MB 00:00 2023-11-18T23:39:12.652 INFO:teuthology.orchestra.run.smithi116.stdout:(60/145): postgresql-13.11-1.el9.x86_64.rpm 7.4 MB/s | 1.5 MB 00:00 2023-11-18T23:39:12.677 INFO:teuthology.orchestra.run.smithi116.stdout:(61/145): postgresql-contrib-13.11-1.el9.x86_64 5.5 MB/s | 811 kB 00:00 2023-11-18T23:39:12.702 INFO:teuthology.orchestra.run.smithi116.stdout:(62/145): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 134 kB 00:00 2023-11-18T23:39:12.794 INFO:teuthology.orchestra.run.smithi116.stdout:(63/145): python3-babel-2.9.1-2.el9.noarch.rpm 50 MB/s | 5.8 MB 00:00 2023-11-18T23:39:12.828 INFO:teuthology.orchestra.run.smithi116.stdout:(64/145): python3-jinja2-2.11.3-4.el9.noarch.rp 1.8 MB/s | 228 kB 00:00 2023-11-18T23:39:12.895 INFO:teuthology.orchestra.run.smithi116.stdout:(65/145): postgresql-server-13.11-1.el9.x86_64. 26 MB/s | 5.7 MB 00:00 2023-11-18T23:39:12.911 INFO:teuthology.orchestra.run.smithi116.stdout:(66/145): python3-jsonpatch-1.21-16.el9.noarch. 214 kB/s | 24 kB 00:00 2023-11-18T23:39:12.928 INFO:teuthology.orchestra.run.smithi116.stdout:(67/145): python3-jsonpointer-2.0-4.el9.noarch. 183 kB/s | 18 kB 00:00 2023-11-18T23:39:12.954 INFO:teuthology.orchestra.run.smithi116.stdout:(68/145): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-11-18T23:39:12.970 INFO:teuthology.orchestra.run.smithi116.stdout:(69/145): python3-markupsafe-1.1.1-12.el9.x86_6 540 kB/s | 32 kB 00:00 2023-11-18T23:39:13.046 INFO:teuthology.orchestra.run.smithi116.stdout:(70/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2023-11-18T23:39:13.062 INFO:teuthology.orchestra.run.smithi116.stdout:(71/145): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 174 kB 00:00 2023-11-18T23:39:13.088 INFO:teuthology.orchestra.run.smithi116.stdout:(72/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 217 kB 00:00 2023-11-18T23:39:13.105 INFO:teuthology.orchestra.run.smithi116.stdout:(73/145): python3-prettytable-0.7.2-27.el9.noar 706 kB/s | 41 kB 00:00 2023-11-18T23:39:13.130 INFO:teuthology.orchestra.run.smithi116.stdout:(74/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-11-18T23:39:13.155 INFO:teuthology.orchestra.run.smithi116.stdout:(75/145): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-11-18T23:39:13.172 INFO:teuthology.orchestra.run.smithi116.stdout:(76/145): python3-pytz-2021.1-5.el9.noarch.rpm 710 kB/s | 47 kB 00:00 2023-11-18T23:39:13.189 INFO:teuthology.orchestra.run.smithi116.stdout:(77/145): python3-requests-oauthlib-1.3.0-12.el 730 kB/s | 43 kB 00:00 2023-11-18T23:39:13.206 INFO:teuthology.orchestra.run.smithi116.stdout:(78/145): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-18T23:39:13.298 INFO:teuthology.orchestra.run.smithi116.stdout:(79/145): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 300 kB 00:00 2023-11-18T23:39:13.507 INFO:teuthology.orchestra.run.smithi116.stdout:(80/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2023-11-18T23:39:13.520 INFO:teuthology.orchestra.run.smithi116.stdout:(81/145): uuid-1.6.2-55.el9.x86_64.rpm 181 kB/s | 56 kB 00:00 2023-11-18T23:39:13.545 INFO:teuthology.orchestra.run.smithi116.stdout:(82/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 349 kB/s | 85 kB 00:00 2023-11-18T23:39:13.562 INFO:teuthology.orchestra.run.smithi116.stdout:(83/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-11-18T23:39:13.579 INFO:teuthology.orchestra.run.smithi116.stdout:(84/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-18T23:39:13.604 INFO:teuthology.orchestra.run.smithi116.stdout:(85/145): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-18T23:39:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:(86/145): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-11-18T23:39:13.659 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-11-18T23:39:13.659 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-11-18T23:39:13.663 INFO:teuthology.orchestra.run.smithi116.stdout:(87/145): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-11-18T23:39:13.688 INFO:teuthology.orchestra.run.smithi116.stdout:(88/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2023-11-18T23:39:13.730 INFO:teuthology.orchestra.run.smithi116.stdout:(89/145): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2023-11-18T23:39:13.756 INFO:teuthology.orchestra.run.smithi116.stdout:(90/145): python3-pycparser-2.20-6.el9.noarch.r 1.9 MB/s | 124 kB 00:00 2023-11-18T23:39:13.781 INFO:teuthology.orchestra.run.smithi116.stdout:(91/145): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2023-11-18T23:39:13.806 INFO:teuthology.orchestra.run.smithi116.stdout:(92/145): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-18T23:39:13.831 INFO:teuthology.orchestra.run.smithi116.stdout:(93/145): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-11-18T23:39:14.015 INFO:teuthology.orchestra.run.smithi116.stdout:(94/145): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-11-18T23:39:14.482 INFO:teuthology.orchestra.run.smithi116.stdout:(95/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 52 kB/s | 24 kB 00:00 2023-11-18T23:39:14.615 INFO:teuthology.orchestra.run.smithi116.stdout:(96/145): gperftools-libs-2.9.1-2.el9.x86_64.rp 382 kB/s | 309 kB 00:00 2023-11-18T23:39:14.707 INFO:teuthology.orchestra.run.smithi116.stdout:(97/145): liboath-2.6.7-2.el9.x86_64.rpm 215 kB/s | 49 kB 00:00 2023-11-18T23:39:14.758 INFO:teuthology.orchestra.run.smithi116.stdout:(98/145): libunwind-1.6.2-1.el9.x86_64.rpm 475 kB/s | 67 kB 00:00 2023-11-18T23:39:15.024 INFO:teuthology.orchestra.run.smithi116.stdout:(99/145): python3-asyncssh-2.13.2-3.el9.noarch. 2.0 MB/s | 548 kB 00:00 2023-11-18T23:39:15.100 INFO:teuthology.orchestra.run.smithi116.stdout:(100/145): libarrow-9.0.0-9.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2023-11-18T23:39:15.150 INFO:teuthology.orchestra.run.smithi116.stdout:(101/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 347 kB/s | 43 kB 00:00 2023-11-18T23:39:15.225 INFO:teuthology.orchestra.run.smithi116.stdout:(102/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.6 MB/s | 837 kB 00:00 2023-11-18T23:39:15.250 INFO:teuthology.orchestra.run.smithi116.stdout:(103/145): python3-cachetools-4.2.4-1.el9.noarc 214 kB/s | 32 kB 00:00 2023-11-18T23:39:15.276 INFO:teuthology.orchestra.run.smithi116.stdout:(104/145): python3-certifi-2021.10.8-2.el9.noar 119 kB/s | 15 kB 00:00 2023-11-18T23:39:15.441 INFO:teuthology.orchestra.run.smithi116.stdout:(105/145): python3-cheroot-8.6.0-4.el9.noarch.r 798 kB/s | 172 kB 00:00 2023-11-18T23:39:15.535 INFO:teuthology.orchestra.run.smithi116.stdout:(106/145): python3-google-auth-2.23.4-1.el9.noa 763 kB/s | 197 kB 00:00 2023-11-18T23:39:15.577 INFO:teuthology.orchestra.run.smithi116.stdout:(107/145): python3-cherrypy-18.6.1-2.el9.noarch 1.1 MB/s | 358 kB 00:00 2023-11-18T23:39:15.602 INFO:teuthology.orchestra.run.smithi116.stdout:(108/145): python3-jaraco-8.2.1-3.el9.noarch.rp 66 kB/s | 11 kB 00:00 2023-11-18T23:39:15.661 INFO:teuthology.orchestra.run.smithi116.stdout:(109/145): python3-jaraco-classes-3.2.1-5.el9.n 140 kB/s | 18 kB 00:00 2023-11-18T23:39:15.703 INFO:teuthology.orchestra.run.smithi116.stdout:(110/145): python3-jaraco-collections-3.0.0-8.e 185 kB/s | 23 kB 00:00 2023-11-18T23:39:15.755 INFO:teuthology.orchestra.run.smithi116.stdout:(111/145): python3-jaraco-functools-3.5.0-2.el9 155 kB/s | 19 kB 00:00 2023-11-18T23:39:15.787 INFO:teuthology.orchestra.run.smithi116.stdout:(112/145): python3-jaraco-text-3.2.0-6.el9.noar 156 kB/s | 20 kB 00:00 2023-11-18T23:39:15.820 INFO:teuthology.orchestra.run.smithi116.stdout:(113/145): python3-jwt+crypto-2.4.0-1.el9.noarc 77 kB/s | 9.0 kB 00:00 2023-11-18T23:39:15.854 INFO:teuthology.orchestra.run.smithi116.stdout:(114/145): python3-jwt-2.4.0-1.el9.noarch.rpm 326 kB/s | 41 kB 00:00 2023-11-18T23:39:15.929 INFO:teuthology.orchestra.run.smithi116.stdout:(115/145): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2023-11-18T23:39:15.954 INFO:teuthology.orchestra.run.smithi116.stdout:(116/145): python3-logutils-0.3.5-21.el9.noarch 346 kB/s | 46 kB 00:00 2023-11-18T23:39:15.979 INFO:teuthology.orchestra.run.smithi116.stdout:(117/145): python3-more-itertools-8.12.0-2.el9. 627 kB/s | 79 kB 00:00 2023-11-18T23:39:16.055 INFO:teuthology.orchestra.run.smithi116.stdout:(118/145): python3-natsort-7.1.1-5.el9.noarch.r 460 kB/s | 58 kB 00:00 2023-11-18T23:39:16.097 INFO:teuthology.orchestra.run.smithi116.stdout:(119/145): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2023-11-18T23:39:16.114 INFO:teuthology.orchestra.run.smithi116.stdout:(120/145): python3-portend-3.1.0-2.el9.noarch.r 123 kB/s | 16 kB 00:00 2023-11-18T23:39:16.181 INFO:teuthology.orchestra.run.smithi116.stdout:(121/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 718 kB/s | 90 kB 00:00 2023-11-18T23:39:16.214 INFO:teuthology.orchestra.run.smithi116.stdout:(122/145): python3-repoze-lru-0.7-16.el9.noarch 262 kB/s | 31 kB 00:00 2023-11-18T23:39:16.256 INFO:teuthology.orchestra.run.smithi116.stdout:(123/145): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2023-11-18T23:39:16.306 INFO:teuthology.orchestra.run.smithi116.stdout:(124/145): python3-rsa-4.9-2.el9.noarch.rpm 471 kB/s | 59 kB 00:00 2023-11-18T23:39:16.332 INFO:teuthology.orchestra.run.smithi116.stdout:(125/145): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2023-11-18T23:39:16.382 INFO:teuthology.orchestra.run.smithi116.stdout:(126/145): python3-typing-extensions-4.4.0-2.el 406 kB/s | 51 kB 00:00 2023-11-18T23:39:16.432 INFO:teuthology.orchestra.run.smithi116.stdout:(127/145): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-11-18T23:39:16.457 INFO:teuthology.orchestra.run.smithi116.stdout:(128/145): python3-websocket-client-1.2.3-2.el9 715 kB/s | 90 kB 00:00 2023-11-18T23:39:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:(129/145): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2023-11-18T23:39:16.575 INFO:teuthology.orchestra.run.smithi116.stdout:(130/145): python3-zc-lockfile-2.0-10.el9.noarc 140 kB/s | 20 kB 00:00 2023-11-18T23:39:16.600 INFO:teuthology.orchestra.run.smithi116.stdout:(131/145): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-11-18T23:39:16.842 INFO:teuthology.orchestra.run.smithi116.stdout:(132/145): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2023-11-18T23:39:16.867 INFO:teuthology.orchestra.run.smithi116.stdout:(133/145): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 68 kB 00:00 2023-11-18T23:39:16.934 INFO:teuthology.orchestra.run.smithi116.stdout:(134/145): NetworkManager-1.45.6-1.el9.x86_64.r 34 MB/s | 2.2 MB 00:00 2023-11-18T23:39:16.992 INFO:teuthology.orchestra.run.smithi116.stdout:(135/145): NetworkManager-libnm-1.45.6-1.el9.x8 30 MB/s | 1.8 MB 00:00 2023-11-18T23:39:17.027 INFO:teuthology.orchestra.run.smithi116.stdout:(136/145): NetworkManager-team-1.45.6-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-11-18T23:39:17.061 INFO:teuthology.orchestra.run.smithi116.stdout:(137/145): NetworkManager-tui-1.45.6-1.el9.x86_ 7.2 MB/s | 245 kB 00:00 2023-11-18T23:39:17.095 INFO:teuthology.orchestra.run.smithi116.stdout:(138/145): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-11-18T23:39:17.120 INFO:teuthology.orchestra.run.smithi116.stdout:(139/145): elfutils-debuginfod-client-0.190-1.e 1.4 MB/s | 36 kB 00:00 2023-11-18T23:39:17.154 INFO:teuthology.orchestra.run.smithi116.stdout:(140/145): elfutils-libelf-0.190-1.el9.x86_64.r 5.6 MB/s | 192 kB 00:00 2023-11-18T23:39:17.204 INFO:teuthology.orchestra.run.smithi116.stdout:(141/145): librados2-18.0.0-7418.gb0f45a51.el9. 5.3 MB/s | 3.3 MB 00:00 2023-11-18T23:39:17.229 INFO:teuthology.orchestra.run.smithi116.stdout:(142/145): elfutils-libs-0.190-1.el9.x86_64.rpm 3.3 MB/s | 255 kB 00:00 2023-11-18T23:39:17.246 INFO:teuthology.orchestra.run.smithi116.stdout:(143/145): libacl-2.3.1-4.el9.x86_64.rpm 530 kB/s | 22 kB 00:00 2023-11-18T23:39:17.271 INFO:teuthology.orchestra.run.smithi116.stdout:(144/145): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2023-11-18T23:39:17.513 INFO:teuthology.orchestra.run.smithi116.stdout:(145/145): librbd1-18.0.0-7418.gb0f45a51.el9.x8 3.3 MB/s | 3.0 MB 00:00 2023-11-18T23:39:17.520 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-11-18T23:39:17.520 INFO:teuthology.orchestra.run.smithi116.stdout:Total 12 MB/s | 200 MB 00:16 2023-11-18T23:39:17.545 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-11-18T23:39:17.723 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-11-18T23:39:17.723 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-11-18T23:39:19.460 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-11-18T23:39:19.461 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-11-18T23:39:19.649 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-11-18T23:39:19.722 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/158 2023-11-18T23:39:19.747 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/158 2023-11-18T23:39:19.801 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/158 2023-11-18T23:39:20.141 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/158 2023-11-18T23:39:20.189 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T23:39:20.320 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T23:39:20.349 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T23:39:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T23:39:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T23:39:20.580 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/158 2023-11-18T23:39:20.816 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/158 2023-11-18T23:39:20.871 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/158 2023-11-18T23:39:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/158 2023-11-18T23:39:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/158 2023-11-18T23:39:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T23:39:21.241 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T23:39:21.264 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T23:39:21.326 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T23:39:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/158 2023-11-18T23:39:21.618 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T23:39:21.670 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T23:39:21.762 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T23:39:21.805 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T23:39:22.096 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T23:39:22.134 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/158 2023-11-18T23:39:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/158 2023-11-18T23:39:22.259 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/158 2023-11-18T23:39:22.288 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/158 2023-11-18T23:39:22.332 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/158 2023-11-18T23:39:22.372 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/158 2023-11-18T23:39:22.450 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/158 2023-11-18T23:39:22.496 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/158 2023-11-18T23:39:22.523 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/158 2023-11-18T23:39:22.597 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/158 2023-11-18T23:39:22.629 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 28/158 2023-11-18T23:39:22.673 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 29/158 2023-11-18T23:39:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 30/158 2023-11-18T23:39:22.890 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/158 2023-11-18T23:39:22.951 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/158 2023-11-18T23:39:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/158 2023-11-18T23:39:23.615 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/158 2023-11-18T23:39:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/158 2023-11-18T23:39:23.701 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 36/158 2023-11-18T23:39:23.738 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 37/158 2023-11-18T23:39:23.768 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/158 2023-11-18T23:39:23.879 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : re2-1:20211101-3.el9.x86_64 39/158 2023-11-18T23:39:23.914 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 40/158 2023-11-18T23:39:23.972 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/158 2023-11-18T23:39:24.046 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/158 2023-11-18T23:39:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/158 2023-11-18T23:39:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 44/158 2023-11-18T23:39:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/158 2023-11-18T23:39:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/158 2023-11-18T23:39:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/158 2023-11-18T23:39:24.389 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/158 2023-11-18T23:39:24.437 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/158 2023-11-18T23:39:24.480 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 50/158 2023-11-18T23:39:24.579 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/158 2023-11-18T23:39:24.613 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 52/158 2023-11-18T23:39:24.652 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/158 2023-11-18T23:39:24.685 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/158 2023-11-18T23:39:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 55/158 2023-11-18T23:39:24.830 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 56/158 2023-11-18T23:39:24.898 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/158 2023-11-18T23:39:24.962 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/158 2023-11-18T23:39:25.171 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/158 2023-11-18T23:39:25.218 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/158 2023-11-18T23:39:25.288 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-11-18T23:39:25.349 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/158 2023-11-18T23:39:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/158 2023-11-18T23:39:25.382 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/158 2023-11-18T23:39:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/158 2023-11-18T23:39:25.434 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/158 2023-11-18T23:39:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/158 2023-11-18T23:39:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/158 2023-11-18T23:39:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/158 2023-11-18T23:39:25.554 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/158 2023-11-18T23:39:25.582 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 67/158 2023-11-18T23:39:25.624 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/158 2023-11-18T23:39:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/158 2023-11-18T23:39:25.705 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/158 2023-11-18T23:39:25.759 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/158 2023-11-18T23:39:25.784 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/158 2023-11-18T23:39:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T23:39:25.883 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/158 2023-11-18T23:39:25.919 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/158 2023-11-18T23:39:25.945 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T23:39:25.953 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/158 2023-11-18T23:39:25.976 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T23:39:25.995 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/158 2023-11-18T23:39:26.029 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/158 2023-11-18T23:39:26.051 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T23:39:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T23:39:26.125 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/158 2023-11-18T23:39:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/158 2023-11-18T23:39:26.169 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/158 2023-11-18T23:39:26.173 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/158 2023-11-18T23:39:26.226 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/158 2023-11-18T23:39:26.284 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/158 2023-11-18T23:39:26.342 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/158 2023-11-18T23:39:26.403 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/158 2023-11-18T23:39:26.446 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/158 2023-11-18T23:39:26.474 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T23:39:26.576 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T23:39:26.600 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T23:39:26.662 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T23:39:26.889 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/158 2023-11-18T23:39:27.015 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T23:39:27.075 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T23:39:27.146 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/158 2023-11-18T23:39:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T23:39:27.196 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/158 2023-11-18T23:39:27.229 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/158 2023-11-18T23:39:27.251 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T23:39:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/158 2023-11-18T23:39:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/158 2023-11-18T23:39:27.485 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/158 2023-11-18T23:39:27.522 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T23:39:27.556 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/158 2023-11-18T23:39:27.565 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/158 2023-11-18T23:39:27.624 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/158 2023-11-18T23:39:27.677 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/158 2023-11-18T23:39:27.709 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/158 2023-11-18T23:39:27.752 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/158 2023-11-18T23:39:27.792 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/158 2023-11-18T23:39:27.856 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/158 2023-11-18T23:39:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/158 2023-11-18T23:39:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/158 2023-11-18T23:39:27.988 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/158 2023-11-18T23:39:28.023 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 28/158 2023-11-18T23:39:28.067 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 29/158 2023-11-18T23:39:28.141 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 30/158 2023-11-18T23:39:28.277 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/158 2023-11-18T23:39:28.278 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/158 2023-11-18T23:39:28.327 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/158 2023-11-18T23:39:28.398 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/158 2023-11-18T23:39:28.881 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/158 2023-11-18T23:39:28.966 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/158 2023-11-18T23:39:29.001 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/158 2023-11-18T23:39:29.046 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 36/158 2023-11-18T23:39:29.083 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 37/158 2023-11-18T23:39:29.113 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/158 2023-11-18T23:39:29.224 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-3.el9.x86_64 39/158 2023-11-18T23:39:29.471 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 40/158 2023-11-18T23:39:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/158 2023-11-18T23:39:29.627 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/158 2023-11-18T23:39:29.660 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/158 2023-11-18T23:39:29.696 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 44/158 2023-11-18T23:39:29.739 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/158 2023-11-18T23:39:29.742 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/158 2023-11-18T23:39:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/158 2023-11-18T23:39:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/158 2023-11-18T23:39:29.829 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/158 2023-11-18T23:39:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/158 2023-11-18T23:39:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-16.el9.x86_64 93/158 2023-11-18T23:39:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/158 2023-11-18T23:39:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 95/158 2023-11-18T23:39:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/158 2023-11-18T23:39:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/158 2023-11-18T23:39:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 50/158 2023-11-18T23:39:30.141 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/158 2023-11-18T23:39:30.182 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 52/158 2023-11-18T23:39:30.223 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/158 2023-11-18T23:39:30.255 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/158 2023-11-18T23:39:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/158 2023-11-18T23:39:30.291 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T23:39:30.349 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 55/158 2023-11-18T23:39:30.365 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T23:39:30.395 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/158 2023-11-18T23:39:30.400 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 56/158 2023-11-18T23:39:30.432 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/158 2023-11-18T23:39:30.440 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/158 2023-11-18T23:39:30.495 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/158 2023-11-18T23:39:30.687 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/158 2023-11-18T23:39:30.737 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/158 2023-11-18T23:39:30.875 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/158 2023-11-18T23:39:30.883 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T23:39:30.915 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/158 2023-11-18T23:39:30.944 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/158 2023-11-18T23:39:30.978 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/158 2023-11-18T23:39:31.011 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/158 2023-11-18T23:39:31.035 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T23:39:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/158 2023-11-18T23:39:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 67/158 2023-11-18T23:39:31.107 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T23:39:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/158 2023-11-18T23:39:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/158 2023-11-18T23:39:31.147 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/158 2023-11-18T23:39:31.182 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/158 2023-11-18T23:39:31.212 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/158 2023-11-18T23:39:31.289 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/158 2023-11-18T23:39:31.322 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/158 2023-11-18T23:39:31.356 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/158 2023-11-18T23:39:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/158 2023-11-18T23:39:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/158 2023-11-18T23:39:31.514 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/158 2023-11-18T23:39:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/158 2023-11-18T23:39:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/158 2023-11-18T23:39:31.711 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/158 2023-11-18T23:39:32.461 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/158 2023-11-18T23:39:32.507 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/158 2023-11-18T23:39:32.540 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/158 2023-11-18T23:39:32.573 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/158 2023-11-18T23:39:32.750 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/158 2023-11-18T23:39:32.792 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/158 2023-11-18T23:39:32.874 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/158 2023-11-18T23:39:33.373 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T23:39:33.408 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T23:39:33.531 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/158 2023-11-18T23:39:33.654 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/158 2023-11-18T23:39:33.986 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T23:39:34.020 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T23:39:34.108 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T23:39:34.108 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-18T23:39:34.108 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-18T23:39:34.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:34.146 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T23:39:34.905 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/158 2023-11-18T23:39:35.004 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/158 2023-11-18T23:39:35.036 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/158 2023-11-18T23:39:35.066 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.6-16.el9.x86_64 93/158 2023-11-18T23:39:35.095 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/158 2023-11-18T23:39:35.128 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 95/158 2023-11-18T23:39:35.457 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/158 2023-11-18T23:39:35.491 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T23:39:35.581 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T23:39:35.612 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/158 2023-11-18T23:39:35.649 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/158 2023-11-18T23:39:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T23:39:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T23:39:36.181 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T23:39:36.203 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/158 2023-11-18T23:39:38.269 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T23:39:38.300 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T23:39:38.852 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T23:39:38.895 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T23:39:38.990 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T23:39:38.990 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-18T23:39:38.991 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-18T23:39:38.991 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T23:39:46.087 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T23:39:46.087 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-11-18T23:39:46.088 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-11-18T23:39:46.088 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-11-18T23:39:46.088 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-11-18T23:39:46.088 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-11-18T23:39:46.088 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /root 2023-11-18T23:39:46.088 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-11-18T23:39:46.088 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:46.266 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T23:39:46.283 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T23:39:46.283 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:46.283 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-18T23:39:46.283 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:47.903 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T23:39:47.930 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T23:39:47.931 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:47.931 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-18T23:39:47.931 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T23:39:47.931 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T23:39:47.932 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:48.145 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T23:39:48.169 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T23:39:48.169 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:48.170 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-18T23:39:48.170 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T23:39:48.170 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T23:39:48.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T23:39:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T23:39:48.661 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:48.661 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-18T23:39:48.661 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T23:39:48.662 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T23:39:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.2-8.el9.noarch 110/158 2023-11-18T23:39:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T23:39:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T23:39:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 112/158 2023-11-18T23:39:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 113/158 2023-11-18T23:39:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T23:39:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T23:39:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T23:39:50.242 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T23:39:50.242 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2023-11-18T23:39:50.242 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2023-11-18T23:39:50.242 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2023-11-18T23:39:50.243 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2023-11-18T23:39:50.243 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2023-11-18T23:39:50.243 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2023-11-18T23:39:50.243 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2023-11-18T23:39:50.243 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:50.407 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T23:39:50.422 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T23:39:50.422 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:50.422 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-18T23:39:50.422 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:50.629 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T23:39:50.662 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T23:39:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T23:39:50.934 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 117/158 2023-11-18T23:39:50.964 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T23:39:50.989 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T23:39:50.989 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:50.989 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-18T23:39:50.989 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T23:39:50.989 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T23:39:50.990 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:51.040 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T23:39:51.051 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T23:39:51.100 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/158 2023-11-18T23:39:51.925 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/158 2023-11-18T23:39:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T23:39:51.968 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T23:39:51.974 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T23:39:51.974 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:51.974 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-18T23:39:51.974 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T23:39:51.974 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T23:39:51.975 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T23:39:51.993 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:51.993 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-18T23:39:51.994 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T23:39:51.994 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T23:39:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T23:39:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T23:39:52.033 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:52.033 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-18T23:39:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:52.076 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T23:39:52.100 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T23:39:52.100 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:52.100 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-18T23:39:52.100 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T23:39:52.101 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T23:39:52.101 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:52.193 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T23:39:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T23:39:52.216 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:52.216 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-18T23:39:52.216 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T23:39:52.216 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T23:39:52.216 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T23:39:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T23:39:52.452 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-18T23:39:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T23:39:52.453 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T23:39:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:39:52.669 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T23:39:52.691 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T23:39:52.691 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:52.691 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-18T23:39:52.692 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T23:39:52.692 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T23:39:52.692 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:52.796 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.2-8.el9.noarch 110/158 2023-11-18T23:39:53.201 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T23:39:53.227 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T23:39:53.256 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 112/158 2023-11-18T23:39:53.310 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 113/158 2023-11-18T23:39:53.334 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T23:39:53.555 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T23:39:53.585 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T23:39:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T23:39:54.577 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T23:39:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T23:39:54.825 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 117/158 2023-11-18T23:39:54.853 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T23:39:54.877 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T23:39:54.877 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:54.877 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-18T23:39:54.877 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T23:39:54.878 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T23:39:54.878 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:54.921 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T23:39:54.931 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T23:39:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/158 2023-11-18T23:39:55.760 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/158 2023-11-18T23:39:55.807 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T23:39:55.829 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T23:39:55.829 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:55.829 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-18T23:39:55.829 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T23:39:55.829 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T23:39:55.829 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:55.874 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T23:39:55.896 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T23:39:55.896 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:55.896 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-18T23:39:55.896 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:55.941 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T23:39:55.963 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T23:39:55.963 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:55.963 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-18T23:39:55.963 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T23:39:55.964 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T23:39:55.964 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:56.266 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T23:39:56.289 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T23:39:56.289 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T23:39:56.289 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-18T23:39:56.290 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T23:39:56.290 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T23:39:56.290 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:39:56.648 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/158 2023-11-18T23:39:56.689 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 127/158 2023-11-18T23:39:56.732 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/158 2023-11-18T23:39:56.762 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 129/158 2023-11-18T23:39:56.954 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 130/158 2023-11-18T23:39:57.073 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 131/158 2023-11-18T23:39:57.118 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 132/158 2023-11-18T23:39:57.151 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 133/158 2023-11-18T23:39:57.191 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 134/158 2023-11-18T23:39:57.221 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 135/158 2023-11-18T23:39:57.285 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 136/158 2023-11-18T23:39:57.343 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T23:39:57.378 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/158 2023-11-18T23:39:57.986 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T23:39:58.027 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T23:39:58.049 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T23:39:58.105 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 140/158 2023-11-18T23:39:59.014 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 141/158 2023-11-18T23:39:59.082 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/158 2023-11-18T23:39:59.125 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/158 2023-11-18T23:39:59.217 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/158 2023-11-18T23:39:59.252 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/158 2023-11-18T23:39:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T23:39:59.303 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 147/158 2023-11-18T23:39:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 148/158 2023-11-18T23:39:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T23:39:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T23:39:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 150/158 2023-11-18T23:39:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 151/158 2023-11-18T23:39:59.488 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 152/158 2023-11-18T23:39:59.496 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T23:39:59.496 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T23:39:59.685 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T23:39:59.685 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T23:39:59.768 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T23:39:59.793 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 155/158 2023-11-18T23:39:59.793 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T23:39:59.878 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T23:39:59.903 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 157/158 2023-11-18T23:39:59.979 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T23:40:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/158 2023-11-18T23:40:00.144 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 127/158 2023-11-18T23:40:00.185 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/158 2023-11-18T23:40:00.209 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 129/158 2023-11-18T23:40:00.394 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 130/158 2023-11-18T23:40:00.508 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 131/158 2023-11-18T23:40:00.549 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 132/158 2023-11-18T23:40:00.582 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 133/158 2023-11-18T23:40:00.622 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 134/158 2023-11-18T23:40:00.660 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 135/158 2023-11-18T23:40:00.724 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 136/158 2023-11-18T23:40:00.772 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T23:40:00.825 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/158 2023-11-18T23:40:01.437 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T23:40:01.474 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T23:40:01.494 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T23:40:01.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 140/158 2023-11-18T23:40:02.384 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 141/158 2023-11-18T23:40:02.462 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/158 2023-11-18T23:40:02.503 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/158 2023-11-18T23:40:02.588 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/158 2023-11-18T23:40:02.623 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/158 2023-11-18T23:40:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T23:40:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 147/158 2023-11-18T23:40:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 148/158 2023-11-18T23:40:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T23:40:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T23:40:02.812 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 150/158 2023-11-18T23:40:02.828 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 151/158 2023-11-18T23:40:02.853 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 152/158 2023-11-18T23:40:02.861 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T23:40:02.861 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T23:40:03.048 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T23:40:03.048 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T23:40:03.131 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T23:40:03.155 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 155/158 2023-11-18T23:40:03.156 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T23:40:03.240 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T23:40:03.266 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 157/158 2023-11-18T23:40:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T23:40:04.681 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T23:40:08.027 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/158 2023-11-18T23:40:08.027 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/158 2023-11-18T23:40:08.027 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/158 2023-11-18T23:40:08.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 14/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 16/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 17/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 18/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 19/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 20/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 21/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 22/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/158 2023-11-18T23:40:08.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 28/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 29/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 30/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 31/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 32/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 33/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 34/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 35/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 36/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 37/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 38/158 2023-11-18T23:40:08.030 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-16.el9.x86_64 47/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/158 2023-11-18T23:40:08.031 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/158 2023-11-18T23:40:08.032 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/158 2023-11-18T23:40:08.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/158 2023-11-18T23:40:08.034 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/158 2023-11-18T23:40:08.035 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/158 2023-11-18T23:40:08.036 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/158 2023-11-18T23:40:08.037 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 133/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 135/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T23:40:08.038 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/158 2023-11-18T23:40:08.039 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/158 2023-11-18T23:40:08.041 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: acl-2.3.1-4.el9.x86_64 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-18T23:40:08.042 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.2-8.el9.noarch 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.7.4-5.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.044 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.4-9.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-16.el9.x86_64 2023-11-18T23:40:08.045 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.046 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-18T23:40:08.047 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-13.11-1.el9.x86_64 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-18T23:40:08.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-18T23:40:08.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-18T23:40:08.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-18T23:40:08.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-18T23:40:08.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply-3.11-14.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-18T23:40:08.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-18T23:40:08.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: re2-1:20211101-3.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:08.055 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-11-18T23:40:08.056 DEBUG:teuthology.parallel:result is None 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/158 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/158 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/158 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/158 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/158 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T23:40:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 14/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 16/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 17/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 18/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 19/158 2023-11-18T23:40:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 20/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 21/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 22/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 28/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 29/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 30/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 31/158 2023-11-18T23:40:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 32/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 33/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 34/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 35/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 36/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 37/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 38/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/158 2023-11-18T23:40:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.6-16.el9.x86_64 47/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/158 2023-11-18T23:40:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/158 2023-11-18T23:40:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/158 2023-11-18T23:40:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/158 2023-11-18T23:40:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/158 2023-11-18T23:40:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/158 2023-11-18T23:40:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/158 2023-11-18T23:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 133/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 135/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T23:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/158 2023-11-18T23:40:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/158 2023-11-18T23:40:10.289 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: acl-2.3.1-4.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-18T23:40:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.2-8.el9.noarch 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.7.4-5.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.4-9.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-18T23:40:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.6-16.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.294 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-18T23:40:10.295 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-13.11-1.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-18T23:40:10.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-18T23:40:10.297 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-18T23:40:10.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-18T23:40:10.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-18T23:40:10.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-18T23:40:10.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-3.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-18T23:40:10.302 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-18T23:40:10.303 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-18T23:40:10.303 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:10.303 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-11-18T23:40:10.711 DEBUG:teuthology.parallel:result is None 2023-11-18T23:40:10.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T23:40:10.945 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-18T23:40:10.971 INFO:teuthology.orchestra.run.smithi008.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-18T23:40:10.972 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-18T23:40:10.972 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-18T23:40:10.972 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T23:40:11.116 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-18T23:40:11.138 INFO:teuthology.orchestra.run.smithi116.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-18T23:40:11.138 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-18T23:40:11.139 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-18T23:40:11.139 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-18T23:40:11.139 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:11.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T23:40:11.178 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:11.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T23:40:11.211 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-18T23:40:11.211 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:11.212 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T23:40:11.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T23:40:11.327 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:11.327 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T23:40:11.354 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T23:40:11.420 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-18T23:40:11.421 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:11.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T23:40:11.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T23:40:11.527 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:11.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T23:40:11.555 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T23:40:11.622 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-18T23:40:11.622 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:11.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T23:40:11.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T23:40:11.726 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:11.727 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T23:40:11.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T23:40:11.821 INFO:teuthology.run_tasks:Running task ceph... 2023-11-18T23:40:11.886 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-18T23:40:11.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2023-11-18T23:40:11.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2023-11-18T23:40:11.918 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-18T23:40:11.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T23:40:11.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T23:40:11.989 INFO:tasks.ceph:Creating extra log directories... 2023-11-18T23:40:11.989 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T23:40:12.032 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T23:40:12.066 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-18T23:40:12.066 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-18T23:40:12.067 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-18T23:40:12.067 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:12.067 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T23:40:12.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T23:40:12.246 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-18T23:40:12.277 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:12.277 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T23:40:12.292 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T23:40:12.410 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-18T23:40:12.442 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-18T23:40:12.442 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-18T23:40:12.443 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461799', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7461799', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1491, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi008.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDv1UA29E/bd2moLgdPGqzblNqMWJNY6RKhfINpNqLEUsAY5hRBk/p0/+Ml5LpIogY48MO5AKdKsK8BsyqrcCIY=', 'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2Tj7DI+fVI4kmFUuOvnTBZ0/JLt4QUnRWsOG6iOs8cv48ouF+piGrpfGcmdNx4yjVsdwiPYb4mUgB1gvNJZbg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-18_13:51:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-18T23:40:12.443 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T23:40:12.445 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T23:40:12.492 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T23:40:12.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T23:40:12.559 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:12.559 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T23:40:12.585 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T23:40:12.586 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-11-18T23:40:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T23:40:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:12.641 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-18T23:40:12.641 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:12.641 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:12.641 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-11-18 23:40:00.325898562 +0000 2023-11-18T23:40:12.641 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-11-18 23:38:13.423732817 +0000 2023-11-18T23:40:12.642 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-11-18 23:38:13.423732817 +0000 2023-11-18T23:40:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-11-18 23:38:13.423732817 +0000 2023-11-18T23:40:12.642 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T23:40:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-11-18T23:40:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-11-18T23:40:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 8.2267e-05 s, 6.2 MB/s 2023-11-18T23:40:12.711 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T23:40:12.767 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-11-18T23:40:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T23:40:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-18T23:40:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-11-18 23:40:00.326898552 +0000 2023-11-18T23:40:12.823 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-11-18 23:38:13.908727826 +0000 2023-11-18T23:40:12.823 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-11-18 23:38:13.908727826 +0000 2023-11-18T23:40:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-11-18 23:38:13.908727826 +0000 2023-11-18T23:40:12.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T23:40:12.891 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-11-18T23:40:12.891 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-11-18T23:40:12.891 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.5381e-05 s, 5.4 MB/s 2023-11-18T23:40:12.892 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T23:40:12.949 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-11-18T23:40:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T23:40:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:13.004 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-18T23:40:13.004 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:13.005 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:13.005 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-11-18 23:40:00.326898552 +0000 2023-11-18T23:40:13.005 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-11-18 23:38:14.407722692 +0000 2023-11-18T23:40:13.005 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-11-18 23:38:14.407722692 +0000 2023-11-18T23:40:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-11-18 23:38:14.407722692 +0000 2023-11-18T23:40:13.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T23:40:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-11-18T23:40:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-11-18T23:40:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.3098e-05 s, 5.5 MB/s 2023-11-18T23:40:13.075 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T23:40:13.131 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-11-18T23:40:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T23:40:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-18T23:40:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-11-18 23:40:00.326898552 +0000 2023-11-18T23:40:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-11-18 23:38:14.892717701 +0000 2023-11-18T23:40:13.187 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-11-18 23:38:14.892717701 +0000 2023-11-18T23:40:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-11-18 23:38:14.892717701 +0000 2023-11-18T23:40:13.187 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T23:40:13.257 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-11-18T23:40:13.258 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-11-18T23:40:13.258 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.7806e-05 s, 5.2 MB/s 2023-11-18T23:40:13.259 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T23:40:13.314 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:13.314 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:13.314 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T23:40:13.333 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T23:40:13.333 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2023-11-18T23:40:13.390 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T23:40:13.390 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:13.391 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-11-18T23:40:13.391 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:13.391 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:13.391 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-11-18 23:40:03.643325505 +0000 2023-11-18T23:40:13.391 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-11-18 23:38:04.487542616 +0000 2023-11-18T23:40:13.391 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-11-18 23:38:04.487542616 +0000 2023-11-18T23:40:13.391 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-11-18 23:38:04.487542616 +0000 2023-11-18T23:40:13.391 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T23:40:13.460 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-11-18T23:40:13.460 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-11-18T23:40:13.460 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000195996 s, 2.6 MB/s 2023-11-18T23:40:13.461 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T23:40:13.519 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2023-11-18T23:40:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-11-18 23:40:03.643325505 +0000 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-11-18 23:38:04.974534725 +0000 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-11-18 23:38:04.974534725 +0000 2023-11-18T23:40:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-11-18 23:38:04.974534725 +0000 2023-11-18T23:40:13.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T23:40:13.644 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-11-18T23:40:13.644 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-11-18T23:40:13.644 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000353319 s, 1.4 MB/s 2023-11-18T23:40:13.646 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T23:40:13.703 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2023-11-18T23:40:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T23:40:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:13.759 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-11-18T23:40:13.759 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:13.760 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:13.760 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-11-18 23:40:03.643325505 +0000 2023-11-18T23:40:13.760 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-11-18 23:38:05.469526703 +0000 2023-11-18T23:40:13.760 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-11-18 23:38:05.469526703 +0000 2023-11-18T23:40:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-11-18 23:38:05.469526703 +0000 2023-11-18T23:40:13.760 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T23:40:13.826 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-11-18T23:40:13.826 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-11-18T23:40:13.826 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000216503 s, 2.4 MB/s 2023-11-18T23:40:13.828 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T23:40:13.885 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2023-11-18T23:40:13.941 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T23:40:13.941 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T23:40:13.941 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-18T23:40:13.941 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T23:40:13.941 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T23:40:13.941 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-11-18 23:40:03.644325489 +0000 2023-11-18T23:40:13.942 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-11-18 23:38:05.960518747 +0000 2023-11-18T23:40:13.942 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-11-18 23:38:05.960518747 +0000 2023-11-18T23:40:13.942 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2023-11-18 23:38:05.960518747 +0000 2023-11-18T23:40:13.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T23:40:14.008 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-11-18T23:40:14.008 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-11-18T23:40:14.008 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00020019 s, 2.6 MB/s 2023-11-18T23:40:14.010 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T23:40:14.066 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:14.067 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T23:40:14.067 INFO:tasks.ceph:Generating config... 2023-11-18T23:40:14.068 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-18T23:40:14.068 INFO:tasks.ceph:[client] debug client = 20 2023-11-18T23:40:14.068 INFO:tasks.ceph:[client] debug ms = 1 2023-11-18T23:40:14.068 INFO:tasks.ceph:[client] pid file = 2023-11-18T23:40:14.068 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-18T23:40:14.069 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-18T23:40:14.069 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-18T23:40:14.070 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-18T23:40:14.070 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-18T23:40:14.070 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-18T23:40:14.070 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-18T23:40:14.070 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-18T23:40:14.070 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-18T23:40:14.070 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-18T23:40:14.070 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-18T23:40:14.070 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-18T23:40:14.071 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-18T23:40:14.072 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-18T23:40:14.072 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-18T23:40:14.072 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-18T23:40:14.072 INFO:tasks.ceph:Setting up mon.a... 2023-11-18T23:40:14.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-18T23:40:14.149 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2023-11-18T23:40:14.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-18T23:40:14.203 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T23:40:14.235 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8'), ('mon.b', '172.21.15.116'), ('mon.c', '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]')] 2023-11-18T23:40:14.235 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-18T23:40:14.236 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:14.236 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T23:40:14.291 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --add b 172.21.15.116 --addv c '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:14.377 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:14.377 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid 45315d48-6a4a-4df1-b021-4a12da37b9ab 2023-11-18T23:40:14.377 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2023-11-18T23:40:14.377 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2023-11-18T23:40:14.377 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 45315d48-6a4a-4df1-b021-4a12da37b9ab 2023-11-18T23:40:14.377 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2023-11-18T23:40:14.376851+0000 2023-11-18T23:40:14.377 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-11-18T23:40:14.376851+0000 2023-11-18T23:40:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 16 (pacific) 2023-11-18T23:40:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2023-11-18T23:40:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2023-11-18T23:40:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2023-11-18T23:40:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2023-11-18T23:40:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-18T23:40:14.379 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T23:40:14.394 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 45315d48-6a4a-4df1-b021-4a12da37b9ab... 2023-11-18T23:40:14.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T23:40:14.438 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T23:40:14.492 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2023-11-18T23:40:14.492 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2023-11-18T23:40:14.492 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T23:40:14.492 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2023-11-18T23:40:14.492 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.492 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T23:40:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2023-11-18T23:40:14.494 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.495 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.8,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]" 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 45315d48-6a4a-4df1-b021-4a12da37b9ab 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.496 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.497 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2023-11-18T23:40:14.498 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2023-11-18T23:40:14.499 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = bitmap 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T23:40:14.500 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-11-18T23:40:14.501 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2023-11-18T23:40:14.502 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2023-11-18T23:40:14.503 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T23:40:14.504 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: mon op complaint time = 120 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T23:40:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout: client mount timeout = 600 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout: debug client = 20 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = "" 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2023-11-18T23:40:14.506 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout:[mds] 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds = 20 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds balancer = 20 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug frag = True 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug scatterstat = True 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout: mds op complaint time = 180 2023-11-18T23:40:14.507 INFO:teuthology.orchestra.run.smithi116.stdout: mds verify scatter = True 2023-11-18T23:40:14.508 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2023-11-18T23:40:14.508 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2023-11-18T23:40:14.508 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2023-11-18T23:40:14.508 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-11-18T23:40:14.508 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-11-18T23:40:14.509 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.510 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T23:40:14.511 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-11-18T23:40:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]" 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 45315d48-6a4a-4df1-b021-4a12da37b9ab 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-11-18T23:40:14.513 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug trim objects = true 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-11-18T23:40:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-11-18T23:40:14.515 INFO:teuthology.orchestra.run.smithi008.stdout: bdev async discard = True 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: bdev enable discard = True 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore allocator = bitmap 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 1/20 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 1/20 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 4/10 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T23:40:14.516 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-11-18T23:40:14.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-11-18T23:40:14.518 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T23:40:14.519 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-11-18T23:40:14.520 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2023-11-18T23:40:14.521 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-11-18T23:40:14.522 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-11-18T23:40:14.523 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-11-18T23:40:14.524 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-18T23:40:14.524 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-18T23:40:14.583 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-18T23:40:14.584 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:14.584 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-18T23:40:14.599 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:14.599 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-18T23:40:14.654 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:40:14.654 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:14.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T23:40:14.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T23:40:14.740 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:14.740 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:14.795 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:40:14.795 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:14.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T23:40:14.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T23:40:14.836 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:14.836 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:14.891 INFO:tasks.ceph:Setting up mon nodes... 2023-11-18T23:40:14.892 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-18T23:40:14.892 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T23:40:14.954 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T23:40:14.956 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T23:40:15.025 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T23:40:15.028 INFO:tasks.ceph:Setting up mds nodes... 2023-11-18T23:40:15.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T23:40:15.090 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T23:40:15.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-18T23:40:15.123 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T23:40:15.224 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T23:40:15.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-18T23:40:15.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T23:40:15.314 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T23:40:15.317 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-18T23:40:15.344 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T23:40:15.438 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T23:40:15.441 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-18T23:40:15.467 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-18T23:40:15.468 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-18T23:40:15.515 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-18T23:40:15.534 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-18T23:40:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-18T23:40:15.598 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-18T23:40:15.640 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-18T23:40:15.655 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-18T23:40:15.738 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-18T23:40:15.753 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-18T23:40:15.753 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T23:40:15.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-18T23:40:15.784 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:15.784 INFO:tasks.ceph:role: osd.0 2023-11-18T23:40:15.784 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:40:15.785 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T23:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:15.855 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:15.856 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:15.887 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-11-18T23:40:15.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-11-18T23:40:15.889 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-18T23:40:15.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-18T23:40:16.040 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-18T23:40:16.112 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:16.112 INFO:tasks.ceph:role: osd.1 2023-11-18T23:40:16.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:40:16.112 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T23:40:16.183 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:16.184 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:16.185 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:16.216 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-11-18T23:40:16.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-11-18T23:40:16.218 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-18T23:40:16.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-18T23:40:16.369 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-18T23:40:16.441 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:16.441 INFO:tasks.ceph:role: osd.2 2023-11-18T23:40:16.441 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:40:16.441 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:16.513 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:16.544 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-11-18T23:40:16.546 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-11-18T23:40:16.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-18T23:40:16.620 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-18T23:40:16.697 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-18T23:40:16.768 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:16.768 INFO:tasks.ceph:role: osd.3 2023-11-18T23:40:16.768 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:40:16.768 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T23:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:16.838 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:16.839 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:16.871 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-11-18T23:40:16.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-11-18T23:40:16.873 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-18T23:40:16.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-18T23:40:17.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:17.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:17.121+0000 7f0ecc80e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-18T23:40:17.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:17.121+0000 7f0ecc80e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-18T23:40:17.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:17.121+0000 7f0ecc80e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T23:40:17.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:17.121+0000 7f0ecc80e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T23:40:17.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:17.121+0000 7f0ecc80e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T23:40:17.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:17.121+0000 7f0ecc80e500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-18T23:40:19.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-18T23:40:20.013 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:20.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:20.107+0000 7f2facc0f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-18T23:40:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:20.107+0000 7f2facc0f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-18T23:40:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:20.107+0000 7f2facc0f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T23:40:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:20.107+0000 7f2facc0f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T23:40:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:20.107+0000 7f2facc0f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T23:40:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:20.107+0000 7f2facc0f500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-18T23:40:22.963 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-18T23:40:22.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:23.095+0000 7f09ff6da500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-18T23:40:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:23.095+0000 7f09ff6da500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-18T23:40:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:23.096+0000 7f09ff6da500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T23:40:23.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:23.096+0000 7f09ff6da500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T23:40:23.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:23.096+0000 7f09ff6da500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T23:40:23.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:23.096+0000 7f09ff6da500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-18T23:40:25.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-18T23:40:25.984 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:26.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:26.080+0000 7f041f814500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-18T23:40:26.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:26.080+0000 7f041f814500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-18T23:40:26.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:26.080+0000 7f041f814500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T23:40:26.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:26.080+0000 7f041f814500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T23:40:26.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:26.080+0000 7f041f814500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T23:40:26.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:26.081+0000 7f041f814500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-18T23:40:28.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-18T23:40:28.975 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-18T23:40:29.006 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:29.006 INFO:tasks.ceph:role: osd.4 2023-11-18T23:40:29.007 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:40:29.007 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T23:40:29.085 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:29.085 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:29.085 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:29.085 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:29.086 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:29.086 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:29.086 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:29.086 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:29.086 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:29.086 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:29.579 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-11-18T23:40:29.582 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-11-18T23:40:29.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-18T23:40:29.703 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-18T23:40:29.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-18T23:40:29.811 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:29.811 INFO:tasks.ceph:role: osd.5 2023-11-18T23:40:29.811 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:40:29.811 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T23:40:29.887 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:29.887 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:29.887 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:29.887 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:29.888 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:29.888 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:29.888 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:29.888 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:29.888 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:29.888 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:30.345 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-11-18T23:40:30.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-11-18T23:40:30.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-18T23:40:30.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-18T23:40:30.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-18T23:40:30.568 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:30.568 INFO:tasks.ceph:role: osd.6 2023-11-18T23:40:30.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:40:30.568 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T23:40:30.642 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:30.642 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:30.642 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:30.642 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:30.642 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:30.642 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:30.642 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:30.643 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:30.643 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:30.643 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:31.166 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-11-18T23:40:31.167 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-11-18T23:40:31.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-18T23:40:31.282 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-18T23:40:31.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-18T23:40:31.383 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T23:40:31.383 INFO:tasks.ceph:role: osd.7 2023-11-18T23:40:31.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:40:31.383 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T23:40:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T23:40:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T23:40:31.459 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T23:40:31.956 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-11-18T23:40:31.958 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-11-18T23:40:31.958 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-18T23:40:32.072 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-18T23:40:32.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:32.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:32.203+0000 7fb409a65500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-18T23:40:32.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:32.203+0000 7fb409a65500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-18T23:40:32.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:32.203+0000 7fb409a65500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T23:40:32.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:32.203+0000 7fb409a65500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T23:40:32.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:32.203+0000 7fb409a65500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T23:40:32.205 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:32.204+0000 7fb409a65500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-18T23:40:35.053 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-18T23:40:35.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:35.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:35.173+0000 7fcb39bab500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-18T23:40:35.174 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:35.173+0000 7fcb39bab500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-18T23:40:35.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:35.173+0000 7fcb39bab500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T23:40:35.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:35.173+0000 7fcb39bab500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T23:40:35.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:35.173+0000 7fcb39bab500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T23:40:35.175 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:35.174+0000 7fcb39bab500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-18T23:40:38.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-18T23:40:38.063 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:38.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:38.152+0000 7ff7f4625500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-18T23:40:38.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:38.152+0000 7ff7f4625500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-18T23:40:38.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:38.152+0000 7ff7f4625500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T23:40:38.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:38.152+0000 7ff7f4625500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T23:40:38.154 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:38.152+0000 7ff7f4625500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T23:40:38.155 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:38.153+0000 7ff7f4625500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-18T23:40:40.999 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-18T23:40:41.028 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:41.117 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:41.116+0000 7f2006c25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-18T23:40:41.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:41.116+0000 7f2006c25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-18T23:40:41.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:41.116+0000 7f2006c25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T23:40:41.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:41.116+0000 7f2006c25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T23:40:41.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:41.116+0000 7f2006c25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T23:40:41.118 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:41.117+0000 7f2006c25500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-18T23:40:42.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:40:42.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:40:43.973 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-18T23:40:44.005 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-18T23:40:44.005 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-18T23:40:44.041 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-18T23:40:44.115 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.115 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-18T23:40:44.188 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-18T23:40:44.260 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.261 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-18T23:40:44.333 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-18T23:40:44.405 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-18T23:40:44.477 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-18T23:40:44.509 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.509 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-18T23:40:44.579 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-18T23:40:44.648 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-18T23:40:44.717 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-18T23:40:44.785 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.785 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-18T23:40:44.853 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-18T23:40:44.920 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.920 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-18T23:40:44.938 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:44.938 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-18T23:40:44.995 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:44.995 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-18T23:40:45.010 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:45.011 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-18T23:40:45.065 INFO:tasks.ceph:Adding keys to all mons... 2023-11-18T23:40:45.066 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T23:40:45.068 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T23:40:45.109 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.y] 2023-11-18T23:40:45.109 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBeS1llotXdOBAArTNfRg614mXOCcEWleQoPQ== 2023-11-18T23:40:45.109 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-11-18T23:40:45.109 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1llJF1lBRAAL5Z1HqSg7cZ3qtjKimJrFA== 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1ll7E9mDRAATrIeinLTQ+sYnt8GrozzXw== 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBhS1llMgdHBxAAK6i2OLPrmVUcDO/EKdVfNw== 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBkS1llOFtyBhAA0qITFutD1bIAiivFwc7Y5A== 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBnS1llypnDBRAA909zPp13+rfqUi2p1GlnDw== 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBqS1llei3aBBAAJExvT2KNzaW+MRytjytBrQ== 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2023-11-18T23:40:45.110 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1llNP6BARAAZZC8g8qPIHbQNIy+zKPoGA== 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1llle7AEhAAHi2RUW5BB5a4vXphW/ALKA== 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1lluS8mGhAAFbmuZIx8Q6TGO7+MnSg3zw== 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.4] 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBwS1llmgowDBAAcaWlB0NBKb3JmrXUrzn//A== 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.5] 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBzS1ll4PxjChAALB5TsdIzkXkh6TRvdhVBUA== 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.6] 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB2S1llGeMoCRAAkC0vF/EHce1yMSn7vEYFLA== 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.7] 2023-11-18T23:40:45.111 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB5S1lluagABxAAJK8+7xOBv9GcVNE8C0EAFQ== 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1llAtO6HhAAmnJ2CjYeVW/+aFk46V8/ag== 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout:[client.2] 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1ll332MIhAAh2y0x9zjV7q6Petzf9Zevg== 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout:[client.1] 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1llCywqJhAABvMC0nxxcyudTnZ5kiYpeA== 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout:[client.3] 2023-11-18T23:40:45.112 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1llUen/KxAAxn6wdpBrfGo/WN2+kaFibw== 2023-11-18T23:40:45.131 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.y] 2023-11-18T23:40:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBeS1llotXdOBAArTNfRg614mXOCcEWleQoPQ== 2023-11-18T23:40:45.131 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2023-11-18T23:40:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1llJF1lBRAAL5Z1HqSg7cZ3qtjKimJrFA== 2023-11-18T23:40:45.131 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2023-11-18T23:40:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1ll7E9mDRAATrIeinLTQ+sYnt8GrozzXw== 2023-11-18T23:40:45.131 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBhS1llMgdHBxAAK6i2OLPrmVUcDO/EKdVfNw== 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBkS1llOFtyBhAA0qITFutD1bIAiivFwc7Y5A== 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBnS1llypnDBRAA909zPp13+rfqUi2p1GlnDw== 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBqS1llei3aBBAAJExvT2KNzaW+MRytjytBrQ== 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1llNP6BARAAZZC8g8qPIHbQNIy+zKPoGA== 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1llle7AEhAAHi2RUW5BB5a4vXphW/ALKA== 2023-11-18T23:40:45.132 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1lluS8mGhAAFbmuZIx8Q6TGO7+MnSg3zw== 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBwS1llmgowDBAAcaWlB0NBKb3JmrXUrzn//A== 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBzS1ll4PxjChAALB5TsdIzkXkh6TRvdhVBUA== 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.6] 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB2S1llGeMoCRAAkC0vF/EHce1yMSn7vEYFLA== 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.7] 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB5S1lluagABxAAJK8+7xOBv9GcVNE8C0EAFQ== 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1llAtO6HhAAmnJ2CjYeVW/+aFk46V8/ag== 2023-11-18T23:40:45.133 INFO:teuthology.orchestra.run.smithi116.stdout:[client.2] 2023-11-18T23:40:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1ll332MIhAAh2y0x9zjV7q6Petzf9Zevg== 2023-11-18T23:40:45.134 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2023-11-18T23:40:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1llCywqJhAABvMC0nxxcyudTnZ5kiYpeA== 2023-11-18T23:40:45.134 INFO:teuthology.orchestra.run.smithi116.stdout:[client.3] 2023-11-18T23:40:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBfS1llUen/KxAAxn6wdpBrfGo/WN2+kaFibw== 2023-11-18T23:40:45.135 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T23:40:45.156 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T23:40:45.226 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.229 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.349 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.402 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.460 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T23:40:45.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T23:40:45.625 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.684 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T23:40:45.742 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T23:40:45.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:45.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:46.024 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:46.026 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:46.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:46.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:46.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:46.144 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T23:40:46.201 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-18T23:40:46.201 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-18T23:40:46.231 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T23:40:46.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-18T23:40:46.363 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-18T23:40:46.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T23:40:46.486 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-18T23:40:46.513 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-18T23:40:46.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T23:40:46.676 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-18T23:40:46.703 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:46.705 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T23:40:46.757 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-18T23:40:46.758 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-18T23:40:46.758 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-18T23:40:46.760 INFO:tasks.ceph.mon.a:Started 2023-11-18T23:40:46.761 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-18T23:40:46.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-18T23:40:46.799 INFO:tasks.ceph.mon.b:Started 2023-11-18T23:40:46.799 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-18T23:40:46.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-18T23:40:46.801 INFO:tasks.ceph.mon.c:Started 2023-11-18T23:40:46.802 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-18T23:40:46.802 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-18T23:40:46.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-18T23:40:46.804 INFO:tasks.ceph.mgr.y:Started 2023-11-18T23:40:46.804 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-18T23:40:46.804 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-18T23:40:46.806 INFO:tasks.ceph.mgr.x:Started 2023-11-18T23:40:46.806 INFO:tasks.ceph:Setting crush tunables to default 2023-11-18T23:40:46.807 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2023-11-18T23:40:46.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.912+0000 7fe20e4f2640 1 Processor -- start 2023-11-18T23:40:46.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.912+0000 7fe20e4f2640 1 -- start start 2023-11-18T23:40:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe20e4f2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe20e4f2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2080cfe90 con 0x7fe2080b07f0 2023-11-18T23:40:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe20e4f2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20815ee60 con 0x7fe20815ea80 2023-11-18T23:40:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe20e4f2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2080cef60 con 0x7fe2080afee0 2023-11-18T23:40:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe2077fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe20ca8f640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe2080b07f0 0x7fe2080b0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45424/0 (socket says 172.21.15.8:45424) 2023-11-18T23:40:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe20ca8f640 1 -- 172.21.15.8:0/2252670008 learned_addr learned my addr 172.21.15.8:0/2252670008 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:40:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe2077fe640 1 -- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 msgr2=0x7fe2080cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T23:40:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe2077fe640 1 -- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 msgr2=0x7fe2080cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T23:40:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe2077fe640 1 --2- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T23:40:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:46.913+0000 7fe2077fe640 1 --2- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T23:40:47.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.114+0000 7fe2077fe640 1 --2- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.114+0000 7fe2077fe640 1 -- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 msgr2=0x7fe2080cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T23:40:47.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.114+0000 7fe2077fe640 1 -- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 msgr2=0x7fe2080cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T23:40:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.114+0000 7fe2077fe640 1 --2- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T23:40:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.114+0000 7fe2077fe640 1 --2- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146565936 0 0) 0x7fe2080cfe90 con 0x7fe2080b07f0 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f0003520 con 0x7fe2080b07f0 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926298533 0 0) 0x7fe20815ee60 con 0x7fe20815ea80 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2080cfe90 con 0x7fe20815ea80 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294631369 0 0) 0x7fe2080cfe90 con 0x7fe20815ea80 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 msgr2=0x7fe2080cf950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 --2- 172.21.15.8:0/2252670008 >> v2:172.21.15.8:3300/0 conn(0x7fe2080afee0 0x7fe2080cf950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 >> v1:172.21.15.8:6789/0 conn(0x7fe2080b07f0 legacy=0x7fe2080b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208099a10 con 0x7fe20815ea80 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.118+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fe1f8001670 con 0x7fe20815ea80 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 >> v1:172.21.15.116:6789/0 conn(0x7fe20815ea80 legacy=0x7fe2080cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe206ffd640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe1f0004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe206ffd640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1f0003760 0x7fe1f0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe206ffd640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1f0004170 0x7fe1f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080cef60 con 0x7fe1f0004bb0 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f000c100 con 0x7fe1f0004170 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f000c2c0 con 0x7fe1f0003760 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe20ca8f640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1f0004170 0x7fe1f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe207fff640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe1f0004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe2077fe640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1f0003760 0x7fe1f0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe207fff640 1 -- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1f0003760 msgr2=0x7fe1f0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe207fff640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1f0003760 0x7fe1f0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe207fff640 1 -- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1f0004170 msgr2=0x7fe1f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe207fff640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1f0004170 0x7fe1f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe207fff640 1 -- 172.21.15.8:0/2252670008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080cfe90 con 0x7fe1f0004bb0 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe2077fe640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1f0003760 0x7fe1f0003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe20ca8f640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1f0004170 0x7fe1f000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:47.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.119+0000 7fe20ca8f640 1 -- 172.21.15.8:0/2252670008 reap_dead start 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.120+0000 7fe207fff640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe1f0004fb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8007e70 tx=0x7fe1f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c01767fd81125f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.121+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f800e2d0 con 0x7fe1f0004bb0 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.121+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8030a70 con 0x7fe1f0004bb0 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.121+0000 7fe206ffd640 1 -- 172.21.15.8:0/2252670008 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8030e00 con 0x7fe1f0004bb0 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.122+0000 7fe20e4f2640 1 -- 172.21.15.8:0/2252670008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 msgr2=0x7fe1f0004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.122+0000 7fe20e4f2640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe1f0004fb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8007e70 tx=0x7fe1f00057f0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.122+0000 7fe20e4f2640 1 -- 172.21.15.8:0/2252670008 shutdown_connections 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.122+0000 7fe20e4f2640 1 --2- 172.21.15.8:0/2252670008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe1f0004fb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.122+0000 7fe20e4f2640 1 -- 172.21.15.8:0/2252670008 >> 172.21.15.8:0/2252670008 conn(0x7fe2080b2ab0 msgr2=0x7fe2080b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.122+0000 7fe20e4f2640 1 -- 172.21.15.8:0/2252670008 shutdown_connections 2023-11-18T23:40:47.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.122+0000 7fe20e4f2640 1 -- 172.21.15.8:0/2252670008 wait complete. 2023-11-18T23:40:47.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.124+0000 7fe20e4f2640 1 Processor -- start 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.124+0000 7fe20e4f2640 1 -- start start 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe20e4f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe208155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe20e4f2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2081558a0 0x7fe2080b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe20e4f2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2080b6600 0x7fe2080b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe20e4f2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080b6a90 con 0x7fe1f0004bb0 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe20e4f2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20815c1f0 con 0x7fe2080b6600 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe207fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe208155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe20e4f2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20815c4d0 con 0x7fe2081558a0 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe207fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe208155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36490/0 (socket says 172.21.15.8:36490) 2023-11-18T23:40:47.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe207fff640 1 -- 172.21.15.8:0/3565458835 learned_addr learned my addr 172.21.15.8:0/3565458835 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.125+0000 7fe20ca8f640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2080b6600 0x7fe2080b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe2077fe640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2081558a0 0x7fe2080b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe20ca8f640 1 -- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2081558a0 msgr2=0x7fe2080b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe20ca8f640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2081558a0 0x7fe2080b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe20ca8f640 1 -- 172.21.15.8:0/3565458835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 msgr2=0x7fe208155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe20ca8f640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe208155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe20ca8f640 1 -- 172.21.15.8:0/3565458835 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20815c7b0 con 0x7fe2080b6600 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe207fff640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe208155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe20ca8f640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2080b6600 0x7fe2080b3b50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe208071a70 tx=0x7fe20000f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe204ff9640 1 -- 172.21.15.8:0/3565458835 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000fdb0 con 0x7fe2080b6600 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe204ff9640 1 -- 172.21.15.8:0/3565458835 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200012350 con 0x7fe2080b6600 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20815ca90 con 0x7fe2080b6600 2023-11-18T23:40:47.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.126+0000 7fe204ff9640 1 -- 172.21.15.8:0/3565458835 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200012700 con 0x7fe2080b6600 2023-11-18T23:40:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.127+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2080caf20 con 0x7fe2080b6600 2023-11-18T23:40:47.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.128+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20809f0b0 con 0x7fe2080b6600 2023-11-18T23:40:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.132+0000 7fe204ff9640 1 -- 172.21.15.8:0/3565458835 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe200012b60 con 0x7fe2080b6600 2023-11-18T23:40:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.132+0000 7fe204ff9640 1 -- 172.21.15.8:0/3565458835 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe200014bb0 con 0x7fe2080b6600 2023-11-18T23:40:47.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.134+0000 7fe204ff9640 1 -- 172.21.15.8:0/3565458835 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe20001a070 con 0x7fe2080b6600 2023-11-18T23:40:47.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.200+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe20804e920 con 0x7fe2080b6600 2023-11-18T23:40:47.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.208+0000 7fe204ff9640 1 -- 172.21.15.8:0/3565458835 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe200002090 con 0x7fe2080b6600 2023-11-18T23:40:47.210 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2080b6600 msgr2=0x7fe2080b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2080b6600 0x7fe2080b3b50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe208071a70 tx=0x7fe20000f5a0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 shutdown_connections 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2080b6600 0x7fe2080b3b50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2081558a0 0x7fe2080b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 --2- 172.21.15.8:0/3565458835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0004bb0 0x7fe208155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 >> 172.21.15.8:0/3565458835 conn(0x7fe2080b2ab0 msgr2=0x7fe20806f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 shutdown_connections 2023-11-18T23:40:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:47.209+0000 7fe20e4f2640 1 -- 172.21.15.8:0/3565458835 wait complete. 2023-11-18T23:40:47.221 INFO:tasks.ceph:check_enable_crimson: False 2023-11-18T23:40:47.222 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-18T23:40:47.222 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:47.222 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-18T23:40:47.252 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:47.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-18T23:40:47.324 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:47.324 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-18T23:40:47.394 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:40:47.394 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-18T23:40:47.467 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:47.467 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-18T23:40:47.494 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:47.494 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-18T23:40:47.561 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:47.561 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-18T23:40:47.599 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:47.598+0000 7f94f4a2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T23:40:47.625 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:40:47.626 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-18T23:40:47.632 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:47.631+0000 7f0d76c32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T23:40:47.653 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:47.651+0000 7f94f4a2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T23:40:47.679 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 49ec5c0c-7fd1-4b41-bfd4-31b0cce07854 0 2023-11-18T23:40:47.685 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:47.684+0000 7f0d76c32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T23:40:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.817+0000 7fe175b0a640 1 Processor -- start 2023-11-18T23:40:47.819 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe175b0a640 1 -- start start 2023-11-18T23:40:47.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe175b0a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe17006e420 0x7fe1700b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe175b0a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17006e9e0 0x7fe1700b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe175b0a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17006a570 con 0x7fe17015d210 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe175b0a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17015d5f0 con 0x7fe17006e420 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe175b0a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700b4f20 con 0x7fe17006e9e0 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe16effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe17006e420 0x7fe1700b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe16ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17006e9e0 0x7fe1700b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.818+0000 7fe16effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe17006e420 0x7fe1700b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54568/0 (socket says 172.21.15.116:54568) 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.819+0000 7fe16effd640 1 -- 172.21.15.116:0/3568506136 learned_addr learned my addr 172.21.15.116:0/3568506136 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.819+0000 7fe16f7fe640 1 --1- 172.21.15.116:0/3568506136 >> v1:172.21.15.116:6789/0 conn(0x7fe17015d210 0x7fe17006ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:35966/0 (socket says 172.21.15.116:35966) 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.819+0000 7fe16ffff640 1 -- 172.21.15.116:0/3568506136 >> v2:172.21.15.116:3300/0 conn(0x7fe17006e420 msgr2=0x7fe1700b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.819+0000 7fe16ffff640 1 --2- 172.21.15.116:0/3568506136 >> v2:172.21.15.116:3300/0 conn(0x7fe17006e420 0x7fe1700b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.819+0000 7fe16ffff640 1 -- 172.21.15.116:0/3568506136 >> v1:172.21.15.116:6789/0 conn(0x7fe17015d210 legacy=0x7fe17006ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.819+0000 7fe16ffff640 1 -- 172.21.15.116:0/3568506136 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17006a810 con 0x7fe17006e9e0 2023-11-18T23:40:47.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.819+0000 7fe16effd640 1 --2- 172.21.15.116:0/3568506136 >> v2:172.21.15.116:3300/0 conn(0x7fe17006e420 0x7fe1700b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe16ffff640 1 --2- 172.21.15.116:0/3568506136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17006e9e0 0x7fe1700b3280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe168009d90 tx=0x7fe16802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01da203f27c5788 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe16e7fc640 1 -- 172.21.15.116:0/3568506136 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16802cbc0 con 0x7fe17006e9e0 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe16e7fc640 1 -- 172.21.15.116:0/3568506136 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16802cd20 con 0x7fe17006e9e0 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe16e7fc640 1 -- 172.21.15.116:0/3568506136 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168034660 con 0x7fe17006e9e0 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 -- 172.21.15.116:0/3568506136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17006e9e0 msgr2=0x7fe1700b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 --2- 172.21.15.116:0/3568506136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17006e9e0 0x7fe1700b3280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe168009d90 tx=0x7fe16802be10 comp rx=0 tx=0).stop 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 -- 172.21.15.116:0/3568506136 shutdown_connections 2023-11-18T23:40:47.823 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 --2- 172.21.15.116:0/3568506136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17006e9e0 0x7fe1700b3280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 --2- 172.21.15.116:0/3568506136 >> v2:172.21.15.116:3300/0 conn(0x7fe17006e420 0x7fe1700b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 -- 172.21.15.116:0/3568506136 >> 172.21.15.116:0/3568506136 conn(0x7fe1700b1e30 msgr2=0x7fe1700b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:47.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 -- 172.21.15.116:0/3568506136 shutdown_connections 2023-11-18T23:40:47.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.820+0000 7fe175b0a640 1 -- 172.21.15.116:0/3568506136 wait complete. 2023-11-18T23:40:47.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.822+0000 7fe175b0a640 1 Processor -- start 2023-11-18T23:40:47.824 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.822+0000 7fe175b0a640 1 -- start start 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe17006e420 0x7fe17015f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17006e9e0 0x7fe17015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17015d210 0x7fe1701605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17015fc00 con 0x7fe17006e9e0 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17015e620 con 0x7fe17006e420 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17015e900 con 0x7fe17015d210 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe17006e420 0x7fe17015f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17015d210 0x7fe1701605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe17006e420 0x7fe17015f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54574/0 (socket says 172.21.15.116:54574) 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16f7fe640 1 -- 172.21.15.116:0/720640795 learned_addr learned my addr 172.21.15.116:0/720640795 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16effd640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17006e9e0 0x7fe17015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16ffff640 1 -- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe17006e420 msgr2=0x7fe17015f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16ffff640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe17006e420 0x7fe17015f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16ffff640 1 -- 172.21.15.116:0/720640795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17006e9e0 msgr2=0x7fe17015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16ffff640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17006e9e0 0x7fe17015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16ffff640 1 -- 172.21.15.116:0/720640795 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1640094d0 con 0x7fe17015d210 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16f7fe640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe17006e420 0x7fe17015f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe16ffff640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17015d210 0x7fe1701605d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe168033000 tx=0x7fe168004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe157fff640 1 -- 172.21.15.116:0/720640795 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168040650 con 0x7fe17015d210 2023-11-18T23:40:47.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe157fff640 1 -- 172.21.15.116:0/720640795 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16802ce90 con 0x7fe17015d210 2023-11-18T23:40:47.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe157fff640 1 -- 172.21.15.116:0/720640795 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1680409f0 con 0x7fe17015d210 2023-11-18T23:40:47.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe168009a70 con 0x7fe17015d210 2023-11-18T23:40:47.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.824+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17015eec0 con 0x7fe17015d210 2023-11-18T23:40:47.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.825+0000 7fe157fff640 1 -- 172.21.15.116:0/720640795 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe168049400 con 0x7fe17015d210 2023-11-18T23:40:47.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.825+0000 7fe157fff640 1 -- 172.21.15.116:0/720640795 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe16803e400 con 0x7fe17015d210 2023-11-18T23:40:47.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.825+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17009e0a0 con 0x7fe17015d210 2023-11-18T23:40:47.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.827+0000 7fe157fff640 1 -- 172.21.15.116:0/720640795 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe168067ce0 con 0x7fe17015d210 2023-11-18T23:40:47.900 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.898+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "49ec5c0c-7fd1-4b41-bfd4-31b0cce07854", "id": 0} v 0) v1 -- 0x7fe17004e920 con 0x7fe17015d210 2023-11-18T23:40:47.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.901+0000 7fe157fff640 1 -- 172.21.15.116:0/720640795 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49ec5c0c-7fd1-4b41-bfd4-31b0cce07854", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe168056030 con 0x7fe17015d210 2023-11-18T23:40:47.903 INFO:teuthology.orchestra.run.smithi116.stdout:0 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17015d210 msgr2=0x7fe1701605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17015d210 0x7fe1701605d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe168033000 tx=0x7fe168004a40 comp rx=0 tx=0).stop 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 shutdown_connections 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe17015d210 0x7fe1701605d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17006e9e0 0x7fe17015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 --2- 172.21.15.116:0/720640795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe17006e420 0x7fe17015f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 >> 172.21.15.116:0/720640795 conn(0x7fe1700b1e30 msgr2=0x7fe1700acdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 shutdown_connections 2023-11-18T23:40:47.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:47.902+0000 7fe175b0a640 1 -- 172.21.15.116:0/720640795 wait complete. 2023-11-18T23:40:47.914 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 35b1fa9a-38ce-478e-b4a5-39533be5bd6d 1 2023-11-18T23:40:48.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.012+0000 7f88e1924640 1 Processor -- start 2023-11-18T23:40:48.013 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.012+0000 7f88e1924640 1 -- start start 2023-11-18T23:40:48.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.012+0000 7f88e1924640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.012+0000 7f88e1924640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f88dc0b3610 0x7f88dc160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88e1924640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc06b4e0 con 0x7f88dc161370 2023-11-18T23:40:48.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88e1924640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc161820 con 0x7f88dc0b3610 2023-11-18T23:40:48.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88e1924640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0b3aa0 con 0x7f88dc06efd0 2023-11-18T23:40:48.016 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88daffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88db7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f88dc161370 0x7f88dc15d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:35982/0 (socket says 172.21.15.116:35982) 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88daffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:44056/0 (socket says 172.21.15.116:44056) 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88db7fe640 1 -- 172.21.15.116:0/3242839946 learned_addr learned my addr 172.21.15.116:0/3242839946 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88d3fff640 1 --2- 172.21.15.116:0/3242839946 >> v2:172.21.15.8:3300/0 conn(0x7f88dc0b3610 0x7f88dc160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88daffd640 1 -- 172.21.15.116:0/3242839946 >> v2:172.21.15.8:3300/0 conn(0x7f88dc0b3610 msgr2=0x7f88dc160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88daffd640 1 --2- 172.21.15.116:0/3242839946 >> v2:172.21.15.8:3300/0 conn(0x7f88dc0b3610 0x7f88dc160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88daffd640 1 -- 172.21.15.116:0/3242839946 >> v1:172.21.15.116:6789/0 conn(0x7f88dc161370 legacy=0x7f88dc15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88da7fc640 1 -- 172.21.15.116:0/3242839946 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685742402 0 0) 0x7f88dc06b4e0 con 0x7f88dc161370 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.013+0000 7f88daffd640 1 -- 172.21.15.116:0/3242839946 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0b3d80 con 0x7f88dc06efd0 2023-11-18T23:40:48.017 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88daffd640 1 --2- 172.21.15.116:0/3242839946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0ad690 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0097a0 tx=0x7f88cc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3eb82dca60e02b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88da7fc640 1 -- 172.21.15.116:0/3242839946 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc031830 con 0x7f88dc06efd0 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88da7fc640 1 -- 172.21.15.116:0/3242839946 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc031990 con 0x7f88dc06efd0 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88da7fc640 1 -- 172.21.15.116:0/3242839946 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc031d20 con 0x7f88dc06efd0 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88e1924640 1 -- 172.21.15.116:0/3242839946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 msgr2=0x7f88dc0ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88e1924640 1 --2- 172.21.15.116:0/3242839946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0ad690 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0097a0 tx=0x7f88cc02b8d0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88e1924640 1 -- 172.21.15.116:0/3242839946 shutdown_connections 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88e1924640 1 --2- 172.21.15.116:0/3242839946 >> v2:172.21.15.8:3300/0 conn(0x7f88dc0b3610 0x7f88dc160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88e1924640 1 --2- 172.21.15.116:0/3242839946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0ad690 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.014+0000 7f88e1924640 1 -- 172.21.15.116:0/3242839946 >> 172.21.15.116:0/3242839946 conn(0x7f88dc0b1670 msgr2=0x7f88dc0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.018 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.015+0000 7f88e1924640 1 -- 172.21.15.116:0/3242839946 shutdown_connections 2023-11-18T23:40:48.019 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.015+0000 7f88e1924640 1 -- 172.21.15.116:0/3242839946 wait complete. 2023-11-18T23:40:48.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 Processor -- start 2023-11-18T23:40:48.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 -- start start 2023-11-18T23:40:48.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88dc161370 0x7f88dc141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc156ae0 0x7f88dc15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.021 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1550c0 con 0x7f88dc161370 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0b02b0 con 0x7f88dc156ae0 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88e1924640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0af730 con 0x7f88dc06efd0 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88daffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88db7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc156ae0 0x7f88dc15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88daffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:44062/0 (socket says 172.21.15.116:44062) 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.016+0000 7f88daffd640 1 -- 172.21.15.116:0/1483099935 learned_addr learned my addr 172.21.15.116:0/1483099935 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88d3fff640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88dc161370 0x7f88dc141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88daffd640 1 -- 172.21.15.116:0/1483099935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc156ae0 msgr2=0x7f88dc15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88daffd640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc156ae0 0x7f88dc15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.022 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88daffd640 1 -- 172.21.15.116:0/1483099935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88dc161370 msgr2=0x7f88dc141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88daffd640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88dc161370 0x7f88dc141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88daffd640 1 -- 172.21.15.116:0/1483099935 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc009400 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88daffd640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0b0e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88cc02bee0 tx=0x7f88cc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88d8ff9640 1 -- 172.21.15.116:0/1483099935 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc03a6f0 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88d8ff9640 1 -- 172.21.15.116:0/1483099935 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc03a870 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc0afa10 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88d8ff9640 1 -- 172.21.15.116:0/1483099935 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc03ac20 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc0affd0 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88d8ff9640 1 -- 172.21.15.116:0/1483099935 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f88cc04d740 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.017+0000 7f88d8ff9640 1 -- 172.21.15.116:0/1483099935 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f88cc043980 con 0x7f88dc06efd0 2023-11-18T23:40:48.023 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.018+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc14fcd0 con 0x7f88dc06efd0 2023-11-18T23:40:48.024 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.020+0000 7f88d8ff9640 1 -- 172.21.15.116:0/1483099935 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f88cc048070 con 0x7f88dc06efd0 2023-11-18T23:40:48.093 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.091+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35b1fa9a-38ce-478e-b4a5-39533be5bd6d", "id": 1} v 0) v1 -- 0x7f88dc072720 con 0x7f88dc06efd0 2023-11-18T23:40:48.095 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.094+0000 7f88d8ff9640 1 -- 172.21.15.116:0/1483099935 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35b1fa9a-38ce-478e-b4a5-39533be5bd6d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f88cc035020 con 0x7f88dc06efd0 2023-11-18T23:40:48.095 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-11-18T23:40:48.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 msgr2=0x7f88dc0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.096 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0b0e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88cc02bee0 tx=0x7f88cc0046c0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 shutdown_connections 2023-11-18T23:40:48.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc156ae0 0x7f88dc15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88dc161370 0x7f88dc141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 --2- 172.21.15.116:0/1483099935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88dc06efd0 0x7f88dc0b0e60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 >> 172.21.15.116:0/1483099935 conn(0x7f88dc0b1670 msgr2=0x7f88dc15fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 shutdown_connections 2023-11-18T23:40:48.097 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.095+0000 7f88e1924640 1 -- 172.21.15.116:0/1483099935 wait complete. 2023-11-18T23:40:48.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 7b9fd147-ee9b-4197-922c-fc998413d8d8 2 2023-11-18T23:40:48.207 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.206+0000 7f87c4b6c640 1 Processor -- start 2023-11-18T23:40:48.207 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.206+0000 7f87c4b6c640 1 -- start start 2023-11-18T23:40:48.208 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87c4b6c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f87c006abe0 0x7f87c01681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87c4b6c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c015d7c0 con 0x7f87c015d3e0 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87c4b6c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00cdee0 con 0x7f87c006f880 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87c4b6c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c0071c10 con 0x7f87c006abe0 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87bed9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f87c006abe0 0x7f87c01681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87b7fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f87c006f880 0x7f87c006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:35988/0 (socket says 172.21.15.116:35988) 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87b7fff640 1 -- 172.21.15.116:0/2859140502 learned_addr learned my addr 172.21.15.116:0/2859140502 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87bed9d640 1 -- 172.21.15.116:0/2859140502 >> v1:172.21.15.116:6789/0 conn(0x7f87c006f880 legacy=0x7f87c006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87bed9d640 1 -- 172.21.15.116:0/2859140502 >> v1:172.21.15.8:6789/0 conn(0x7f87c015d3e0 legacy=0x7f87c0071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.209 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.207+0000 7f87bed9d640 1 -- 172.21.15.116:0/2859140502 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0071ef0 con 0x7f87c006abe0 2023-11-18T23:40:48.210 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.208+0000 7f87bed9d640 1 --2- 172.21.15.116:0/2859140502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c01681b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009d90 tx=0x7f87b802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3d225cf641a9010 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.208+0000 7f87bdd9b640 1 -- 172.21.15.116:0/2859140502 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b802cc60 con 0x7f87c006abe0 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.208+0000 7f87bdd9b640 1 -- 172.21.15.116:0/2859140502 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b802cdc0 con 0x7f87c006abe0 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.208+0000 7f87bdd9b640 1 -- 172.21.15.116:0/2859140502 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8034660 con 0x7f87c006abe0 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.209+0000 7f87c4b6c640 1 -- 172.21.15.116:0/2859140502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 msgr2=0x7f87c01681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.209+0000 7f87c4b6c640 1 --2- 172.21.15.116:0/2859140502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c01681b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009d90 tx=0x7f87b802beb0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.209+0000 7f87c4b6c640 1 -- 172.21.15.116:0/2859140502 shutdown_connections 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.209+0000 7f87c4b6c640 1 --2- 172.21.15.116:0/2859140502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c01681b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.209+0000 7f87c4b6c640 1 -- 172.21.15.116:0/2859140502 >> 172.21.15.116:0/2859140502 conn(0x7f87c00cfe00 msgr2=0x7f87c00d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.209+0000 7f87c4b6c640 1 -- 172.21.15.116:0/2859140502 shutdown_connections 2023-11-18T23:40:48.211 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.209+0000 7f87c4b6c640 1 -- 172.21.15.116:0/2859140502 wait complete. 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.210+0000 7f87c4b6c640 1 Processor -- start 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.210+0000 7f87c4b6c640 1 -- start start 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c0155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87c006f880 0x7f87c01e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c015d3e0 0x7f87c015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01e8150 con 0x7f87c015d3e0 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0156480 con 0x7f87c006abe0 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01e7540 con 0x7f87c006f880 2023-11-18T23:40:48.214 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c0155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87c006f880 0x7f87c01e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c0155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54584/0 (socket says 172.21.15.116:54584) 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 -- 172.21.15.116:0/412655636 learned_addr learned my addr 172.21.15.116:0/412655636 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87bed9d640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c015d3e0 0x7f87c015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 -- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87c006f880 msgr2=0x7f87c01e6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87c006f880 0x7f87c01e6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 -- 172.21.15.116:0/412655636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c015d3e0 msgr2=0x7f87c015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c015d3e0 0x7f87c015b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 -- 172.21.15.116:0/412655636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009a70 con 0x7f87c006abe0 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87b7fff640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87c006f880 0x7f87c01e6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87be59c640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c0155f40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c400 tx=0x7f87b000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.215 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87b6ffd640 1 -- 172.21.15.116:0/412655636 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00052d0 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87b6ffd640 1 -- 172.21.15.116:0/412655636 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b0005430 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c01e7820 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87b6ffd640 1 -- 172.21.15.116:0/412655636 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0003830 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.211+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c01e7de0 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.212+0000 7f87b6ffd640 1 -- 172.21.15.116:0/412655636 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f87b0003c90 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.212+0000 7f87b6ffd640 1 -- 172.21.15.116:0/412655636 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f87b0012840 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.212+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c009e030 con 0x7f87c006abe0 2023-11-18T23:40:48.216 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.214+0000 7f94f4a2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T23:40:48.217 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.214+0000 7f87b6ffd640 1 -- 172.21.15.116:0/412655636 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f87b0017070 con 0x7f87c006abe0 2023-11-18T23:40:48.248 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.247+0000 7f0d76c32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T23:40:48.269 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.268+0000 7f94f4a2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T23:40:48.286 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.285+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7b9fd147-ee9b-4197-922c-fc998413d8d8", "id": 2} v 0) v1 -- 0x7f87c004e920 con 0x7f87c006abe0 2023-11-18T23:40:48.289 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.288+0000 7f87b6ffd640 1 -- 172.21.15.116:0/412655636 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b9fd147-ee9b-4197-922c-fc998413d8d8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87c015d7c0 con 0x7f87c006abe0 2023-11-18T23:40:48.289 INFO:teuthology.orchestra.run.smithi116.stdout:2 2023-11-18T23:40:48.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 msgr2=0x7f87c0155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c0155f40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c400 tx=0x7f87b000c8c0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 shutdown_connections 2023-11-18T23:40:48.290 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87c015d3e0 0x7f87c015b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87c006f880 0x7f87c01e6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 --2- 172.21.15.116:0/412655636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87c006abe0 0x7f87c0155f40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 >> 172.21.15.116:0/412655636 conn(0x7f87c00cfe00 msgr2=0x7f87c00cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 shutdown_connections 2023-11-18T23:40:48.291 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.289+0000 7f87c4b6c640 1 -- 172.21.15.116:0/412655636 wait complete. 2023-11-18T23:40:48.300 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 84ad6608-8092-4637-8354-ae4afe85e4a1 3 2023-11-18T23:40:48.302 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.301+0000 7f0d76c32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T23:40:48.316 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.315+0000 7f94f4a2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T23:40:48.348 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.347+0000 7f0d76c32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T23:40:48.372 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.371+0000 7f94f4a2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T23:40:48.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.399+0000 7f3406133640 1 Processor -- start 2023-11-18T23:40:48.401 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.399+0000 7f3406133640 1 -- start start 2023-11-18T23:40:48.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f3406133640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f340006abe0 0x7f34000accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f3406133640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000cc7e0 con 0x7f340015b400 2023-11-18T23:40:48.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f3406133640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000cca60 con 0x7f340015b020 2023-11-18T23:40:48.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f3406133640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34000ccd40 con 0x7f340006abe0 2023-11-18T23:40:48.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f33ff7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f340015b020 0x7f34000cbdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36000/0 (socket says 172.21.15.116:36000) 2023-11-18T23:40:48.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f33ff7fe640 1 -- 172.21.15.116:0/1214541356 learned_addr learned my addr 172.21.15.116:0/1214541356 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-11-18T23:40:48.404 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f33fffff640 1 --2- 172.21.15.116:0/1214541356 >> v2:172.21.15.8:3300/0 conn(0x7f340006abe0 0x7f34000accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703486491 0 0) 0x7f34000cca60 con 0x7f340015b020 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33ec003520 con 0x7f340015b020 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.400+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92553897 0 0) 0x7f34000cc7e0 con 0x7f340015b400 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34000cca60 con 0x7f340015b400 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153750200 0 0) 0x7f33ec003520 con 0x7f340015b020 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 >> v2:172.21.15.8:3300/0 conn(0x7f340006abe0 msgr2=0x7f34000accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 --2- 172.21.15.116:0/1214541356 >> v2:172.21.15.8:3300/0 conn(0x7f340006abe0 0x7f34000accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.405 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 >> v1:172.21.15.8:6789/0 conn(0x7f340015b400 legacy=0x7f340006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000cd020 con 0x7f340015b020 2023-11-18T23:40:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f33f0001670 con 0x7f340015b020 2023-11-18T23:40:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 >> v1:172.21.15.116:6789/0 conn(0x7f340015b020 legacy=0x7f34000cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33ec003b00 0x7f33ec003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33ec0047c0 0x7f33ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec005180 0x7f33ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.406 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000ccd40 con 0x7f33ec005180 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec00bf70 con 0x7f33ec003b00 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec00c130 con 0x7f33ec0047c0 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33ff7fe640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33ec003b00 0x7f33ec003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33f7fff640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33ec0047c0 0x7f33ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33fffff640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec005180 0x7f33ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33ff7fe640 1 -- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33ec0047c0 msgr2=0x7f33ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33ff7fe640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33ec0047c0 0x7f33ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.407 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33ff7fe640 1 -- 172.21.15.116:0/1214541356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec005180 msgr2=0x7f33ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:48.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33ff7fe640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec005180 0x7f33ec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33fffff640 1 -- 172.21.15.116:0/1214541356 reap_dead start 2023-11-18T23:40:48.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.401+0000 7f33ff7fe640 1 -- 172.21.15.116:0/1214541356 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec003520 con 0x7f33ec003b00 2023-11-18T23:40:48.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.402+0000 7f33ff7fe640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33ec003b00 0x7f33ec003f00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c160 tx=0x7f33ec0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc8542314fa5231 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.402+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0005ad0 con 0x7f33ec003b00 2023-11-18T23:40:48.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.402+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0005c50 con 0x7f33ec003b00 2023-11-18T23:40:48.408 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.402+0000 7f33feffd640 1 -- 172.21.15.116:0/1214541356 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f002c7d0 con 0x7f33ec003b00 2023-11-18T23:40:48.409 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.403+0000 7f0d76c32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T23:40:48.411 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.403+0000 7f3406133640 1 -- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33ec003b00 msgr2=0x7f33ec003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.403+0000 7f3406133640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33ec003b00 0x7f33ec003f00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c160 tx=0x7f33ec0057f0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.403+0000 7f3406133640 1 -- 172.21.15.116:0/1214541356 shutdown_connections 2023-11-18T23:40:48.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.403+0000 7f3406133640 1 --2- 172.21.15.116:0/1214541356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33ec003b00 0x7f33ec003f00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.403+0000 7f3406133640 1 -- 172.21.15.116:0/1214541356 >> 172.21.15.116:0/1214541356 conn(0x7f34000b19d0 msgr2=0x7f34000b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.403+0000 7f3406133640 1 -- 172.21.15.116:0/1214541356 shutdown_connections 2023-11-18T23:40:48.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.403+0000 7f3406133640 1 -- 172.21.15.116:0/1214541356 wait complete. 2023-11-18T23:40:48.412 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.404+0000 7f3406133640 1 Processor -- start 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.404+0000 7f3406133640 1 -- start start 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f3406133640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec003b00 0x7f34000c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f3406133640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f340015b7f0 0x7f340015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f3406133640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34000c2180 0x7f34000c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f3406133640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000cf440 con 0x7f33ec003b00 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f3406133640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340015c1b0 con 0x7f34000c2180 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f3406133640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000c2b40 con 0x7f340015b7f0 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f340015b7f0 0x7f340015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.413 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f340015b7f0 0x7f340015bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:44088/0 (socket says 172.21.15.116:44088) 2023-11-18T23:40:48.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 -- 172.21.15.116:0/2856873298 learned_addr learned my addr 172.21.15.116:0/2856873298 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:48.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33fffff640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34000c2180 0x7f34000c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33ff7fe640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec003b00 0x7f34000c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 -- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34000c2180 msgr2=0x7f34000c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34000c2180 0x7f34000c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 -- 172.21.15.116:0/2856873298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec003b00 msgr2=0x7f34000c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.414 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec003b00 0x7f34000c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.405+0000 7f33f7fff640 1 -- 172.21.15.116:0/2856873298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000ce7c0 con 0x7f340015b7f0 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f33f7fff640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f340015b7f0 0x7f340015bc70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f33e800f7a0 tx=0x7f33e800fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f33fcff9640 1 -- 172.21.15.116:0/2856873298 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8005110 con 0x7f340015b7f0 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f33fcff9640 1 -- 172.21.15.116:0/2856873298 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8005290 con 0x7f340015b7f0 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34000ceaa0 con 0x7f340015b7f0 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f33fcff9640 1 -- 172.21.15.116:0/2856873298 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8007050 con 0x7f340015b7f0 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34000cf060 con 0x7f340015b7f0 2023-11-18T23:40:48.415 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f33fcff9640 1 -- 172.21.15.116:0/2856873298 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f33e80074b0 con 0x7f340015b7f0 2023-11-18T23:40:48.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.406+0000 7f33fcff9640 1 -- 172.21.15.116:0/2856873298 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f33e800dc60 con 0x7f340015b7f0 2023-11-18T23:40:48.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.407+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34000cf580 con 0x7f340015b7f0 2023-11-18T23:40:48.416 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.409+0000 7f33fcff9640 1 -- 172.21.15.116:0/2856873298 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f34000cf580 con 0x7f340015b7f0 2023-11-18T23:40:48.418 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.417+0000 7f94f4a2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T23:40:48.448 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.447+0000 7f0d76c32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T23:40:48.482 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.481+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "84ad6608-8092-4637-8354-ae4afe85e4a1", "id": 3} v 0) v1 -- 0x7f340009e030 con 0x7f340015b7f0 2023-11-18T23:40:48.485 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.484+0000 7f33fcff9640 1 -- 172.21.15.116:0/2856873298 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84ad6608-8092-4637-8354-ae4afe85e4a1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f33e801a070 con 0x7f340015b7f0 2023-11-18T23:40:48.485 INFO:teuthology.orchestra.run.smithi116.stdout:3 2023-11-18T23:40:48.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.484+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f340015b7f0 msgr2=0x7f340015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.484+0000 7f3406133640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f340015b7f0 0x7f340015bc70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f33e800f7a0 tx=0x7f33e800fc60 comp rx=0 tx=0).stop 2023-11-18T23:40:48.486 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.485+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 shutdown_connections 2023-11-18T23:40:48.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.485+0000 7f3406133640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34000c2180 0x7f34000c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.485+0000 7f3406133640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f340015b7f0 0x7f340015bc70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.485+0000 7f3406133640 1 --2- 172.21.15.116:0/2856873298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33ec003b00 0x7f34000c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.485+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 >> 172.21.15.116:0/2856873298 conn(0x7f34000b19d0 msgr2=0x7f34000cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.485+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 shutdown_connections 2023-11-18T23:40:48.487 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.485+0000 7f3406133640 1 -- 172.21.15.116:0/2856873298 wait complete. 2023-11-18T23:40:48.496 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new b8382491-446a-4a0b-b5ca-fc73c050e4ab 4 2023-11-18T23:40:48.524 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.523+0000 7f94f4a2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-18T23:40:48.553 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.552+0000 7f0d76c32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-18T23:40:48.597 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.596+0000 7f94f4a2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T23:40:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.622+0000 7ff281644640 1 Processor -- start 2023-11-18T23:40:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.622+0000 7ff281644640 1 -- start start 2023-11-18T23:40:48.624 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff281644640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c0d1980 0x7ff27c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff281644640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0d11d0 con 0x7ff27c0d1d60 2023-11-18T23:40:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff281644640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0ce2b0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff281644640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0ce590 con 0x7ff27c0d1980 2023-11-18T23:40:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff27affd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c0d1980 0x7ff27c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.625 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff27b7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff27c15d6c0 0x7ff27c0b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36010/0 (socket says 172.21.15.116:36010) 2023-11-18T23:40:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff27b7fe640 1 -- 172.21.15.116:0/3129618380 learned_addr learned my addr 172.21.15.116:0/3129618380 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-11-18T23:40:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff27affd640 1 -- 172.21.15.116:0/3129618380 >> v1:172.21.15.116:6789/0 conn(0x7ff27c15d6c0 legacy=0x7ff27c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff27affd640 1 -- 172.21.15.116:0/3129618380 >> v1:172.21.15.8:6789/0 conn(0x7ff27c0d1d60 legacy=0x7ff27c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.626 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff279ffb640 1 -- 172.21.15.116:0/3129618380 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160123908 0 0) 0x7ff27c0ce2b0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.627 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.623+0000 7ff27affd640 1 -- 172.21.15.116:0/3129618380 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0ce870 con 0x7ff27c0d1980 2023-11-18T23:40:48.627 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.626+0000 7f0d76c32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T23:40:48.628 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.624+0000 7ff27affd640 1 --2- 172.21.15.116:0/3129618380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c0d1980 0x7ff27c0cdc40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff2700097d0 tx=0x7ff27002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66f364994ed71112 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.624+0000 7ff279ffb640 1 -- 172.21.15.116:0/3129618380 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270031800 con 0x7ff27c0d1980 2023-11-18T23:40:48.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.624+0000 7ff279ffb640 1 -- 172.21.15.116:0/3129618380 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff270031960 con 0x7ff27c0d1980 2023-11-18T23:40:48.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.624+0000 7ff279ffb640 1 -- 172.21.15.116:0/3129618380 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270031cf0 con 0x7ff27c0d1980 2023-11-18T23:40:48.629 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.625+0000 7ff281644640 1 -- 172.21.15.116:0/3129618380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c0d1980 msgr2=0x7ff27c0cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.625+0000 7ff281644640 1 --2- 172.21.15.116:0/3129618380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c0d1980 0x7ff27c0cdc40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff2700097d0 tx=0x7ff27002b8a0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.625+0000 7ff281644640 1 -- 172.21.15.116:0/3129618380 shutdown_connections 2023-11-18T23:40:48.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.625+0000 7ff281644640 1 --2- 172.21.15.116:0/3129618380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c0d1980 0x7ff27c0cdc40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.625+0000 7ff281644640 1 -- 172.21.15.116:0/3129618380 >> 172.21.15.116:0/3129618380 conn(0x7ff27c09c470 msgr2=0x7ff27c0d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.625+0000 7ff281644640 1 -- 172.21.15.116:0/3129618380 shutdown_connections 2023-11-18T23:40:48.630 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.625+0000 7ff281644640 1 -- 172.21.15.116:0/3129618380 wait complete. 2023-11-18T23:40:48.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.627+0000 7ff281644640 1 Processor -- start 2023-11-18T23:40:48.631 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.627+0000 7ff281644640 1 -- start start 2023-11-18T23:40:48.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff281644640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff27c0d1980 0x7ff27c0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff281644640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff27c0d1d60 0x7ff27c152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff281644640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c15d6c0 0x7ff27c0cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff281644640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0cb860 con 0x7ff27c0d1d60 2023-11-18T23:40:48.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff281644640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0c9ba0 con 0x7ff27c0d1980 2023-11-18T23:40:48.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff281644640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c153050 con 0x7ff27c15d6c0 2023-11-18T23:40:48.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff27c0d1980 0x7ff27c0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27b7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c15d6c0 0x7ff27c0cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff27c0d1980 0x7ff27c0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54608/0 (socket says 172.21.15.116:54608) 2023-11-18T23:40:48.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27affd640 1 -- 172.21.15.116:0/2888315355 learned_addr learned my addr 172.21.15.116:0/2888315355 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:48.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27a7fc640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff27c0d1d60 0x7ff27c152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27b7fe640 1 -- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff27c0d1980 msgr2=0x7ff27c0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27b7fe640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff27c0d1980 0x7ff27c0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.634 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27b7fe640 1 -- 172.21.15.116:0/2888315355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff27c0d1d60 msgr2=0x7ff27c152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27b7fe640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff27c0d1d60 0x7ff27c152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27b7fe640 1 -- 172.21.15.116:0/2888315355 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009400 con 0x7ff27c15d6c0 2023-11-18T23:40:48.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.628+0000 7ff27affd640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff27c0d1980 0x7ff27c0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:48.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff27b7fe640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c15d6c0 0x7ff27c0cbd60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff27400c780 tx=0x7ff27400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff2637fe640 1 -- 172.21.15.116:0/2888315355 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400ce30 con 0x7ff27c15d6c0 2023-11-18T23:40:48.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff2637fe640 1 -- 172.21.15.116:0/2888315355 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27400a640 con 0x7ff27c15d6c0 2023-11-18T23:40:48.635 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c0ca8c0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff2637fe640 1 -- 172.21.15.116:0/2888315355 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400a9f0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c0ccdd0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff2637fe640 1 -- 172.21.15.116:0/2888315355 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2740070d0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.629+0000 7ff2637fe640 1 -- 172.21.15.116:0/2888315355 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff274012910 con 0x7ff27c15d6c0 2023-11-18T23:40:48.636 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.630+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c0ce2b0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.637 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.632+0000 7ff2637fe640 1 -- 172.21.15.116:0/2888315355 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff274018070 con 0x7ff27c15d6c0 2023-11-18T23:40:48.647 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.646+0000 7f94f4a2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T23:40:48.674 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.673+0000 7f0d76c32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T23:40:48.699 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.698+0000 7f94f4a2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T23:40:48.704 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.703+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8382491-446a-4a0b-b5ca-fc73c050e4ab", "id": 4} v 0) v1 -- 0x7ff27c0a10e0 con 0x7ff27c15d6c0 2023-11-18T23:40:48.709 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.706+0000 7ff2637fe640 1 -- 172.21.15.116:0/2888315355 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8382491-446a-4a0b-b5ca-fc73c050e4ab", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff274012c40 con 0x7ff27c15d6c0 2023-11-18T23:40:48.710 INFO:teuthology.orchestra.run.smithi116.stdout:4 2023-11-18T23:40:48.710 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c15d6c0 msgr2=0x7ff27c0cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c15d6c0 0x7ff27c0cbd60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff27400c780 tx=0x7ff27400cc40 comp rx=0 tx=0).stop 2023-11-18T23:40:48.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 shutdown_connections 2023-11-18T23:40:48.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27c15d6c0 0x7ff27c0cbd60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff27c0d1d60 0x7ff27c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 --2- 172.21.15.116:0/2888315355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff27c0d1980 0x7ff27c0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 >> 172.21.15.116:0/2888315355 conn(0x7ff27c09c470 msgr2=0x7ff27c0b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.711 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 shutdown_connections 2023-11-18T23:40:48.712 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.707+0000 7ff281644640 1 -- 172.21.15.116:0/2888315355 wait complete. 2023-11-18T23:40:48.718 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 15683341-f0d7-4f5f-a5f8-3bf8ae54223b 5 2023-11-18T23:40:48.729 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.728+0000 7f0d76c32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T23:40:48.749 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:48.748+0000 7f94f4a2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T23:40:48.778 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:48.777+0000 7f0d76c32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T23:40:48.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.816+0000 7f3edb71d640 1 Processor -- start 2023-11-18T23:40:48.818 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3edb71d640 1 -- start start 2023-11-18T23:40:48.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3edb71d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed415d2e0 0x7f3ed40b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3edb71d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3ed40b2cd0 0x7f3ed406d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3edb71d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed40acbf0 con 0x7f3ed406ded0 2023-11-18T23:40:48.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3edb71d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed415d6c0 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3edb71d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40b3170 con 0x7f3ed415d2e0 2023-11-18T23:40:48.820 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3ed94b9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed415d2e0 0x7f3ed40b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3ed9cba640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f3ed406ded0 0x7f3ed406b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36024/0 (socket says 172.21.15.116:36024) 2023-11-18T23:40:48.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.817+0000 7f3ed9cba640 1 -- 172.21.15.116:0/1809180036 learned_addr learned my addr 172.21.15.116:0/1809180036 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-11-18T23:40:48.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ed8cb8640 1 --2- 172.21.15.116:0/1809180036 >> v2:172.21.15.8:3300/0 conn(0x7f3ed40b2cd0 0x7f3ed406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ed94b9640 1 -- 172.21.15.116:0/1809180036 >> v2:172.21.15.8:3300/0 conn(0x7f3ed40b2cd0 msgr2=0x7f3ed406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:48.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ed94b9640 1 --2- 172.21.15.116:0/1809180036 >> v2:172.21.15.8:3300/0 conn(0x7f3ed40b2cd0 0x7f3ed406d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ed94b9640 1 -- 172.21.15.116:0/1809180036 >> v1:172.21.15.116:6789/0 conn(0x7f3ed406ded0 legacy=0x7f3ed406b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.821 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ecbfff640 1 -- 172.21.15.116:0/1809180036 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111782137 0 0) 0x7f3ed40acbf0 con 0x7f3ed406ded0 2023-11-18T23:40:48.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ed94b9640 1 -- 172.21.15.116:0/1809180036 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40b3450 con 0x7f3ed415d2e0 2023-11-18T23:40:48.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ed8cb8640 1 --2- 172.21.15.116:0/1809180036 >> v2:172.21.15.8:3300/0 conn(0x7f3ed40b2cd0 0x7f3ed406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:40:48.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.818+0000 7f3ed94b9640 1 --2- 172.21.15.116:0/1809180036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed415d2e0 0x7f3ed40b2790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097a0 tx=0x7f3ed002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e9b2e68619c9d68 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3ecbfff640 1 -- 172.21.15.116:0/1809180036 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed002d040 con 0x7f3ed415d2e0 2023-11-18T23:40:48.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3ecbfff640 1 -- 172.21.15.116:0/1809180036 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0031810 con 0x7f3ed415d2e0 2023-11-18T23:40:48.822 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3ecbfff640 1 -- 172.21.15.116:0/1809180036 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0031ba0 con 0x7f3ed415d2e0 2023-11-18T23:40:48.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 -- 172.21.15.116:0/1809180036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed415d2e0 msgr2=0x7f3ed40b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.825 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 --2- 172.21.15.116:0/1809180036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed415d2e0 0x7f3ed40b2790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097a0 tx=0x7f3ed002b8b0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 -- 172.21.15.116:0/1809180036 shutdown_connections 2023-11-18T23:40:48.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 --2- 172.21.15.116:0/1809180036 >> v2:172.21.15.8:3300/0 conn(0x7f3ed40b2cd0 0x7f3ed406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 --2- 172.21.15.116:0/1809180036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed415d2e0 0x7f3ed40b2790 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 -- 172.21.15.116:0/1809180036 >> 172.21.15.116:0/1809180036 conn(0x7f3ed4070f40 msgr2=0x7f3ed4071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 -- 172.21.15.116:0/1809180036 shutdown_connections 2023-11-18T23:40:48.826 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.819+0000 7f3edb71d640 1 -- 172.21.15.116:0/1809180036 wait complete. 2023-11-18T23:40:48.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.820+0000 7f3edb71d640 1 Processor -- start 2023-11-18T23:40:48.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3edb71d640 1 -- start start 2023-11-18T23:40:48.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3edb71d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed406ded0 0x7f3ed414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3edb71d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ed40b2cd0 0x7f3ed41501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3edb71d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed415d2e0 0x7f3ed4150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:48.827 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3edb71d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4153470 con 0x7f3ed415d2e0 2023-11-18T23:40:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3edb71d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4153160 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3edb71d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40cc6a0 con 0x7f3ed406ded0 2023-11-18T23:40:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3ed94b9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed406ded0 0x7f3ed414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3ed94b9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed406ded0 0x7f3ed414f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:44122/0 (socket says 172.21.15.116:44122) 2023-11-18T23:40:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3ed94b9640 1 -- 172.21.15.116:0/3696602249 learned_addr learned my addr 172.21.15.116:0/3696602249 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:48.828 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3ed8cb8640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ed40b2cd0 0x7f3ed41501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.821+0000 7f3ed9cba640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed415d2e0 0x7f3ed4150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed8cb8640 1 -- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed406ded0 msgr2=0x7f3ed414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed8cb8640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed406ded0 0x7f3ed414f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed8cb8640 1 -- 172.21.15.116:0/3696602249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed415d2e0 msgr2=0x7f3ed4150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed8cb8640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed415d2e0 0x7f3ed4150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed8cb8640 1 -- 172.21.15.116:0/3696602249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009400 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.829 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed94b9640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed406ded0 0x7f3ed414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed9cba640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed415d2e0 0x7f3ed4150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ed8cb8640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ed40b2cd0 0x7f3ed41501f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400e810 tx=0x7f3ec400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ec9ffb640 1 -- 172.21.15.116:0/3696602249 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4004030 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ec9ffb640 1 -- 172.21.15.116:0/3696602249 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4004190 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed40cc980 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.830 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ec9ffb640 1 -- 172.21.15.116:0/3696602249 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400c6d0 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ec9ffb640 1 -- 172.21.15.116:0/3696602249 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3ec400cb30 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed40ccf40 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.822+0000 7f3ec9ffb640 1 -- 172.21.15.116:0/3696602249 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3ec4003cf0 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.823+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed4072720 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.831 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.825+0000 7f3ec9ffb640 1 -- 172.21.15.116:0/3696602249 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3ec4020060 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.898 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.897+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "15683341-f0d7-4f5f-a5f8-3bf8ae54223b", "id": 5} v 0) v1 -- 0x7f3ed40ceff0 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.901 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.900+0000 7f3ec9ffb640 1 -- 172.21.15.116:0/3696602249 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15683341-f0d7-4f5f-a5f8-3bf8ae54223b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ec400f040 con 0x7f3ed40b2cd0 2023-11-18T23:40:48.901 INFO:teuthology.orchestra.run.smithi116.stdout:5 2023-11-18T23:40:48.902 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.900+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ed40b2cd0 msgr2=0x7f3ed41501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:48.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.900+0000 7f3edb71d640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ed40b2cd0 0x7f3ed41501f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400e810 tx=0x7f3ec400ecd0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.901+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 shutdown_connections 2023-11-18T23:40:48.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.901+0000 7f3edb71d640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ed415d2e0 0x7f3ed4150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.903 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.901+0000 7f3edb71d640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ed40b2cd0 0x7f3ed41501f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.901+0000 7f3edb71d640 1 --2- 172.21.15.116:0/3696602249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ed406ded0 0x7f3ed414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:48.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.901+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 >> 172.21.15.116:0/3696602249 conn(0x7f3ed4070f40 msgr2=0x7f3ed415fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:48.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.901+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 shutdown_connections 2023-11-18T23:40:48.904 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:48.901+0000 7f3edb71d640 1 -- 172.21.15.116:0/3696602249 wait complete. 2023-11-18T23:40:48.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 8ca3ae25-3f08-4dcb-847a-783fcedfb69f 6 2023-11-18T23:40:49.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f5066e90640 1 Processor -- start 2023-11-18T23:40:49.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f5066e90640 1 -- start start 2023-11-18T23:40:49.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f5066e90640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f506015b090 0x7f506015c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f5066e90640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f506006a4d0 0x7f506006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f5066e90640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506015fc40 con 0x7f50600ca450 2023-11-18T23:40:49.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f5066e90640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506006aea0 con 0x7f506015b090 2023-11-18T23:40:49.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f5066e90640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506015c680 con 0x7f506006a4d0 2023-11-18T23:40:49.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f505ffff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f50600ca450 0x7f506015f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36038/0 (socket says 172.21.15.116:36038) 2023-11-18T23:40:49.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f505ffff640 1 -- 172.21.15.116:0/3339858371 learned_addr learned my addr 172.21.15.116:0/3339858371 (peer_addr_for_me v1:172.21.15.116:0/0) 2023-11-18T23:40:49.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.054+0000 7f506542d640 1 --2- 172.21.15.116:0/3339858371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f506006a4d0 0x7f506006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.059 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.055+0000 7f5064c2c640 1 --2- 172.21.15.116:0/3339858371 >> v2:172.21.15.8:3300/0 conn(0x7f506015b090 0x7f506015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.055+0000 7f505f7fe640 1 -- 172.21.15.116:0/3339858371 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994816152 0 0) 0x7f504c001110 con 0x7f50600ca450 2023-11-18T23:40:49.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.055+0000 7f505f7fe640 1 -- 172.21.15.116:0/3339858371 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5050003520 con 0x7f50600ca450 2023-11-18T23:40:49.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.055+0000 7f506542d640 1 -- 172.21.15.116:0/3339858371 >> v2:172.21.15.8:3300/0 conn(0x7f506015b090 msgr2=0x7f506015c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:49.060 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.055+0000 7f506542d640 1 --2- 172.21.15.116:0/3339858371 >> v2:172.21.15.8:3300/0 conn(0x7f506015b090 0x7f506015c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.055+0000 7f506542d640 1 -- 172.21.15.116:0/3339858371 >> v1:172.21.15.116:6789/0 conn(0x7f50600ca450 legacy=0x7f506015f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.055+0000 7f506542d640 1 -- 172.21.15.116:0/3339858371 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506006ebb0 con 0x7f506006a4d0 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f506542d640 1 --2- 172.21.15.116:0/3339858371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f506006a4d0 0x7f506006a960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5058009d90 tx=0x7f505802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e49b03af68e7cd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f505f7fe640 1 -- 172.21.15.116:0/3339858371 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505802cc50 con 0x7f506006a4d0 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f505f7fe640 1 -- 172.21.15.116:0/3339858371 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505802cdb0 con 0x7f506006a4d0 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f505f7fe640 1 -- 172.21.15.116:0/3339858371 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058034660 con 0x7f506006a4d0 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 -- 172.21.15.116:0/3339858371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f506006a4d0 msgr2=0x7f506006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 --2- 172.21.15.116:0/3339858371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f506006a4d0 0x7f506006a960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5058009d90 tx=0x7f505802bea0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.061 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 -- 172.21.15.116:0/3339858371 shutdown_connections 2023-11-18T23:40:49.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 --2- 172.21.15.116:0/3339858371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f506006a4d0 0x7f506006a960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 --2- 172.21.15.116:0/3339858371 >> v2:172.21.15.8:3300/0 conn(0x7f506015b090 0x7f506015c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 -- 172.21.15.116:0/3339858371 >> 172.21.15.116:0/3339858371 conn(0x7f50600b19d0 msgr2=0x7f50600b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:49.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 -- 172.21.15.116:0/3339858371 shutdown_connections 2023-11-18T23:40:49.062 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.056+0000 7f5066e90640 1 -- 172.21.15.116:0/3339858371 wait complete. 2023-11-18T23:40:49.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.057+0000 7f5066e90640 1 Processor -- start 2023-11-18T23:40:49.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.057+0000 7f5066e90640 1 -- start start 2023-11-18T23:40:49.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f5066e90640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f506006a4d0 0x7f50600c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.064 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f5066e90640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50600ca450 0x7f5060154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f5066e90640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f506015b090 0x7f50600c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f5066e90640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060159c80 con 0x7f506006a4d0 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f5066e90640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50600b4fd0 con 0x7f506015b090 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f5066e90640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50601592e0 con 0x7f50600ca450 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f505ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50600ca450 0x7f5060154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f506542d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f506015b090 0x7f50600c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f505ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50600ca450 0x7f5060154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:44140/0 (socket says 172.21.15.116:44140) 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f505ffff640 1 -- 172.21.15.116:0/463849093 learned_addr learned my addr 172.21.15.116:0/463849093 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.058+0000 7f5064c2c640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f506006a4d0 0x7f50600c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505ffff640 1 -- 172.21.15.116:0/463849093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f506015b090 msgr2=0x7f50600c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.065 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505ffff640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f506015b090 0x7f50600c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505ffff640 1 -- 172.21.15.116:0/463849093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f506006a4d0 msgr2=0x7f50600c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505ffff640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f506006a4d0 0x7f50600c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505ffff640 1 -- 172.21.15.116:0/463849093 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058009a70 con 0x7f50600ca450 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505ffff640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50600ca450 0x7f5060154600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c700 tx=0x7f504c00cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505d7fa640 1 -- 172.21.15.116:0/463849093 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c005ce0 con 0x7f50600ca450 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505d7fa640 1 -- 172.21.15.116:0/463849093 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c005e40 con 0x7f50600ca450 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50601595c0 con 0x7f50600ca450 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505d7fa640 1 -- 172.21.15.116:0/463849093 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c007290 con 0x7f50600ca450 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5060154b40 con 0x7f50600ca450 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505d7fa640 1 -- 172.21.15.116:0/463849093 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f504c01c440 con 0x7f50600ca450 2023-11-18T23:40:49.066 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.059+0000 7f505d7fa640 1 -- 172.21.15.116:0/463849093 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f504c0129f0 con 0x7f50600ca450 2023-11-18T23:40:49.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.060+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5060159dc0 con 0x7f50600ca450 2023-11-18T23:40:49.067 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.062+0000 7f505d7fa640 1 -- 172.21.15.116:0/463849093 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5060159dc0 con 0x7f50600ca450 2023-11-18T23:40:49.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.134+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8ca3ae25-3f08-4dcb-847a-783fcedfb69f", "id": 6} v 0) v1 -- 0x7f506009e030 con 0x7f50600ca450 2023-11-18T23:40:49.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.137+0000 7f505d7fa640 1 -- 172.21.15.116:0/463849093 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ca3ae25-3f08-4dcb-847a-783fcedfb69f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f504c017070 con 0x7f50600ca450 2023-11-18T23:40:49.138 INFO:teuthology.orchestra.run.smithi116.stdout:6 2023-11-18T23:40:49.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50600ca450 msgr2=0x7f5060154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50600ca450 0x7f5060154600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c700 tx=0x7f504c00cb00 comp rx=0 tx=0).stop 2023-11-18T23:40:49.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 shutdown_connections 2023-11-18T23:40:49.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f506015b090 0x7f50600c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50600ca450 0x7f5060154600 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 --2- 172.21.15.116:0/463849093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f506006a4d0 0x7f50600c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 >> 172.21.15.116:0/463849093 conn(0x7f50600b19d0 msgr2=0x7f50600b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:49.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 shutdown_connections 2023-11-18T23:40:49.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.138+0000 7f5066e90640 1 -- 172.21.15.116:0/463849093 wait complete. 2023-11-18T23:40:49.148 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.147+0000 7f94f4a2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-18T23:40:49.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 83046faa-fd59-44b8-a0db-f82d66da14cc 7 2023-11-18T23:40:49.173 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.172+0000 7f0d76c32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-18T23:40:49.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.247+0000 7f261191d640 1 Processor -- start 2023-11-18T23:40:49.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.247+0000 7f261191d640 1 -- start start 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f261191d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c06b4e0 0x7f260c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f261191d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f260c0ce0f0 0x7f260c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f261191d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c06be80 con 0x7f260c13ffc0 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f261191d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0cc6c0 con 0x7f260c0ce0f0 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f261191d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0ccb50 con 0x7f260c06b4e0 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f260b7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f260c0ce0f0 0x7f260c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f260a7fc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c06b4e0 0x7f260c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f260b7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f260c0ce0f0 0x7f260c0ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54634/0 (socket says 172.21.15.116:54634) 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f260a7fc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c06b4e0 0x7f260c06b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:44150/0 (socket says 172.21.15.116:44150) 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.248+0000 7f260b7fe640 1 -- 172.21.15.116:0/2915562554 learned_addr learned my addr 172.21.15.116:0/2915562554 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:49.251 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f260b7fe640 1 -- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c06b4e0 msgr2=0x7f260c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f260b7fe640 1 --2- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c06b4e0 0x7f260c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f260b7fe640 1 -- 172.21.15.116:0/2915562554 >> v1:172.21.15.8:6789/0 conn(0x7f260c13ffc0 legacy=0x7f260c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f260b7fe640 1 -- 172.21.15.116:0/2915562554 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c15b3b0 con 0x7f260c0ce0f0 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f260a7fc640 1 --2- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c06b4e0 0x7f260c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f260b7fe640 1 --2- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c0ce0f0 0x7f260c0ce580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2604009e50 tx=0x7f260402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ace74e745b72d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f2609ffb640 1 -- 172.21.15.116:0/2915562554 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260402ca70 con 0x7f260c0ce0f0 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f2609ffb640 1 -- 172.21.15.116:0/2915562554 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260402cbd0 con 0x7f260c0ce0f0 2023-11-18T23:40:49.252 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.249+0000 7f2609ffb640 1 -- 172.21.15.116:0/2915562554 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040343f0 con 0x7f260c0ce0f0 2023-11-18T23:40:49.253 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 -- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c0ce0f0 msgr2=0x7f260c0ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.253 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 --2- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c0ce0f0 0x7f260c0ce580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2604009e50 tx=0x7f260402bed0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.253 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 -- 172.21.15.116:0/2915562554 shutdown_connections 2023-11-18T23:40:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 --2- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c0ce0f0 0x7f260c0ce580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 --2- 172.21.15.116:0/2915562554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c06b4e0 0x7f260c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 -- 172.21.15.116:0/2915562554 >> 172.21.15.116:0/2915562554 conn(0x7f260c070f40 msgr2=0x7f260c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 -- 172.21.15.116:0/2915562554 shutdown_connections 2023-11-18T23:40:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.250+0000 7f261191d640 1 -- 172.21.15.116:0/2915562554 wait complete. 2023-11-18T23:40:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.252+0000 7f261191d640 1 Processor -- start 2023-11-18T23:40:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.252+0000 7f261191d640 1 -- start start 2023-11-18T23:40:49.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f261191d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c06b4e0 0x7f260c154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f261191d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c0ce0f0 0x7f260c15cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.256 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f261191d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f260c13ffc0 0x7f260c1f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f261191d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c159a00 con 0x7f260c13ffc0 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f261191d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c159570 con 0x7f260c06b4e0 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f261191d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c158960 con 0x7f260c0ce0f0 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f260affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c06b4e0 0x7f260c154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f260a7fc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c0ce0f0 0x7f260c15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f260a7fc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c0ce0f0 0x7f260c15cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:44166/0 (socket says 172.21.15.116:44166) 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f260a7fc640 1 -- 172.21.15.116:0/3711126621 learned_addr learned my addr 172.21.15.116:0/3711126621 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.253+0000 7f260affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c06b4e0 0x7f260c154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54650/0 (socket says 172.21.15.116:54650) 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260b7fe640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f260c13ffc0 0x7f260c1f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260affd640 1 -- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c0ce0f0 msgr2=0x7f260c15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260affd640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c0ce0f0 0x7f260c15cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260affd640 1 -- 172.21.15.116:0/3711126621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f260c13ffc0 msgr2=0x7f260c1f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260affd640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f260c13ffc0 0x7f260c1f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260affd640 1 -- 172.21.15.116:0/3711126621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600009400 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260a7fc640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c0ce0f0 0x7f260c15cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f260affd640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c06b4e0 0x7f260c154c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25fc001770 tx=0x7f25fc001c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f25f3fff640 1 -- 172.21.15.116:0/3711126621 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc010460 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f25f3fff640 1 -- 172.21.15.116:0/3711126621 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc001d60 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2604009b30 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f25f3fff640 1 -- 172.21.15.116:0/3711126621 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc005310 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c158f20 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f25f3fff640 1 -- 172.21.15.116:0/3711126621 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f25fc00a940 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.254+0000 7f25f3fff640 1 -- 172.21.15.116:0/3711126621 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f25fc00fb40 con 0x7f260c06b4e0 2023-11-18T23:40:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.255+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c072720 con 0x7f260c06b4e0 2023-11-18T23:40:49.259 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.257+0000 7f25f3fff640 1 -- 172.21.15.116:0/3711126621 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f25fc005470 con 0x7f260c06b4e0 2023-11-18T23:40:49.289 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.288+0000 7f94f4a2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T23:40:49.315 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.314+0000 7f0d76c32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T23:40:49.329 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.328+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "83046faa-fd59-44b8-a0db-f82d66da14cc", "id": 7} v 0) v1 -- 0x7f260c0ae510 con 0x7f260c06b4e0 2023-11-18T23:40:49.337 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.336+0000 7f25f3fff640 1 -- 172.21.15.116:0/3711126621 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83046faa-fd59-44b8-a0db-f82d66da14cc", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f25fc00ad30 con 0x7f260c06b4e0 2023-11-18T23:40:49.338 INFO:teuthology.orchestra.run.smithi116.stdout:7 2023-11-18T23:40:49.338 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c06b4e0 msgr2=0x7f260c154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c06b4e0 0x7f260c154c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25fc001770 tx=0x7f25fc001c30 comp rx=0 tx=0).stop 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 shutdown_connections 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f260c13ffc0 0x7f260c1f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f260c0ce0f0 0x7f260c15cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 --2- 172.21.15.116:0/3711126621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c06b4e0 0x7f260c154c50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 >> 172.21.15.116:0/3711126621 conn(0x7f260c070f40 msgr2=0x7f260c0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 shutdown_connections 2023-11-18T23:40:49.339 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:40:49.337+0000 7f261191d640 1 -- 172.21.15.116:0/3711126621 wait complete. 2023-11-18T23:40:49.348 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-18T23:40:49.349 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-18T23:40:49.351 INFO:tasks.ceph.osd.0:Started 2023-11-18T23:40:49.351 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-18T23:40:49.351 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-18T23:40:49.353 INFO:tasks.ceph.osd.1:Started 2023-11-18T23:40:49.353 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-18T23:40:49.353 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-18T23:40:49.355 INFO:tasks.ceph.osd.2:Started 2023-11-18T23:40:49.355 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-18T23:40:49.356 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-18T23:40:49.358 INFO:tasks.ceph.osd.3:Started 2023-11-18T23:40:49.358 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-18T23:40:49.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-18T23:40:49.360 INFO:tasks.ceph.osd.4:Started 2023-11-18T23:40:49.360 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-18T23:40:49.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-18T23:40:49.362 INFO:tasks.ceph.osd.5:Started 2023-11-18T23:40:49.362 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-18T23:40:49.363 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-18T23:40:49.364 INFO:tasks.ceph.osd.6:Started 2023-11-18T23:40:49.365 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-18T23:40:49.365 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-18T23:40:49.367 INFO:tasks.ceph.osd.7:Started 2023-11-18T23:40:49.367 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:40:49.425 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.424+0000 7f94f4a2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T23:40:49.473 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.472+0000 7f0d76c32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T23:40:49.481 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.480+0000 7f94f4a2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T23:40:49.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.509+0000 7fb36cd33640 1 Processor -- start 2023-11-18T23:40:49.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.509+0000 7fb36cd33640 1 -- start start 2023-11-18T23:40:49.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.509+0000 7fb36cd33640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3680d1720 0x7fb3680d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.509+0000 7fb36cd33640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb3680b3db0 0x7fb3680b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.509+0000 7fb36cd33640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680b5f90 con 0x7fb36815d3e0 2023-11-18T23:40:49.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.509+0000 7fb36cd33640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680d20a0 con 0x7fb3680d1720 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.509+0000 7fb36cd33640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680b61e0 con 0x7fb3680b3db0 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb35ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3680d1720 0x7fb3680d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb35ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3680d1720 0x7fb3680d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32982/0 (socket says 172.21.15.8:32982) 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb35ffff640 1 -- 172.21.15.8:0/3421187030 learned_addr learned my addr 172.21.15.8:0/3421187030 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb366d9d640 1 --2- 172.21.15.8:0/3421187030 >> v2:172.21.15.116:3300/0 conn(0x7fb3680b3db0 0x7fb3680b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb365d9b640 1 -- 172.21.15.8:0/3421187030 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218126411 0 0) 0x7fb3680b5f90 con 0x7fb36815d3e0 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb365d9b640 1 -- 172.21.15.8:0/3421187030 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb354003520 con 0x7fb36815d3e0 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb35ffff640 1 -- 172.21.15.8:0/3421187030 >> v2:172.21.15.116:3300/0 conn(0x7fb3680b3db0 msgr2=0x7fb3680b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb35ffff640 1 --2- 172.21.15.8:0/3421187030 >> v2:172.21.15.116:3300/0 conn(0x7fb3680b3db0 0x7fb3680b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb35ffff640 1 -- 172.21.15.8:0/3421187030 >> v1:172.21.15.8:6789/0 conn(0x7fb36815d3e0 legacy=0x7fb3680ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.510+0000 7fb35ffff640 1 -- 172.21.15.8:0/3421187030 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680b64c0 con 0x7fb3680d1720 2023-11-18T23:40:49.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb35ffff640 1 --2- 172.21.15.8:0/3421187030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680d1720 0x7fb3680d1b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb3680cdc30 tx=0x7fb35002b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52029ef30c19a5f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:49.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb365d9b640 1 -- 172.21.15.8:0/3421187030 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350030890 con 0x7fb3680d1720 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb365d9b640 1 -- 172.21.15.8:0/3421187030 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3500309f0 con 0x7fb3680d1720 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb365d9b640 1 -- 172.21.15.8:0/3421187030 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350030dc0 con 0x7fb3680d1720 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 -- 172.21.15.8:0/3421187030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680d1720 msgr2=0x7fb3680d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 --2- 172.21.15.8:0/3421187030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680d1720 0x7fb3680d1b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb3680cdc30 tx=0x7fb35002b9d0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 -- 172.21.15.8:0/3421187030 shutdown_connections 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 --2- 172.21.15.8:0/3421187030 >> v2:172.21.15.116:3300/0 conn(0x7fb3680b3db0 0x7fb3680b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 --2- 172.21.15.8:0/3421187030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680d1720 0x7fb3680d1b60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 -- 172.21.15.8:0/3421187030 >> 172.21.15.8:0/3421187030 conn(0x7fb36809c480 msgr2=0x7fb3680d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 -- 172.21.15.8:0/3421187030 shutdown_connections 2023-11-18T23:40:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.511+0000 7fb36cd33640 1 -- 172.21.15.8:0/3421187030 wait complete. 2023-11-18T23:40:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.513+0000 7fb36cd33640 1 Processor -- start 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.513+0000 7fb36cd33640 1 -- start start 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36cd33640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680b3db0 0x7fb36814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36cd33640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3680d1720 0x7fb3680b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36cd33640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb36815d3e0 0x7fb3680b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36cd33640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680afd70 con 0x7fb3680b3db0 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36cd33640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36814eab0 con 0x7fb3680d1720 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36cd33640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680cc390 con 0x7fb36815d3e0 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680b3db0 0x7fb36814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3680d1720 0x7fb3680b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680b3db0 0x7fb36814e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32994/0 (socket says 172.21.15.8:32994) 2023-11-18T23:40:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 -- 172.21.15.8:0/2298231685 learned_addr learned my addr 172.21.15.8:0/2298231685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb366d9d640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb36815d3e0 0x7fb3680b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 -- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb36815d3e0 msgr2=0x7fb3680b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb36815d3e0 0x7fb3680b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 -- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3680d1720 msgr2=0x7fb3680b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3680d1720 0x7fb3680b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb36659c640 1 -- 172.21.15.8:0/2298231685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500094d0 con 0x7fb3680b3db0 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.514+0000 7fb35ffff640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3680d1720 0x7fb3680b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb36659c640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680b3db0 0x7fb36814e570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb35800c490 tx=0x7fb35800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb35effd640 1 -- 172.21.15.8:0/2298231685 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580052d0 con 0x7fb3680b3db0 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb35effd640 1 -- 172.21.15.8:0/2298231685 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358005430 con 0x7fb3680b3db0 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680cc670 con 0x7fb3680b3db0 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb35effd640 1 -- 172.21.15.8:0/2298231685 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358012870 con 0x7fb3680b3db0 2023-11-18T23:40:49.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680ccc30 con 0x7fb3680b3db0 2023-11-18T23:40:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb35effd640 1 -- 172.21.15.8:0/2298231685 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb358012cd0 con 0x7fb3680b3db0 2023-11-18T23:40:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.515+0000 7fb35effd640 1 -- 172.21.15.8:0/2298231685 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb35801bc30 con 0x7fb3680b3db0 2023-11-18T23:40:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.516+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3680afee0 con 0x7fb3680b3db0 2023-11-18T23:40:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.519+0000 7fb35effd640 1 -- 172.21.15.8:0/2298231685 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb35801b520 con 0x7fb3680b3db0 2023-11-18T23:40:49.543 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.542+0000 7f0d76c32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T23:40:49.580 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.579+0000 7f94f4a2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T23:40:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.602+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb368067420 con 0x7fb3680b3db0 2023-11-18T23:40:49.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.603+0000 7fb35effd640 1 -- 172.21.15.8:0/2298231685 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb35802a090 con 0x7fb3680b3db0 2023-11-18T23:40:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:40:49.604 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:40:49.330213+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:40:49.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680b3db0 msgr2=0x7fb36814e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:49.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680b3db0 0x7fb36814e570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb35800c490 tx=0x7fb35800c950 comp rx=0 tx=0).stop 2023-11-18T23:40:49.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 shutdown_connections 2023-11-18T23:40:49.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb36815d3e0 0x7fb3680b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3680d1720 0x7fb3680b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 --2- 172.21.15.8:0/2298231685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3680b3db0 0x7fb36814e570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:49.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 >> 172.21.15.8:0/2298231685 conn(0x7fb36809c480 msgr2=0x7fb36806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:49.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 shutdown_connections 2023-11-18T23:40:49.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:40:49.604+0000 7fb36cd33640 1 -- 172.21.15.8:0/2298231685 wait complete. 2023-11-18T23:40:49.615 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-18T23:40:49.616 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-18T23:40:49.654 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.652+0000 7f0d76c32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T23:40:49.672 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.671+0000 7f94f4a2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T23:40:49.752 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.751+0000 7f0d76c32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T23:40:49.812 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.810+0000 7f94f4a2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T23:40:49.854 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.853+0000 7f94f4a2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T23:40:49.897 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.896+0000 7f0d76c32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T23:40:49.941 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:49.940+0000 7f0d76c32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T23:40:49.958 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-18T23:40:49.957+0000 7f3d22614500 -1 Falling back to public interface 2023-11-18T23:40:49.961 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-18T23:40:49.960+0000 7fbb1c238500 -1 Falling back to public interface 2023-11-18T23:40:49.962 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-18T23:40:49.960+0000 7f6275c0e500 -1 Falling back to public interface 2023-11-18T23:40:49.962 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-18T23:40:49.961+0000 7f2efa372500 -1 Falling back to public interface 2023-11-18T23:40:49.975 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-18T23:40:49.974+0000 7ffb9f4d4500 -1 Falling back to public interface 2023-11-18T23:40:49.994 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-18T23:40:49.993+0000 7feb155ad500 -1 Falling back to public interface 2023-11-18T23:40:49.995 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-18T23:40:49.993+0000 7f9766a2a500 -1 Falling back to public interface 2023-11-18T23:40:49.999 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-18T23:40:49.998+0000 7f9dc160f500 -1 Falling back to public interface 2023-11-18T23:40:50.000 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:49.998+0000 7f94f4a2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T23:40:50.091 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:50.090+0000 7f0d76c32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T23:40:50.420 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T23:40:50.513 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.511+0000 7f0d1ebf5640 1 Processor -- start 2023-11-18T23:40:50.513 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.512+0000 7f0d1ebf5640 1 -- start start 2023-11-18T23:40:50.514 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.512+0000 7f0d1ebf5640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0d180b1120 0x7f0d180cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:50.514 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.512+0000 7f0d1ebf5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d18143240 0x7f0d18070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:50.514 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.512+0000 7f0d1ebf5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d18070350 con 0x7f0d18142cc0 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.512+0000 7f0d1ebf5640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d181430a0 con 0x7f0d180b1120 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.512+0000 7f0d1ebf5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18070630 con 0x7f0d18143240 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d17fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0d180b1120 0x7f0d180cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d17fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0d180b1120 0x7f0d180cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32996/0 (socket says 172.21.15.8:32996) 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d17fff640 1 -- 172.21.15.8:0/3498926480 learned_addr learned my addr 172.21.15.8:0/3498926480 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d1d192640 1 --2- 172.21.15.8:0/3498926480 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d18143240 0x7f0d18070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d17fff640 1 -- 172.21.15.8:0/3498926480 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d18143240 msgr2=0x7f0d18070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d17fff640 1 --2- 172.21.15.8:0/3498926480 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d18143240 0x7f0d18070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d17fff640 1 -- 172.21.15.8:0/3498926480 >> v1:172.21.15.116:6789/0 conn(0x7f0d18142cc0 legacy=0x7f0d180b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:50.515 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.513+0000 7f0d17fff640 1 -- 172.21.15.8:0/3498926480 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180cd400 con 0x7f0d180b1120 2023-11-18T23:40:50.517 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d17fff640 1 --2- 172.21.15.8:0/3498926480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d180b1120 0x7f0d180cddc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009870 tx=0x7f0d0c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1f4337c0708bb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:50.517 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d177fe640 1 -- 172.21.15.8:0/3498926480 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c031640 con 0x7f0d180b1120 2023-11-18T23:40:50.517 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d177fe640 1 -- 172.21.15.8:0/3498926480 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0317a0 con 0x7f0d180b1120 2023-11-18T23:40:50.517 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d177fe640 1 -- 172.21.15.8:0/3498926480 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c031b30 con 0x7f0d180b1120 2023-11-18T23:40:50.517 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/3498926480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d180b1120 msgr2=0x7f0d180cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:50.517 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 --2- 172.21.15.8:0/3498926480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d180b1120 0x7f0d180cddc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009870 tx=0x7f0d0c02b8f0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.517 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/3498926480 shutdown_connections 2023-11-18T23:40:50.518 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 --2- 172.21.15.8:0/3498926480 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d18143240 0x7f0d18070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.518 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 --2- 172.21.15.8:0/3498926480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d180b1120 0x7f0d180cddc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.518 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/3498926480 >> 172.21.15.8:0/3498926480 conn(0x7f0d1806c500 msgr2=0x7f0d1806c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:50.518 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/3498926480 shutdown_connections 2023-11-18T23:40:50.518 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.514+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/3498926480 wait complete. 2023-11-18T23:40:50.518 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.516+0000 7f0d1ebf5640 1 Processor -- start 2023-11-18T23:40:50.518 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.516+0000 7f0d1ebf5640 1 -- start start 2023-11-18T23:40:50.520 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.516+0000 7f0d1ebf5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d180b1120 0x7f0d180cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:50.520 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1ebf5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d18142cc0 0x7f0d1815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:50.520 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1ebf5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d18143240 0x7f0d1815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:50.520 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1ebf5640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18131360 con 0x7f0d18142cc0 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1ebf5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18133050 con 0x7f0d18143240 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1ebf5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18133330 con 0x7f0d180b1120 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d18142cc0 0x7f0d1815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d18142cc0 0x7f0d1815d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33002/0 (socket says 172.21.15.8:33002) 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 -- 172.21.15.8:0/1982242629 learned_addr learned my addr 172.21.15.8:0/1982242629 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1d192640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d18143240 0x7f0d1815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1c991640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d180b1120 0x7f0d180cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 -- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d180b1120 msgr2=0x7f0d180cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d180b1120 0x7f0d180cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 -- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d18143240 msgr2=0x7f0d1815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:50.521 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d18143240 0x7f0d1815d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 -- 172.21.15.8:0/1982242629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0094d0 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d17fff640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d18142cc0 0x7f0d1815d480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c000c00 tx=0x7f0d0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d157fa640 1 -- 172.21.15.8:0/1982242629 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c03a930 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d157fa640 1 -- 172.21.15.8:0/1982242629 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c03aa90 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d18133610 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d157fa640 1 -- 172.21.15.8:0/1982242629 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c03ae40 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.517+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d18133bd0 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.518+0000 7f0d157fa640 1 -- 172.21.15.8:0/1982242629 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d0c02f050 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.518+0000 7f0d157fa640 1 -- 172.21.15.8:0/1982242629 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0d0c044cf0 con 0x7f0d18142cc0 2023-11-18T23:40:50.522 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.518+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d18067420 con 0x7f0d18142cc0 2023-11-18T23:40:50.523 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.521+0000 7f0d157fa640 1 -- 172.21.15.8:0/1982242629 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0d0c035020 con 0x7f0d18142cc0 2023-11-18T23:40:50.584 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.583+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d1806e670 con 0x7f0d18142cc0 2023-11-18T23:40:50.585 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d157fa640 1 -- 172.21.15.8:0/1982242629 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0d0c02d040 con 0x7f0d18142cc0 2023-11-18T23:40:50.585 INFO:teuthology.misc.health.smithi008.stdout: 2023-11-18T23:40:50.586 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":10,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:40:49.330213+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:40:50.587 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d18142cc0 msgr2=0x7f0d1815d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:50.587 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d1ebf5640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d18142cc0 0x7f0d1815d480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c000c00 tx=0x7f0d0c0046c0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.587 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 shutdown_connections 2023-11-18T23:40:50.587 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d1ebf5640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d18143240 0x7f0d1815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.587 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d1ebf5640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d18142cc0 0x7f0d1815d480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.587 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d1ebf5640 1 --2- 172.21.15.8:0/1982242629 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d180b1120 0x7f0d180cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:50.588 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.584+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 >> 172.21.15.8:0/1982242629 conn(0x7f0d1806c500 msgr2=0x7f0d180cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:50.588 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.585+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 shutdown_connections 2023-11-18T23:40:50.588 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:50.585+0000 7f0d1ebf5640 1 -- 172.21.15.8:0/1982242629 wait complete. 2023-11-18T23:40:50.595 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-18T23:40:50.800 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:50.799+0000 7f94f4a2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T23:40:50.921 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:50.920+0000 7f0d76c32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T23:40:51.068 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:51.067+0000 7f94f4a2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T23:40:51.119 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:51.118+0000 7f94f4a2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T23:40:51.204 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:51.202+0000 7f0d76c32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T23:40:51.219 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:51.218+0000 7f94f4a2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T23:40:51.257 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:51.256+0000 7f0d76c32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T23:40:51.363 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-11-18T23:40:51.362+0000 7f0d76c32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T23:40:52.245 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:52.244+0000 7f94956d7640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-18T23:40:52.245 INFO:tasks.ceph.mgr.x.smithi116.stderr:2023-11-18T23:40:52.244+0000 7f94956d7640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-18T23:40:53.425 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-18T23:40:53.424+0000 7f6275c0e500 -1 osd.0 0 log_to_monitors true 2023-11-18T23:40:53.442 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-18T23:40:53.441+0000 7fbb1c238500 -1 osd.6 0 log_to_monitors true 2023-11-18T23:40:53.465 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-18T23:40:53.464+0000 7f2efa372500 -1 osd.7 0 log_to_monitors true 2023-11-18T23:40:53.484 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-18T23:40:53.483+0000 7f3d22614500 -1 osd.4 0 log_to_monitors true 2023-11-18T23:40:53.491 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-18T23:40:53.490+0000 7feb155ad500 -1 osd.2 0 log_to_monitors true 2023-11-18T23:40:53.491 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-18T23:40:53.490+0000 7ffb9f4d4500 -1 osd.5 0 log_to_monitors true 2023-11-18T23:40:53.495 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-18T23:40:53.494+0000 7f9766a2a500 -1 osd.1 0 log_to_monitors true 2023-11-18T23:40:53.496 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-18T23:40:53.495+0000 7f9dc160f500 -1 osd.3 0 log_to_monitors true 2023-11-18T23:40:56.698 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-18T23:40:56.697+0000 7feb12552640 -1 osd.2 0 waiting for initial osdmap 2023-11-18T23:40:56.714 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-18T23:40:56.713+0000 7feb09353640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:56.734 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-18T23:40:56.733+0000 7f9761839640 -1 osd.1 0 waiting for initial osdmap 2023-11-18T23:40:56.747 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-18T23:40:56.746+0000 7f62724f4640 -1 osd.0 0 waiting for initial osdmap 2023-11-18T23:40:56.749 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-18T23:40:56.748+0000 7f9759e72640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:56.761 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-18T23:40:56.760+0000 7f62692f5640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:56.795 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-18T23:40:56.794+0000 7f9dbc7aa640 -1 osd.3 0 waiting for initial osdmap 2023-11-18T23:40:56.811 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-18T23:40:56.810+0000 7f9db4de3640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:57.285 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-18T23:40:57.283+0000 7fbb191dd640 -1 osd.6 0 waiting for initial osdmap 2023-11-18T23:40:57.300 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-18T23:40:57.299+0000 7fbb0ffde640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:57.306 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-18T23:40:57.305+0000 7f3d1d6bc640 -1 osd.4 0 waiting for initial osdmap 2023-11-18T23:40:57.317 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-18T23:40:57.316+0000 7f3d15cf5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:57.318 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-18T23:40:57.317+0000 7ffb9ac3f640 -1 osd.5 0 waiting for initial osdmap 2023-11-18T23:40:57.329 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-18T23:40:57.328+0000 7ffb93278640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:57.330 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-18T23:40:57.329+0000 7f2ef5add640 -1 osd.7 0 waiting for initial osdmap 2023-11-18T23:40:57.343 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-18T23:40:57.342+0000 7f2eee116640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T23:40:57.400 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T23:40:57.495 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.494+0000 7fd374839640 1 Processor -- start 2023-11-18T23:40:57.496 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.494+0000 7fd374839640 1 -- start start 2023-11-18T23:40:57.497 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd374839640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd370142cc0 0x7fd3700cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:57.497 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd374839640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd3700b1120 0x7fd370070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:57.497 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd374839640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd370070350 con 0x7fd370143240 2023-11-18T23:40:57.497 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd374839640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3701430a0 con 0x7fd370142cc0 2023-11-18T23:40:57.497 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd374839640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd370070630 con 0x7fd3700b1120 2023-11-18T23:40:57.497 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd36e59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd370142cc0 0x7fd3700cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd36dd9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd370143240 0x7fd3700b0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33646/0 (socket says 172.21.15.8:33646) 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.495+0000 7fd36dd9b640 1 -- 172.21.15.8:0/274163367 learned_addr learned my addr 172.21.15.8:0/274163367 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36ed9d640 1 --2- 172.21.15.8:0/274163367 >> v2:172.21.15.116:3300/0 conn(0x7fd3700b1120 0x7fd370070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36e59c640 1 -- 172.21.15.8:0/274163367 >> v2:172.21.15.116:3300/0 conn(0x7fd3700b1120 msgr2=0x7fd370070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36e59c640 1 --2- 172.21.15.8:0/274163367 >> v2:172.21.15.116:3300/0 conn(0x7fd3700b1120 0x7fd370070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36e59c640 1 -- 172.21.15.8:0/274163367 >> v1:172.21.15.8:6789/0 conn(0x7fd370143240 legacy=0x7fd3700b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36e59c640 1 -- 172.21.15.8:0/274163367 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700cd400 con 0x7fd370142cc0 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36d59a640 1 -- 172.21.15.8:0/274163367 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897472800 0 0) 0x7fd370070350 con 0x7fd370143240 2023-11-18T23:40:57.498 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36ed9d640 1 --2- 172.21.15.8:0/274163367 >> v2:172.21.15.116:3300/0 conn(0x7fd3700b1120 0x7fd370070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.496+0000 7fd36e59c640 1 --2- 172.21.15.8:0/274163367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700cddc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd3700705a0 tx=0x7fd36802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc4df90c55344d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd36d59a640 1 -- 172.21.15.8:0/274163367 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36802e070 con 0x7fd370142cc0 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd36d59a640 1 -- 172.21.15.8:0/274163367 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680315a0 con 0x7fd370142cc0 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd36d59a640 1 -- 172.21.15.8:0/274163367 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368031930 con 0x7fd370142cc0 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 -- 172.21.15.8:0/274163367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 msgr2=0x7fd3700cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 --2- 172.21.15.8:0/274163367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700cddc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd3700705a0 tx=0x7fd36802b840 comp rx=0 tx=0).stop 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 -- 172.21.15.8:0/274163367 shutdown_connections 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 --2- 172.21.15.8:0/274163367 >> v2:172.21.15.116:3300/0 conn(0x7fd3700b1120 0x7fd370070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 --2- 172.21.15.8:0/274163367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700cddc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.500 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 -- 172.21.15.8:0/274163367 >> 172.21.15.8:0/274163367 conn(0x7fd37006c500 msgr2=0x7fd37006c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:57.501 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 -- 172.21.15.8:0/274163367 shutdown_connections 2023-11-18T23:40:57.501 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.497+0000 7fd374839640 1 -- 172.21.15.8:0/274163367 wait complete. 2023-11-18T23:40:57.501 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 Processor -- start 2023-11-18T23:40:57.501 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 -- start start 2023-11-18T23:40:57.503 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3700b1120 0x7fd370158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:57.503 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:57.503 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd370143240 0x7fd3700cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:57.503 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370136180 con 0x7fd370142cc0 2023-11-18T23:40:57.503 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370135570 con 0x7fd370143240 2023-11-18T23:40:57.503 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd374839640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd370135850 con 0x7fd3700b1120 2023-11-18T23:40:57.503 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd36dd9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd36dd9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33050/0 (socket says 172.21.15.8:33050) 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.499+0000 7fd36dd9b640 1 -- 172.21.15.8:0/1455211439 learned_addr learned my addr 172.21.15.8:0/1455211439 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36ed9d640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd370143240 0x7fd3700cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36e59c640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3700b1120 0x7fd370158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36dd9b640 1 -- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3700b1120 msgr2=0x7fd370158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36dd9b640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3700b1120 0x7fd370158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36dd9b640 1 -- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd370143240 msgr2=0x7fd3700cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36dd9b640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd370143240 0x7fd3700cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36dd9b640 1 -- 172.21.15.8:0/1455211439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368009400 con 0x7fd370142cc0 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd36dd9b640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700ced10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c430 tx=0x7fd35800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:57.504 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd366ffd640 1 -- 172.21.15.8:0/1455211439 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580074e0 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd366ffd640 1 -- 172.21.15.8:0/1455211439 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358007660 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd370135b30 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd366ffd640 1 -- 172.21.15.8:0/1455211439 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358004a20 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.500+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd370159410 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.501+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd370067420 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.501+0000 7fd366ffd640 1 -- 172.21.15.8:0/1455211439 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd358004b80 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.502+0000 7fd366ffd640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd35006adb0 0x7fd35006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.502+0000 7fd366ffd640 1 -- 172.21.15.8:0/1455211439 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fd3580884c0 con 0x7fd370142cc0 2023-11-18T23:40:57.505 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.502+0000 7fd36e59c640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd35006adb0 0x7fd35006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:40:57.506 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.502+0000 7fd36e59c640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd35006adb0 0x7fd35006d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd368036000 tx=0x7fd36803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:40:57.507 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.507+0000 7fd366ffd640 1 -- 172.21.15.8:0/1455211439 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd358054470 con 0x7fd370142cc0 2023-11-18T23:40:57.685 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.684+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd37006e670 con 0x7fd370142cc0 2023-11-18T23:40:57.685 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.684+0000 7fd366ffd640 1 -- 172.21.15.8:0/1455211439 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd358057a90 con 0x7fd370142cc0 2023-11-18T23:40:57.686 INFO:teuthology.misc.health.smithi008.stdout: 2023-11-18T23:40:57.686 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":12,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:40:55.246152+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:40:57.688 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd35006adb0 msgr2=0x7fd35006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:57.688 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd35006adb0 0x7fd35006d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd368036000 tx=0x7fd36803d040 comp rx=0 tx=0).stop 2023-11-18T23:40:57.688 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 msgr2=0x7fd3700ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:40:57.688 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700ced10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c430 tx=0x7fd35800c8f0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.688 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 shutdown_connections 2023-11-18T23:40:57.688 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd35006adb0 0x7fd35006d270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.689 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd370143240 0x7fd3700cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.689 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd370142cc0 0x7fd3700ced10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.689 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.686+0000 7fd374839640 1 --2- 172.21.15.8:0/1455211439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3700b1120 0x7fd370158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:40:57.689 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.687+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 >> 172.21.15.8:0/1455211439 conn(0x7fd37006c500 msgr2=0x7fd3700b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:40:57.689 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.687+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 shutdown_connections 2023-11-18T23:40:57.689 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:40:57.687+0000 7fd374839640 1 -- 172.21.15.8:0/1455211439 wait complete. 2023-11-18T23:40:57.697 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-18T23:41:04.504 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:04.607 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.606+0000 7f06dfb08640 1 Processor -- start 2023-11-18T23:41:04.607 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.606+0000 7f06dfb08640 1 -- start start 2023-11-18T23:41:04.610 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dfb08640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06d80cfbd0 0x7f06d80cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.610 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dfb08640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f06d80ced00 0x7f06d80b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.610 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dfb08640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80b6010 con 0x7f06d80ce870 2023-11-18T23:41:04.610 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dfb08640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d80b6b90 con 0x7f06d80cfbd0 2023-11-18T23:41:04.610 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dfb08640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d80d04f0 con 0x7f06d80ced00 2023-11-18T23:41:04.610 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dd8a4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06d80cfbd0 0x7f06d80cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dd8a4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06d80cfbd0 0x7f06d80cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37186/0 (socket says 172.21.15.8:37186) 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dd8a4640 1 -- 172.21.15.8:0/612520459 learned_addr learned my addr 172.21.15.8:0/612520459 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06de0a5640 1 --2- 172.21.15.8:0/612520459 >> v2:172.21.15.116:3300/0 conn(0x7f06d80ced00 0x7f06d80b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dd8a4640 1 -- 172.21.15.8:0/612520459 >> v2:172.21.15.116:3300/0 conn(0x7f06d80ced00 msgr2=0x7f06d80b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dd8a4640 1 --2- 172.21.15.8:0/612520459 >> v2:172.21.15.116:3300/0 conn(0x7f06d80ced00 0x7f06d80b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dd8a4640 1 -- 172.21.15.8:0/612520459 >> v1:172.21.15.116:6789/0 conn(0x7f06d80ce870 legacy=0x7f06d80b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.607+0000 7f06dd8a4640 1 -- 172.21.15.8:0/612520459 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80b6260 con 0x7f06d80cfbd0 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.608+0000 7f06dd8a4640 1 --2- 172.21.15.8:0/612520459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d80cffb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06d808d530 tx=0x7f06d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4619ffa51156a333 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.608+0000 7f06dc8a2640 1 -- 172.21.15.8:0/612520459 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4031870 con 0x7f06d80cfbd0 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.608+0000 7f06dc8a2640 1 -- 172.21.15.8:0/612520459 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40319d0 con 0x7f06d80cfbd0 2023-11-18T23:41:04.611 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.608+0000 7f06dc8a2640 1 -- 172.21.15.8:0/612520459 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4031d60 con 0x7f06d80cfbd0 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 -- 172.21.15.8:0/612520459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 msgr2=0x7f06d80cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 --2- 172.21.15.8:0/612520459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d80cffb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06d808d530 tx=0x7f06d402b910 comp rx=0 tx=0).stop 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 -- 172.21.15.8:0/612520459 shutdown_connections 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 --2- 172.21.15.8:0/612520459 >> v2:172.21.15.116:3300/0 conn(0x7f06d80ced00 0x7f06d80b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 --2- 172.21.15.8:0/612520459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d80cffb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 -- 172.21.15.8:0/612520459 >> 172.21.15.8:0/612520459 conn(0x7f06d809c490 msgr2=0x7f06d80d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 -- 172.21.15.8:0/612520459 shutdown_connections 2023-11-18T23:41:04.612 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.609+0000 7f06dfb08640 1 -- 172.21.15.8:0/612520459 wait complete. 2023-11-18T23:41:04.614 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.610+0000 7f06dfb08640 1 Processor -- start 2023-11-18T23:41:04.614 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.610+0000 7f06dfb08640 1 -- start start 2023-11-18T23:41:04.614 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dfb08640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d80ce870 0x7f06d806beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.614 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dfb08640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d80ced00 0x7f06d814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dfb08640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d8150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dfb08640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8156970 con 0x7f06d80cfbd0 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dfb08640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d81507c0 con 0x7f06d80ced00 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dfb08640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d809cf00 con 0x7f06d80ce870 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d8150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37198/0 (socket says 172.21.15.8:37198) 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 -- 172.21.15.8:0/2017398233 learned_addr learned my addr 172.21.15.8:0/2017398233 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dd8a4640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d80ce870 0x7f06d806beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dd0a3640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d80ced00 0x7f06d814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 -- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d80ce870 msgr2=0x7f06d806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d80ce870 0x7f06d806beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.615 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 -- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d80ced00 msgr2=0x7f06d814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d80ced00 0x7f06d814fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 -- 172.21.15.8:0/2017398233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40094d0 con 0x7f06d80cfbd0 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dd8a4640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d80ce870 0x7f06d806beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06dd0a3640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d80ced00 0x7f06d814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.611+0000 7f06de0a5640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d8150280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06d0007e40 tx=0x7f06d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.612+0000 7f06ce7fc640 1 -- 172.21.15.8:0/2017398233 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0014620 con 0x7f06d80cfbd0 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.612+0000 7f06ce7fc640 1 -- 172.21.15.8:0/2017398233 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000ee90 con 0x7f06d80cfbd0 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.612+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d81f7330 con 0x7f06d80cfbd0 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.612+0000 7f06ce7fc640 1 -- 172.21.15.8:0/2017398233 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00149e0 con 0x7f06d80cfbd0 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.612+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d809d480 con 0x7f06d80cfbd0 2023-11-18T23:41:04.616 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.613+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d8067420 con 0x7f06d80cfbd0 2023-11-18T23:41:04.617 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.613+0000 7f06ce7fc640 1 -- 172.21.15.8:0/2017398233 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06d0014b40 con 0x7f06d80cfbd0 2023-11-18T23:41:04.617 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.614+0000 7f06ce7fc640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06bc06ae40 0x7f06bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.617 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.614+0000 7f06ce7fc640 1 -- 172.21.15.8:0/2017398233 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06d0089c80 con 0x7f06d80cfbd0 2023-11-18T23:41:04.617 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.614+0000 7f06dd8a4640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06bc06ae40 0x7f06bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.618 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.614+0000 7f06dd8a4640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06bc06ae40 0x7f06bc06d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06d4036000 tx=0x7f06d403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:04.620 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.619+0000 7f06ce7fc640 1 -- 172.21.15.8:0/2017398233 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06d0055070 con 0x7f06d80cfbd0 2023-11-18T23:41:04.799 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.798+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06d80cf9b0 con 0x7f06d80cfbd0 2023-11-18T23:41:04.800 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.799+0000 7f06ce7fc640 1 -- 172.21.15.8:0/2017398233 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12778 (secure 0 0 0) 0x7f06d0058690 con 0x7f06d80cfbd0 2023-11-18T23:41:04.800 INFO:teuthology.misc.health.smithi008.stdout: 2023-11-18T23:41:04.801 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":16,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:01.327983+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:04.802 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06bc06ae40 msgr2=0x7f06bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.802 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06bc06ae40 0x7f06bc06d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06d4036000 tx=0x7f06d403c040 comp rx=0 tx=0).stop 2023-11-18T23:41:04.802 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 msgr2=0x7f06d8150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.802 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d8150280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06d0007e40 tx=0x7f06d000e4b0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 shutdown_connections 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06bc06ae40 0x7f06bc06d300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06d80cfbd0 0x7f06d8150280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d80ced00 0x7f06d814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 --2- 172.21.15.8:0/2017398233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d80ce870 0x7f06d806beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 >> 172.21.15.8:0/2017398233 conn(0x7f06d809c490 msgr2=0x7f06d80c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 shutdown_connections 2023-11-18T23:41:04.803 INFO:teuthology.misc.health.smithi008.stderr:2023-11-18T23:41:04.801+0000 7f06dfb08640 1 -- 172.21.15.8:0/2017398233 wait complete. 2023-11-18T23:41:04.811 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-18T23:41:04.812 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-18T23:41:04.812 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T23:41:04.812 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-18T23:41:04.814 INFO:tasks.ceph.mds.a:Started 2023-11-18T23:41:04.814 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T23:41:04.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-18T23:41:04.817 INFO:tasks.ceph.mds.c:Started 2023-11-18T23:41:04.817 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T23:41:04.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-18T23:41:04.820 INFO:tasks.ceph.mds.b:Started 2023-11-18T23:41:04.820 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T23:41:04.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-18T23:41:04.822 INFO:tasks.ceph.mds.d:Started 2023-11-18T23:41:04.822 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-18T23:41:04.822 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:04.895 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-11-18T23:41:04.896 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-11-18T23:41:04.904 INFO:tasks.ceph.mds.b.smithi116.stdout:starting mds.b at 2023-11-18T23:41:04.904 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2023-11-18T23:41:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.931+0000 7f000c244640 1 Processor -- start 2023-11-18T23:41:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.932+0000 7f000c244640 1 -- start start 2023-11-18T23:41:04.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.932+0000 7f000c244640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f000415d3e0 0x7f00040ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.932+0000 7f000c244640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00040d1e30 0x7f00040b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.932+0000 7f000c244640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040b5f90 con 0x7f00040ced30 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.932+0000 7f000c244640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040cf170 con 0x7f00040d1e30 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.932+0000 7f000c244640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040b61e0 con 0x7f000415d3e0 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f000a7e1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00040d1e30 0x7f00040b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f000a7e1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00040d1e30 0x7f00040b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37240/0 (socket says 172.21.15.8:37240) 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f000a7e1640 1 -- 172.21.15.8:0/1196699413 learned_addr learned my addr 172.21.15.8:0/1196699413 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f00097df640 1 --1- 172.21.15.8:0/1196699413 >> v1:172.21.15.116:6789/0 conn(0x7f00040ced30 0x7f00040d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:37614/0 (socket says 172.21.15.8:37614) 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f0009fe0640 1 --2- 172.21.15.8:0/1196699413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f000415d3e0 0x7f00040ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f0008fde640 1 -- 172.21.15.8:0/1196699413 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409218571 0 0) 0x7f00040b5f90 con 0x7f00040ced30 2023-11-18T23:41:04.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f0008fde640 1 -- 172.21.15.8:0/1196699413 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003520 con 0x7f00040ced30 2023-11-18T23:41:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f000a7e1640 1 -- 172.21.15.8:0/1196699413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f000415d3e0 msgr2=0x7f00040ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f000a7e1640 1 --2- 172.21.15.8:0/1196699413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f000415d3e0 0x7f00040ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f000a7e1640 1 -- 172.21.15.8:0/1196699413 >> v1:172.21.15.116:6789/0 conn(0x7f00040ced30 legacy=0x7f00040d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.933+0000 7f000a7e1640 1 -- 172.21.15.8:0/1196699413 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040b64c0 con 0x7f00040d1e30 2023-11-18T23:41:04.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.934+0000 7f000a7e1640 1 --2- 172.21.15.8:0/1196699413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00040d1e30 0x7f00040b3db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efffc009e80 tx=0x7efffc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ac49facdabed29 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:04.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.934+0000 7f0008fde640 1 -- 172.21.15.8:0/1196699413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc02caf0 con 0x7f00040d1e30 2023-11-18T23:41:04.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.934+0000 7f0008fde640 1 -- 172.21.15.8:0/1196699413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc02cc50 con 0x7f00040d1e30 2023-11-18T23:41:04.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.934+0000 7f0008fde640 1 -- 172.21.15.8:0/1196699413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc0343f0 con 0x7f00040d1e30 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.934+0000 7f000c244640 1 -- 172.21.15.8:0/1196699413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00040d1e30 msgr2=0x7f00040b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.934+0000 7f000c244640 1 --2- 172.21.15.8:0/1196699413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00040d1e30 0x7f00040b3db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efffc009e80 tx=0x7efffc02bf50 comp rx=0 tx=0).stop 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.935+0000 7f000c244640 1 -- 172.21.15.8:0/1196699413 shutdown_connections 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.935+0000 7f000c244640 1 --2- 172.21.15.8:0/1196699413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00040d1e30 0x7f00040b3db0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.935+0000 7f000c244640 1 --2- 172.21.15.8:0/1196699413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f000415d3e0 0x7f00040ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.935+0000 7f000c244640 1 -- 172.21.15.8:0/1196699413 >> 172.21.15.8:0/1196699413 conn(0x7f000409c480 msgr2=0x7f00040d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.935+0000 7f000c244640 1 -- 172.21.15.8:0/1196699413 shutdown_connections 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.935+0000 7f000c244640 1 -- 172.21.15.8:0/1196699413 wait complete. 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.936+0000 7f000c244640 1 Processor -- start 2023-11-18T23:41:04.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.936+0000 7f000c244640 1 -- start start 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000c244640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00040ced30 0x7f00040ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000c244640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00040d1e30 0x7f000414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000c244640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f000415d3e0 0x7f000414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000c244640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040a0ef0 con 0x7f000415d3e0 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000c244640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040cbd70 con 0x7f00040ced30 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000c244640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040a0c10 con 0x7f00040d1e30 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f000415d3e0 0x7f000414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f000415d3e0 0x7f000414ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37254/0 (socket says 172.21.15.8:37254) 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 -- 172.21.15.8:0/1756712976 learned_addr learned my addr 172.21.15.8:0/1756712976 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f0009fe0640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00040ced30 0x7f00040ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f00097df640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00040d1e30 0x7f000414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 -- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00040d1e30 msgr2=0x7f000414c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00040d1e30 0x7f000414c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 -- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00040ced30 msgr2=0x7f00040ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00040ced30 0x7f00040ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 -- 172.21.15.8:0/1756712976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc009b30 con 0x7f000415d3e0 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000a7e1640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f000415d3e0 0x7f000414ca00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efffc036040 tx=0x7efffc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7efffa7fc640 1 -- 172.21.15.8:0/1756712976 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc009510 con 0x7f000415d3e0 2023-11-18T23:41:04.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7efffa7fc640 1 -- 172.21.15.8:0/1756712976 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc03e450 con 0x7f000415d3e0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7efffa7fc640 1 -- 172.21.15.8:0/1756712976 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc03e7e0 con 0x7f000415d3e0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.937+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040cc020 con 0x7f000415d3e0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.938+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040cc5e0 con 0x7f000415d3e0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.938+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0004067420 con 0x7f000415d3e0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.939+0000 7efffa7fc640 1 -- 172.21.15.8:0/1756712976 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efffc03e940 con 0x7f000415d3e0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.939+0000 7efffa7fc640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7effe806ae40 0x7effe806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.939+0000 7efffa7fc640 1 -- 172.21.15.8:0/1756712976 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efffc0abee0 con 0x7f000415d3e0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.939+0000 7f0009fe0640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7effe806ae40 0x7effe806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:04.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.940+0000 7f0009fe0640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7effe806ae40 0x7effe806d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f000409d580 tx=0x7f0000008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:04.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:04.944+0000 7efffa7fc640 1 -- 172.21.15.8:0/1756712976 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efffc0772e0 con 0x7f000415d3e0 2023-11-18T23:41:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.121+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00040b5920 con 0x7f000415d3e0 2023-11-18T23:41:05.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.122+0000 7efffa7fc640 1 -- 172.21.15.8:0/1756712976 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12778 (secure 0 0 0) 0x7efffc07a900 con 0x7f000415d3e0 2023-11-18T23:41:05.123 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:05.123 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:01.327983+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7effe806ae40 msgr2=0x7effe806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7effe806ae40 0x7effe806d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f000409d580 tx=0x7f0000008040 comp rx=0 tx=0).stop 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f000415d3e0 msgr2=0x7f000414ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f000415d3e0 0x7f000414ca00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efffc036040 tx=0x7efffc004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 shutdown_connections 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7effe806ae40 0x7effe806d300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f000415d3e0 0x7f000414ca00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00040d1e30 0x7f000414c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 --2- 172.21.15.8:0/1756712976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00040ced30 0x7f00040ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 >> 172.21.15.8:0/1756712976 conn(0x7f000409c480 msgr2=0x7f000415ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 shutdown_connections 2023-11-18T23:41:05.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.124+0000 7f000c244640 1 -- 172.21.15.8:0/1756712976 wait complete. 2023-11-18T23:41:05.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:05.136 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:05.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.243+0000 7f0f0bbdc640 1 Processor -- start 2023-11-18T23:41:05.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.244+0000 7f0f0bbdc640 1 -- start start 2023-11-18T23:41:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.244+0000 7f0f0bbdc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0f04160ad0 0x7f0f040b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.244+0000 7f0f0bbdc640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f040d16a0 con 0x7f0f040b2110 2023-11-18T23:41:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.244+0000 7f0f0bbdc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f040d1980 con 0x7f0f040d0240 2023-11-18T23:41:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.244+0000 7f0f0bbdc640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040d1c60 con 0x7f0f04160ad0 2023-11-18T23:41:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f09978640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0f04160ad0 0x7f0f040b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f09978640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0f04160ad0 0x7f0f040b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37266/0 (socket says 172.21.15.8:37266) 2023-11-18T23:41:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f09177640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0f040b2110 0x7f0f040cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43466/0 (socket says 172.21.15.8:43466) 2023-11-18T23:41:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f09978640 1 -- 172.21.15.8:0/1053439196 learned_addr learned my addr 172.21.15.8:0/1053439196 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f09978640 1 -- 172.21.15.8:0/1053439196 >> v1:172.21.15.116:6789/0 conn(0x7f0f040d0240 legacy=0x7f0f040ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f09978640 1 -- 172.21.15.8:0/1053439196 >> v1:172.21.15.8:6789/0 conn(0x7f0f040b2110 legacy=0x7f0f040cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f08976640 1 -- 172.21.15.8:0/1053439196 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073809080 0 0) 0x7f0f040d1980 con 0x7f0f040d0240 2023-11-18T23:41:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.245+0000 7f0f09978640 1 -- 172.21.15.8:0/1053439196 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040d1f40 con 0x7f0f04160ad0 2023-11-18T23:41:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f09978640 1 --2- 172.21.15.8:0/1053439196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f040b4420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009870 tx=0x7f0f0002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41edd1d4411f6d81 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f08976640 1 -- 172.21.15.8:0/1053439196 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f000316d0 con 0x7f0f04160ad0 2023-11-18T23:41:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f08976640 1 -- 172.21.15.8:0/1053439196 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f00031830 con 0x7f0f04160ad0 2023-11-18T23:41:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f08976640 1 -- 172.21.15.8:0/1053439196 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00031bc0 con 0x7f0f04160ad0 2023-11-18T23:41:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/1053439196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 msgr2=0x7f0f040b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/1053439196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f040b4420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009870 tx=0x7f0f0002b7f0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/1053439196 shutdown_connections 2023-11-18T23:41:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/1053439196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f040b4420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/1053439196 >> 172.21.15.8:0/1053439196 conn(0x7f0f0409c500 msgr2=0x7f0f040d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/1053439196 shutdown_connections 2023-11-18T23:41:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.246+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/1053439196 wait complete. 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 Processor -- start 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 -- start start 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0f040b2110 0x7f0f04156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f040d0240 0x7f0f040cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f0415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040c7990 con 0x7f0f04160ad0 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04157250 con 0x7f0f040d0240 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0bbdc640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040c6d80 con 0x7f0f040b2110 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0a179640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f0415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0a179640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f0415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37270/0 (socket says 172.21.15.8:37270) 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.248+0000 7f0f0a179640 1 -- 172.21.15.8:0/3902449177 learned_addr learned my addr 172.21.15.8:0/3902449177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f09177640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f040d0240 0x7f0f040cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0a179640 1 -- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0f040b2110 msgr2=0x7f0f04156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0a179640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0f040b2110 0x7f0f04156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0a179640 1 -- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f040d0240 msgr2=0x7f0f040cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0a179640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f040d0240 0x7f0f040cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0a179640 1 -- 172.21.15.8:0/3902449177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f000094d0 con 0x7f0f04160ad0 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0a179640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f0415f440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0efc002230 tx=0x7f0efc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0efa7fc640 1 -- 172.21.15.8:0/3902449177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc003da0 con 0x7f0f04160ad0 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0efa7fc640 1 -- 172.21.15.8:0/3902449177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00ce30 con 0x7f0f04160ad0 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f040c7060 con 0x7f0f04160ad0 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0efa7fc640 1 -- 172.21.15.8:0/3902449177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0052b0 con 0x7f0f04160ad0 2023-11-18T23:41:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.249+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f040c7620 con 0x7f0f04160ad0 2023-11-18T23:41:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.250+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f040a11e0 con 0x7f0f04160ad0 2023-11-18T23:41:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.250+0000 7f0efa7fc640 1 -- 172.21.15.8:0/3902449177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0efc005410 con 0x7f0f04160ad0 2023-11-18T23:41:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.251+0000 7f0efa7fc640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0ee806ae40 0x7f0ee806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.251+0000 7f0efa7fc640 1 -- 172.21.15.8:0/3902449177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0efc088b10 con 0x7f0f04160ad0 2023-11-18T23:41:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.251+0000 7f0f09978640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0ee806ae40 0x7f0ee806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.251+0000 7f0f09978640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0ee806ae40 0x7f0ee806d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0f00036000 tx=0x7f0f00030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.255+0000 7f0efa7fc640 1 -- 172.21.15.8:0/3902449177 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0efc053f10 con 0x7f0f04160ad0 2023-11-18T23:41:05.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.433+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f040c7ad0 con 0x7f0f04160ad0 2023-11-18T23:41:05.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.433+0000 7f0efa7fc640 1 -- 172.21.15.8:0/3902449177 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0efc017070 con 0x7f0f04160ad0 2023-11-18T23:41:05.435 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0ee806ae40 msgr2=0x7f0ee806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0ee806ae40 0x7f0ee806d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0f00036000 tx=0x7f0f00030000 comp rx=0 tx=0).stop 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 msgr2=0x7f0f0415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f0415f440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0efc002230 tx=0x7f0efc00cbe0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 shutdown_connections 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0ee806ae40 0x7f0ee806d300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f04160ad0 0x7f0f0415f440 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f040d0240 0x7f0f040cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 --2- 172.21.15.8:0/3902449177 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0f040b2110 0x7f0f04156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 >> 172.21.15.8:0/3902449177 conn(0x7f0f0409c500 msgr2=0x7f0f0406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:05.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 shutdown_connections 2023-11-18T23:41:05.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.435+0000 7f0f0bbdc640 1 -- 172.21.15.8:0/3902449177 wait complete. 2023-11-18T23:41:05.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:05.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.552+0000 7fea4947c640 1 Processor -- start 2023-11-18T23:41:05.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.552+0000 7fea4947c640 1 -- start start 2023-11-18T23:41:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.553+0000 7fea4947c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fea4406bff0 0x7fea4406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.553+0000 7fea4947c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea44161c50 con 0x7fea44161100 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.553+0000 7fea4947c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea44161eb0 con 0x7fea440b0ee0 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.553+0000 7fea4947c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4406c910 con 0x7fea4406bff0 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.553+0000 7fea3bfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fea44161100 0x7fea44161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43480/0 (socket says 172.21.15.8:43480) 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.553+0000 7fea3bfff640 1 -- 172.21.15.8:0/144878635 learned_addr learned my addr 172.21.15.8:0/144878635 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea42ffd640 1 --2- 172.21.15.8:0/144878635 >> v2:172.21.15.116:3300/0 conn(0x7fea4406bff0 0x7fea4406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720354720 0 0) 0x7fea44161c50 con 0x7fea44161100 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea30003520 con 0x7fea44161100 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916542580 0 0) 0x7fea30003520 con 0x7fea44161100 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 >> v2:172.21.15.116:3300/0 conn(0x7fea4406bff0 msgr2=0x7fea4406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 --2- 172.21.15.8:0/144878635 >> v2:172.21.15.116:3300/0 conn(0x7fea4406bff0 0x7fea4406c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 >> v1:172.21.15.116:6789/0 conn(0x7fea440b0ee0 legacy=0x7fea440b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440cd8f0 con 0x7fea44161100 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fea2c001670 con 0x7fea44161100 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 >> v1:172.21.15.8:6789/0 conn(0x7fea44161100 legacy=0x7fea44161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea30003970 0x7fea30003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea30004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea30005040 0x7fea3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4406c910 con 0x7fea30004370 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3000bfa0 con 0x7fea30005040 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3000c160 con 0x7fea30003970 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea3bfff640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea30004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea437fe640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea30005040 0x7fea3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea42ffd640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea30003970 0x7fea30003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea3bfff640 1 -- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea30003970 msgr2=0x7fea30003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:05.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea3bfff640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea30003970 0x7fea30003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea3bfff640 1 -- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea30005040 msgr2=0x7fea3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea3bfff640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea30005040 0x7fea3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea3bfff640 1 -- 172.21.15.8:0/144878635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30003520 con 0x7fea30004370 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea437fe640 1 -- 172.21.15.8:0/144878635 reap_dead start 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.554+0000 7fea42ffd640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea30003970 0x7fea30003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.555+0000 7fea3bfff640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea30004840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea440cea40 tx=0x7fea300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c6e1da7313e3d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.555+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c005ad0 con 0x7fea30004370 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.555+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c005c50 con 0x7fea30004370 2023-11-18T23:41:05.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.555+0000 7fea427fc640 1 -- 172.21.15.8:0/144878635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c02c890 con 0x7fea30004370 2023-11-18T23:41:05.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.556+0000 7fea4947c640 1 -- 172.21.15.8:0/144878635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 msgr2=0x7fea30004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.556+0000 7fea4947c640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea30004840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea440cea40 tx=0x7fea300057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.556+0000 7fea4947c640 1 -- 172.21.15.8:0/144878635 shutdown_connections 2023-11-18T23:41:05.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.556+0000 7fea4947c640 1 --2- 172.21.15.8:0/144878635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea30004840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.556+0000 7fea4947c640 1 -- 172.21.15.8:0/144878635 >> 172.21.15.8:0/144878635 conn(0x7fea440d0f60 msgr2=0x7fea440d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.556+0000 7fea4947c640 1 -- 172.21.15.8:0/144878635 shutdown_connections 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.556+0000 7fea4947c640 1 -- 172.21.15.8:0/144878635 wait complete. 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.557+0000 7fea4947c640 1 Processor -- start 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.557+0000 7fea4947c640 1 -- start start 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea4947c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea440b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea4947c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea440b66e0 0x7fea4414bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea4947c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea44160070 0x7fea440cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea4947c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440b6250 con 0x7fea30004370 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea4947c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4414c170 con 0x7fea440b66e0 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea4947c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea440b5990 con 0x7fea44160070 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea440b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea440b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37288/0 (socket says 172.21.15.8:37288) 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 -- 172.21.15.8:0/4032767536 learned_addr learned my addr 172.21.15.8:0/4032767536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:05.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea3bfff640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea440b66e0 0x7fea4414bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea437fe640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea44160070 0x7fea440cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 -- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea44160070 msgr2=0x7fea440cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea44160070 0x7fea440cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 -- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea440b66e0 msgr2=0x7fea4414bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea440b66e0 0x7fea4414bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 -- 172.21.15.8:0/4032767536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440b6b60 con 0x7fea30004370 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.558+0000 7fea42ffd640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea440b3b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea340114e0 tx=0x7fea340119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.559+0000 7fea3b7fe640 1 -- 172.21.15.8:0/4032767536 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34015870 con 0x7fea30004370 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.559+0000 7fea3b7fe640 1 -- 172.21.15.8:0/4032767536 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea340159d0 con 0x7fea30004370 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.559+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea440b5c00 con 0x7fea30004370 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.559+0000 7fea3b7fe640 1 -- 172.21.15.8:0/4032767536 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34015d80 con 0x7fea30004370 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.559+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea441604f0 con 0x7fea30004370 2023-11-18T23:41:05.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.560+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea44068470 con 0x7fea30004370 2023-11-18T23:41:05.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.560+0000 7fea3b7fe640 1 -- 172.21.15.8:0/4032767536 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea3401d400 con 0x7fea30004370 2023-11-18T23:41:05.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.560+0000 7fea3b7fe640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fea2406ae70 0x7fea2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:05.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.561+0000 7fea3b7fe640 1 -- 172.21.15.8:0/4032767536 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea34089890 con 0x7fea30004370 2023-11-18T23:41:05.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.561+0000 7fea3bfff640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fea2406ae70 0x7fea2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:05.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.561+0000 7fea3bfff640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fea2406ae70 0x7fea2406d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea2c034000 tx=0x7fea2c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:05.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.565+0000 7fea3b7fe640 1 -- 172.21.15.8:0/4032767536 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea34054d40 con 0x7fea30004370 2023-11-18T23:41:05.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.776+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea4406bdd0 con 0x7fea30004370 2023-11-18T23:41:05.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.776+0000 7fea3b7fe640 1 -- 172.21.15.8:0/4032767536 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fea34022090 con 0x7fea30004370 2023-11-18T23:41:05.778 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:05.778 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-18T23:41:05.778 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2023-11-18T23:41:05.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fea2406ae70 msgr2=0x7fea2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fea2406ae70 0x7fea2406d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea2c034000 tx=0x7fea2c009030 comp rx=0 tx=0).stop 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 msgr2=0x7fea440b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea440b3b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea340114e0 tx=0x7fea340119a0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 shutdown_connections 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fea2406ae70 0x7fea2406d330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea44160070 0x7fea440cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea440b66e0 0x7fea4414bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 --2- 172.21.15.8:0/4032767536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea30004370 0x7fea440b3b80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 >> 172.21.15.8:0/4032767536 conn(0x7fea440d0f60 msgr2=0x7fea4406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 shutdown_connections 2023-11-18T23:41:05.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:05.778+0000 7fea4947c640 1 -- 172.21.15.8:0/4032767536 wait complete. 2023-11-18T23:41:07.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:07.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.907+0000 7f51480bb640 1 Processor -- start 2023-11-18T23:41:07.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.908+0000 7f51480bb640 1 -- start start 2023-11-18T23:41:07.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.908+0000 7f51480bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 0x7f51400d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.908+0000 7f51480bb640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51400b5f90 con 0x7f514015d3e0 2023-11-18T23:41:07.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.908+0000 7f51480bb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51400d20a0 con 0x7f51400b3db0 2023-11-18T23:41:07.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.908+0000 7f51480bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51400b61e0 con 0x7f51400d1720 2023-11-18T23:41:07.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5145e57640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f514015d3e0 0x7f51400ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48668/0 (socket says 172.21.15.8:48668) 2023-11-18T23:41:07.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5145e57640 1 -- 172.21.15.8:0/6997897 learned_addr learned my addr 172.21.15.8:0/6997897 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:07.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619646541 0 0) 0x7f51400b5f90 con 0x7f514015d3e0 2023-11-18T23:41:07.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5145656640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 0x7f51400d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f512c003520 con 0x7f514015d3e0 2023-11-18T23:41:07.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4282649530 0 0) 0x7f512c003520 con 0x7f514015d3e0 2023-11-18T23:41:07.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 msgr2=0x7f51400d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:07.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 0x7f51400d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:07.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 >> v1:172.21.15.116:6789/0 conn(0x7f51400b3db0 legacy=0x7f51400b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:07.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400b64c0 con 0x7f514015d3e0 2023-11-18T23:41:07.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f513c001670 con 0x7f514015d3e0 2023-11-18T23:41:07.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 >> v1:172.21.15.8:6789/0 conn(0x7f514015d3e0 legacy=0x7f51400ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:07.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f512c0039a0 0x7f512c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 0x7f512c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f512c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51400b61e0 con 0x7f512c004d00 2023-11-18T23:41:07.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c00b980 con 0x7f512c0039a0 2023-11-18T23:41:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c00bb40 con 0x7f51400d1720 2023-11-18T23:41:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5146658640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f512c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5145e57640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f512c0039a0 0x7f512c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.909+0000 7f5145656640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 0x7f512c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.910+0000 7f5146658640 1 -- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 msgr2=0x7f512c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:07.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.910+0000 7f5146658640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51400d1720 0x7f512c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.910+0000 7f5146658640 1 -- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f512c0039a0 msgr2=0x7f512c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.910+0000 7f5146658640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f512c0039a0 0x7f512c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.910+0000 7f5146658640 1 -- 172.21.15.8:0/6997897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c003520 con 0x7f512c004d00 2023-11-18T23:41:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.910+0000 7f5146658640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f512c005180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5138001f60 tx=0x7f512c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff70ddf49872963 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:07.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513802d6f0 con 0x7f512c004d00 2023-11-18T23:41:07.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513802d870 con 0x7f512c004d00 2023-11-18T23:41:07.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f5144e55640 1 -- 172.21.15.8:0/6997897 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513802dc20 con 0x7f512c004d00 2023-11-18T23:41:07.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f51480bb640 1 -- 172.21.15.8:0/6997897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 msgr2=0x7f512c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:07.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f51480bb640 1 --2- 172.21.15.8:0/6997897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f512c005180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5138001f60 tx=0x7f512c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:07.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f5146658640 1 -- 172.21.15.8:0/6997897 reap_dead start 2023-11-18T23:41:07.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f51480bb640 1 -- 172.21.15.8:0/6997897 shutdown_connections 2023-11-18T23:41:07.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f51480bb640 1 -- 172.21.15.8:0/6997897 >> 172.21.15.8:0/6997897 conn(0x7f514009c480 msgr2=0x7f51400d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:07.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f51480bb640 1 -- 172.21.15.8:0/6997897 shutdown_connections 2023-11-18T23:41:07.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.911+0000 7f51480bb640 1 -- 172.21.15.8:0/6997897 wait complete. 2023-11-18T23:41:07.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 Processor -- start 2023-11-18T23:41:07.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 -- start start 2023-11-18T23:41:07.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f51401591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5140152210 0x7f51401568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5140154f50 0x7f5140155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51400cb8b0 con 0x7f512c004d00 2023-11-18T23:41:07.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5140155940 con 0x7f5140154f50 2023-11-18T23:41:07.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f51480bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51400cc150 con 0x7f5140152210 2023-11-18T23:41:07.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f5145e57640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f51401591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f5145e57640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f51401591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34578/0 (socket says 172.21.15.8:34578) 2023-11-18T23:41:07.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.913+0000 7f5145e57640 1 -- 172.21.15.8:0/1420172681 learned_addr learned my addr 172.21.15.8:0/1420172681 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:07.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5145656640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5140152210 0x7f51401568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5146658640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5140154f50 0x7f5140155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5145e57640 1 -- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5140152210 msgr2=0x7f51401568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5145e57640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5140152210 0x7f51401568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5145e57640 1 -- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5140154f50 msgr2=0x7f5140155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5145e57640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5140154f50 0x7f5140155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5145e57640 1 -- 172.21.15.8:0/1420172681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51401597a0 con 0x7f512c004d00 2023-11-18T23:41:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5146658640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5140154f50 0x7f5140155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f5145e57640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f51401591a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f513c0072f0 tx=0x7f513c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f51367fc640 1 -- 172.21.15.8:0/1420172681 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00f8e0 con 0x7f512c004d00 2023-11-18T23:41:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f51367fc640 1 -- 172.21.15.8:0/1420172681 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00fa40 con 0x7f512c004d00 2023-11-18T23:41:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51400cba90 con 0x7f512c004d00 2023-11-18T23:41:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f51367fc640 1 -- 172.21.15.8:0/1420172681 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00fdf0 con 0x7f512c004d00 2023-11-18T23:41:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.914+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5140152670 con 0x7f512c004d00 2023-11-18T23:41:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.915+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5140067420 con 0x7f512c004d00 2023-11-18T23:41:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.916+0000 7f51367fc640 1 -- 172.21.15.8:0/1420172681 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f513c01d360 con 0x7f512c004d00 2023-11-18T23:41:07.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.916+0000 7f51367fc640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f512406ae70 0x7f512406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.916+0000 7f51367fc640 1 -- 172.21.15.8:0/1420172681 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f513c088aa0 con 0x7f512c004d00 2023-11-18T23:41:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.916+0000 7f5145656640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f512406ae70 0x7f512406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:07.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.917+0000 7f5145656640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f512406ae70 0x7f512406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51400b8760 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:07.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:07.921+0000 7f51367fc640 1 -- 172.21.15.8:0/1420172681 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f513c053f30 con 0x7f512c004d00 2023-11-18T23:41:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.134+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51400d1500 con 0x7f512c004d00 2023-11-18T23:41:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.135+0000 7f51367fc640 1 -- 172.21.15.8:0/1420172681 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7f513c01a020 con 0x7f512c004d00 2023-11-18T23:41:08.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:08.137 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-18T23:41:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-11-18T23:41:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f512406ae70 msgr2=0x7f512406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f512406ae70 0x7f512406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51400b8760 tx=0x7f5130008040 comp rx=0 tx=0).stop 2023-11-18T23:41:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 msgr2=0x7f51401591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f51401591a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f513c0072f0 tx=0x7f513c0077b0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 shutdown_connections 2023-11-18T23:41:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f512406ae70 0x7f512406d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5140154f50 0x7f5140155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5140152210 0x7f51401568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 --2- 172.21.15.8:0/1420172681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f512c004d00 0x7f51401591a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 >> 172.21.15.8:0/1420172681 conn(0x7f514009c480 msgr2=0x7f51400b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 shutdown_connections 2023-11-18T23:41:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.137+0000 7f51480bb640 1 -- 172.21.15.8:0/1420172681 wait complete. 2023-11-18T23:41:08.148 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:08.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.253+0000 7fb649583640 1 Processor -- start 2023-11-18T23:41:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.253+0000 7fb649583640 1 -- start start 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb649583640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440d1450 0x7fb6440d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb649583640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440cdd30 con 0x7fb644160ab0 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb649583640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440ce2d0 con 0x7fb6440b2450 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb649583640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440d1e00 con 0x7fb6440d1450 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb642ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb644160ab0 0x7fb6440afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48678/0 (socket says 172.21.15.8:48678) 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb642ffd640 1 -- 172.21.15.8:0/828263392 learned_addr learned my addr 172.21.15.8:0/828263392 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb6437fe640 1 --2- 172.21.15.8:0/828263392 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440d1450 0x7fb6440d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb641ffb640 1 -- 172.21.15.8:0/828263392 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367313086 0 0) 0x7fb6440cdd30 con 0x7fb644160ab0 2023-11-18T23:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb641ffb640 1 -- 172.21.15.8:0/828263392 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb630003520 con 0x7fb644160ab0 2023-11-18T23:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb641ffb640 1 -- 172.21.15.8:0/828263392 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286468414 0 0) 0x7fb6440ce2d0 con 0x7fb6440b2450 2023-11-18T23:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb641ffb640 1 -- 172.21.15.8:0/828263392 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6440cdd30 con 0x7fb6440b2450 2023-11-18T23:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb6437fe640 1 -- 172.21.15.8:0/828263392 >> v1:172.21.15.116:6789/0 conn(0x7fb6440b2450 legacy=0x7fb6440cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb6437fe640 1 -- 172.21.15.8:0/828263392 >> v1:172.21.15.8:6789/0 conn(0x7fb644160ab0 legacy=0x7fb6440afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.254+0000 7fb6437fe640 1 -- 172.21.15.8:0/828263392 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440d0a90 con 0x7fb6440d1450 2023-11-18T23:41:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.255+0000 7fb6437fe640 1 --2- 172.21.15.8:0/828263392 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440d1450 0x7fb6440d18c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb634009dc0 tx=0x7fb63402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e2cb6861a59dcf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.255+0000 7fb641ffb640 1 -- 172.21.15.8:0/828263392 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63402cc40 con 0x7fb6440d1450 2023-11-18T23:41:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb641ffb640 1 -- 172.21.15.8:0/828263392 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63402cda0 con 0x7fb6440d1450 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb641ffb640 1 -- 172.21.15.8:0/828263392 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634034660 con 0x7fb6440d1450 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb649583640 1 -- 172.21.15.8:0/828263392 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440d1450 msgr2=0x7fb6440d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb649583640 1 --2- 172.21.15.8:0/828263392 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440d1450 0x7fb6440d18c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb634009dc0 tx=0x7fb63402be90 comp rx=0 tx=0).stop 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb649583640 1 -- 172.21.15.8:0/828263392 shutdown_connections 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb649583640 1 --2- 172.21.15.8:0/828263392 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440d1450 0x7fb6440d18c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb649583640 1 -- 172.21.15.8:0/828263392 >> 172.21.15.8:0/828263392 conn(0x7fb64409c450 msgr2=0x7fb6440d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb649583640 1 -- 172.21.15.8:0/828263392 shutdown_connections 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.256+0000 7fb649583640 1 -- 172.21.15.8:0/828263392 wait complete. 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.257+0000 7fb649583640 1 Processor -- start 2023-11-18T23:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.257+0000 7fb649583640 1 -- start start 2023-11-18T23:41:08.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb649583640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440b2450 0x7fb6440b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb649583640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6440d1450 0x7fb6440b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb649583640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644160ab0 0x7fb6440b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb649583640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440b7270 con 0x7fb644160ab0 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb649583640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440b7550 con 0x7fb6440d1450 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb649583640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440b7830 con 0x7fb6440b2450 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb6437fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644160ab0 0x7fb6440b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb6437fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644160ab0 0x7fb6440b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34588/0 (socket says 172.21.15.8:34588) 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.258+0000 7fb6437fe640 1 -- 172.21.15.8:0/3427462500 learned_addr learned my addr 172.21.15.8:0/3427462500 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb642ffd640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440b2450 0x7fb6440b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6427fc640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6440d1450 0x7fb6440b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6437fe640 1 -- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440b2450 msgr2=0x7fb6440b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6437fe640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440b2450 0x7fb6440b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6437fe640 1 -- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6440d1450 msgr2=0x7fb6440b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6437fe640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6440d1450 0x7fb6440b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6437fe640 1 -- 172.21.15.8:0/3427462500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009a70 con 0x7fb644160ab0 2023-11-18T23:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6427fc640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6440d1450 0x7fb6440b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb6437fe640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644160ab0 0x7fb6440b6c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb634037040 tx=0x7fb634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb63b7fe640 1 -- 172.21.15.8:0/3427462500 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634040650 con 0x7fb644160ab0 2023-11-18T23:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb63b7fe640 1 -- 172.21.15.8:0/3427462500 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6340407b0 con 0x7fb644160ab0 2023-11-18T23:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb644155f90 con 0x7fb644160ab0 2023-11-18T23:41:08.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb63b7fe640 1 -- 172.21.15.8:0/3427462500 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634040b60 con 0x7fb644160ab0 2023-11-18T23:41:08.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.259+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440b7b10 con 0x7fb644160ab0 2023-11-18T23:41:08.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.260+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644156180 con 0x7fb644160ab0 2023-11-18T23:41:08.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.260+0000 7fb63b7fe640 1 -- 172.21.15.8:0/3427462500 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb634040cc0 con 0x7fb644160ab0 2023-11-18T23:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.261+0000 7fb63b7fe640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb62406ae40 0x7fb62406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.261+0000 7fb63b7fe640 1 -- 172.21.15.8:0/3427462500 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb6340abfd0 con 0x7fb644160ab0 2023-11-18T23:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.261+0000 7fb642ffd640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb62406ae40 0x7fb62406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.262+0000 7fb642ffd640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb62406ae40 0x7fb62406d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000f60 tx=0x7fb63c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.265+0000 7fb63b7fe640 1 -- 172.21.15.8:0/3427462500 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb634077340 con 0x7fb644160ab0 2023-11-18T23:41:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.443+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb644067420 con 0x7fb644160ab0 2023-11-18T23:41:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.444+0000 7fb63b7fe640 1 -- 172.21.15.8:0/3427462500 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12778 (secure 0 0 0) 0x7fb634009450 con 0x7fb644160ab0 2023-11-18T23:41:08.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:08.445 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:01.327983+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.445+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb62406ae40 msgr2=0x7fb62406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.445+0000 7fb649583640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb62406ae40 0x7fb62406d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000f60 tx=0x7fb63c009040 comp rx=0 tx=0).stop 2023-11-18T23:41:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644160ab0 msgr2=0x7fb6440b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644160ab0 0x7fb6440b6c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb634037040 tx=0x7fb634004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 shutdown_connections 2023-11-18T23:41:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb62406ae40 0x7fb62406d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644160ab0 0x7fb6440b6c40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6440d1450 0x7fb6440b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 --2- 172.21.15.8:0/3427462500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb6440b2450 0x7fb6440b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 >> 172.21.15.8:0/3427462500 conn(0x7fb64409c450 msgr2=0x7fb64415bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 shutdown_connections 2023-11-18T23:41:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.446+0000 7fb649583640 1 -- 172.21.15.8:0/3427462500 wait complete. 2023-11-18T23:41:08.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:08.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.566+0000 7f0929e21640 1 Processor -- start 2023-11-18T23:41:08.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.566+0000 7f0929e21640 1 -- start start 2023-11-18T23:41:08.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0929e21640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f092415e810 0x7f09240ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0929e21640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f092415ebf0 0x7f0924099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0929e21640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09240cd170 con 0x7f09240cd540 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0929e21640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09240b2260 con 0x7f092415ebf0 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0929e21640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09240b37b0 con 0x7f092415e810 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0922ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f092415ebf0 0x7f0924099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0922ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f092415ebf0 0x7f0924099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34604/0 (socket says 172.21.15.8:34604) 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0922ffd640 1 -- 172.21.15.8:0/3558523217 learned_addr learned my addr 172.21.15.8:0/3558523217 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f09237fe640 1 --2- 172.21.15.8:0/3558523217 >> v2:172.21.15.116:3300/0 conn(0x7f092415e810 0x7f09240ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0922ffd640 1 -- 172.21.15.8:0/3558523217 >> v2:172.21.15.116:3300/0 conn(0x7f092415e810 msgr2=0x7f09240ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0922ffd640 1 --2- 172.21.15.8:0/3558523217 >> v2:172.21.15.116:3300/0 conn(0x7f092415e810 0x7f09240ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0922ffd640 1 -- 172.21.15.8:0/3558523217 >> v1:172.21.15.116:6789/0 conn(0x7f09240cd540 legacy=0x7f0924099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.567+0000 7f0922ffd640 1 -- 172.21.15.8:0/3558523217 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240cc720 con 0x7f092415ebf0 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.568+0000 7f0922ffd640 1 --2- 172.21.15.8:0/3558523217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092415ebf0 0x7f0924099970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0924071720 tx=0x7f091802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ee14c49772e465 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.568+0000 7f09227fc640 1 -- 172.21.15.8:0/3558523217 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918030860 con 0x7f092415ebf0 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.568+0000 7f09227fc640 1 -- 172.21.15.8:0/3558523217 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09180309c0 con 0x7f092415ebf0 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.568+0000 7f09227fc640 1 -- 172.21.15.8:0/3558523217 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918030d50 con 0x7f092415ebf0 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 -- 172.21.15.8:0/3558523217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092415ebf0 msgr2=0x7f0924099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 --2- 172.21.15.8:0/3558523217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092415ebf0 0x7f0924099970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0924071720 tx=0x7f091802b9a0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 -- 172.21.15.8:0/3558523217 shutdown_connections 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 --2- 172.21.15.8:0/3558523217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092415ebf0 0x7f0924099970 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 --2- 172.21.15.8:0/3558523217 >> v2:172.21.15.116:3300/0 conn(0x7f092415e810 0x7f09240ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 -- 172.21.15.8:0/3558523217 >> 172.21.15.8:0/3558523217 conn(0x7f09240b2a70 msgr2=0x7f09240b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:08.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 -- 172.21.15.8:0/3558523217 shutdown_connections 2023-11-18T23:41:08.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.569+0000 7f0929e21640 1 -- 172.21.15.8:0/3558523217 wait complete. 2023-11-18T23:41:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.570+0000 7f0929e21640 1 Processor -- start 2023-11-18T23:41:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.570+0000 7f0929e21640 1 -- start start 2023-11-18T23:41:08.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0929e21640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09240cd540 0x7f092414c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0929e21640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f092415e810 0x7f09240ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0929e21640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f092415ebf0 0x7f09240b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0929e21640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b3ef0 con 0x7f09240cd540 2023-11-18T23:41:08.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0929e21640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b41d0 con 0x7f092415e810 2023-11-18T23:41:08.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0929e21640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b44b0 con 0x7f092415ebf0 2023-11-18T23:41:08.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09240cd540 0x7f092414c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09240cd540 0x7f092414c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34620/0 (socket says 172.21.15.8:34620) 2023-11-18T23:41:08.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 -- 172.21.15.8:0/559382550 learned_addr learned my addr 172.21.15.8:0/559382550 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:08.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0922ffd640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f092415e810 0x7f09240ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0923fff640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f092415ebf0 0x7f09240b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 -- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f092415ebf0 msgr2=0x7f09240b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f092415ebf0 0x7f09240b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 -- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f092415e810 msgr2=0x7f09240ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f092415e810 0x7f09240ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 -- 172.21.15.8:0/559382550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180094d0 con 0x7f09240cd540 2023-11-18T23:41:08.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f0922ffd640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f092415e810 0x7f09240ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:08.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.571+0000 7f09237fe640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09240cd540 0x7f092414c340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f091400e9b0 tx=0x7f091400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.572+0000 7f090bfff640 1 -- 172.21.15.8:0/559382550 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914009670 con 0x7f09240cd540 2023-11-18T23:41:08.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.572+0000 7f090bfff640 1 -- 172.21.15.8:0/559382550 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091400c9a0 con 0x7f09240cd540 2023-11-18T23:41:08.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.572+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09240b4790 con 0x7f09240cd540 2023-11-18T23:41:08.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.572+0000 7f090bfff640 1 -- 172.21.15.8:0/559382550 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091400cd50 con 0x7f09240cd540 2023-11-18T23:41:08.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.572+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092414c880 con 0x7f09240cd540 2023-11-18T23:41:08.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.573+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092409ef40 con 0x7f09240cd540 2023-11-18T23:41:08.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.573+0000 7f090bfff640 1 -- 172.21.15.8:0/559382550 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0914013470 con 0x7f09240cd540 2023-11-18T23:41:08.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.573+0000 7f090bfff640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f091006ae40 0x7f091006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.574+0000 7f090bfff640 1 -- 172.21.15.8:0/559382550 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0914089510 con 0x7f09240cd540 2023-11-18T23:41:08.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.574+0000 7f0922ffd640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f091006ae40 0x7f091006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.574+0000 7f0922ffd640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f091006ae40 0x7f091006d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0918036000 tx=0x7f091803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.578+0000 7f090bfff640 1 -- 172.21.15.8:0/559382550 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0914054910 con 0x7f09240cd540 2023-11-18T23:41:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.755+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09240b3590 con 0x7f09240cd540 2023-11-18T23:41:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.755+0000 7f090bfff640 1 -- 172.21.15.8:0/559382550 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0914057f30 con 0x7f09240cd540 2023-11-18T23:41:08.757 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f091006ae40 msgr2=0x7f091006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f091006ae40 0x7f091006d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0918036000 tx=0x7f091803b040 comp rx=0 tx=0).stop 2023-11-18T23:41:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09240cd540 msgr2=0x7f092414c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09240cd540 0x7f092414c340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f091400e9b0 tx=0x7f091400ee70 comp rx=0 tx=0).stop 2023-11-18T23:41:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 shutdown_connections 2023-11-18T23:41:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f091006ae40 0x7f091006d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f092415ebf0 0x7f09240b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f092415e810 0x7f09240ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 --2- 172.21.15.8:0/559382550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09240cd540 0x7f092414c340 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 >> 172.21.15.8:0/559382550 conn(0x7f09240b2a70 msgr2=0x7f092415da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 shutdown_connections 2023-11-18T23:41:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.757+0000 7f0929e21640 1 -- 172.21.15.8:0/559382550 wait complete. 2023-11-18T23:41:08.769 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T23:41:08.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.874+0000 7ff9f4264640 1 Processor -- start 2023-11-18T23:41:08.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.874+0000 7ff9f4264640 1 -- start start 2023-11-18T23:41:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f4264640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9ec09a530 0x7ff9ec0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f4264640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff9ec0cf890 0x7ff9ec0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f4264640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec0d0070 con 0x7ff9ec099970 2023-11-18T23:41:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f4264640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cbb50 con 0x7ff9ec09a530 2023-11-18T23:41:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f4264640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cfd90 con 0x7ff9ec0cf890 2023-11-18T23:41:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f17ff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9ec09a530 0x7ff9ec0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f2000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff9ec099970 0x7ff9ec099d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48688/0 (socket says 172.21.15.8:48688) 2023-11-18T23:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f2000640 1 -- 172.21.15.8:0/1343244871 learned_addr learned my addr 172.21.15.8:0/1343244871 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.875+0000 7ff9f17ff640 1 --2- 172.21.15.8:0/1343244871 >> v2:172.21.15.8:3300/0 conn(0x7ff9ec09a530 0x7ff9ec0cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34624/0 (socket says 172.21.15.8:34624) 2023-11-18T23:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.876+0000 7ff9f2801640 1 --2- 172.21.15.8:0/1343244871 >> v2:172.21.15.116:3300/0 conn(0x7ff9ec0cf890 0x7ff9ec0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.876+0000 7ff9f17ff640 1 -- 172.21.15.8:0/1343244871 >> v2:172.21.15.116:3300/0 conn(0x7ff9ec0cf890 msgr2=0x7ff9ec0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.876+0000 7ff9f17ff640 1 --2- 172.21.15.8:0/1343244871 >> v2:172.21.15.116:3300/0 conn(0x7ff9ec0cf890 0x7ff9ec0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.876+0000 7ff9f17ff640 1 -- 172.21.15.8:0/1343244871 >> v1:172.21.15.8:6789/0 conn(0x7ff9ec099970 legacy=0x7ff9ec099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.876+0000 7ff9f0ffe640 1 -- 172.21.15.8:0/1343244871 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597430713 0 0) 0x7ff9e8001110 con 0x7ff9ec099970 2023-11-18T23:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.876+0000 7ff9f17ff640 1 -- 172.21.15.8:0/1343244871 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0cbdf0 con 0x7ff9ec09a530 2023-11-18T23:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f17ff640 1 --2- 172.21.15.8:0/1343244871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec09a530 0x7ff9ec0cc8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0afe00 tx=0x7ff9dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4184b3465819ee09 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f0ffe640 1 -- 172.21.15.8:0/1343244871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc031830 con 0x7ff9ec09a530 2023-11-18T23:41:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f0ffe640 1 -- 172.21.15.8:0/1343244871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc031990 con 0x7ff9ec09a530 2023-11-18T23:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f0ffe640 1 -- 172.21.15.8:0/1343244871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc031d20 con 0x7ff9ec09a530 2023-11-18T23:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f4264640 1 -- 172.21.15.8:0/1343244871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec09a530 msgr2=0x7ff9ec0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f4264640 1 --2- 172.21.15.8:0/1343244871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec09a530 0x7ff9ec0cc8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0afe00 tx=0x7ff9dc02b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f4264640 1 -- 172.21.15.8:0/1343244871 shutdown_connections 2023-11-18T23:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f4264640 1 --2- 172.21.15.8:0/1343244871 >> v2:172.21.15.116:3300/0 conn(0x7ff9ec0cf890 0x7ff9ec0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f4264640 1 --2- 172.21.15.8:0/1343244871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec09a530 0x7ff9ec0cc8d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f4264640 1 -- 172.21.15.8:0/1343244871 >> 172.21.15.8:0/1343244871 conn(0x7ff9ec0b2a70 msgr2=0x7ff9ec0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.877+0000 7ff9f4264640 1 -- 172.21.15.8:0/1343244871 shutdown_connections 2023-11-18T23:41:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.878+0000 7ff9f4264640 1 -- 172.21.15.8:0/1343244871 wait complete. 2023-11-18T23:41:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 Processor -- start 2023-11-18T23:41:08.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 -- start start 2023-11-18T23:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec099970 0x7ff9ec153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9ec09a530 0x7ff9ec15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9ec0cf890 0x7ff9ec159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec15e000 con 0x7ff9ec099970 2023-11-18T23:41:08.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec154bd0 con 0x7ff9ec09a530 2023-11-18T23:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f4264640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec15da40 con 0x7ff9ec0cf890 2023-11-18T23:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f2000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec099970 0x7ff9ec153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.879+0000 7ff9f2000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec099970 0x7ff9ec153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34638/0 (socket says 172.21.15.8:34638) 2023-11-18T23:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2000640 1 -- 172.21.15.8:0/2110391509 learned_addr learned my addr 172.21.15.8:0/2110391509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2801640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9ec0cf890 0x7ff9ec159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f17ff640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9ec09a530 0x7ff9ec15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2000640 1 -- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9ec0cf890 msgr2=0x7ff9ec159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2000640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9ec0cf890 0x7ff9ec159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2000640 1 -- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9ec09a530 msgr2=0x7ff9ec15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2000640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9ec09a530 0x7ff9ec15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2000640 1 -- 172.21.15.8:0/2110391509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc009400 con 0x7ff9ec099970 2023-11-18T23:41:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f2000640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec099970 0x7ff9ec153910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800c780 tx=0x7ff9e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9e27fc640 1 -- 172.21.15.8:0/2110391509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80072d0 con 0x7ff9ec099970 2023-11-18T23:41:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9e27fc640 1 -- 172.21.15.8:0/2110391509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8007450 con 0x7ff9ec099970 2023-11-18T23:41:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9e27fc640 1 -- 172.21.15.8:0/2110391509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80047e0 con 0x7ff9ec099970 2023-11-18T23:41:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec15dd20 con 0x7ff9ec099970 2023-11-18T23:41:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.880+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec15c740 con 0x7ff9ec099970 2023-11-18T23:41:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.881+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec15c2c0 con 0x7ff9ec099970 2023-11-18T23:41:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.882+0000 7ff9e27fc640 1 -- 172.21.15.8:0/2110391509 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9e8004960 con 0x7ff9ec099970 2023-11-18T23:41:08.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.882+0000 7ff9e27fc640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff9d006ae40 0x7ff9d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:08.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.882+0000 7ff9e27fc640 1 -- 172.21.15.8:0/2110391509 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff9e8088370 con 0x7ff9ec099970 2023-11-18T23:41:08.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.882+0000 7ff9f17ff640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff9d006ae40 0x7ff9d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:08.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.883+0000 7ff9f17ff640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff9d006ae40 0x7ff9d006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc036000 tx=0x7ff9dc03e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:08.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:08.886+0000 7ff9e27fc640 1 -- 172.21.15.8:0/2110391509 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9ec15c2c0 con 0x7ff9ec099970 2023-11-18T23:41:09.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.065+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff9ec0d0070 con 0x7ff9ec099970 2023-11-18T23:41:09.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.066+0000 7ff9e27fc640 1 -- 172.21.15.8:0/2110391509 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff9ec0d0070 con 0x7ff9ec099970 2023-11-18T23:41:09.067 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:09.068 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-11-18T23:41:09.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:41:09.068 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-11-18T23:41:09.068 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-11-18T23:41:09.068 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:41:09.068 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-11-18T23:41:09.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.067+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff9d006ae40 msgr2=0x7ff9d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.067+0000 7ff9f4264640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff9d006ae40 0x7ff9d006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc036000 tx=0x7ff9dc03e040 comp rx=0 tx=0).stop 2023-11-18T23:41:09.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.067+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec099970 msgr2=0x7ff9ec153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.067+0000 7ff9f4264640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec099970 0x7ff9ec153910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800c780 tx=0x7ff9e800cc40 comp rx=0 tx=0).stop 2023-11-18T23:41:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 shutdown_connections 2023-11-18T23:41:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff9d006ae40 0x7ff9d006d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9ec0cf890 0x7ff9ec159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9ec09a530 0x7ff9ec15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 --2- 172.21.15.8:0/2110391509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9ec099970 0x7ff9ec153910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 >> 172.21.15.8:0/2110391509 conn(0x7ff9ec0b2a70 msgr2=0x7ff9ec0adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:09.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 shutdown_connections 2023-11-18T23:41:09.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.068+0000 7ff9f4264640 1 -- 172.21.15.8:0/2110391509 wait complete. 2023-11-18T23:41:09.080 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T23:41:09.080 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T23:41:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.189+0000 7f7e5deaf640 1 Processor -- start 2023-11-18T23:41:09.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.189+0000 7f7e5deaf640 1 -- start start 2023-11-18T23:41:09.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e5deaf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e5815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e5deaf640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580b4070 con 0x7f7e580ccd90 2023-11-18T23:41:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e5deaf640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5815c4f0 con 0x7f7e580cb820 2023-11-18T23:41:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e5deaf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58144cc0 con 0x7f7e581448e0 2023-11-18T23:41:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e57fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7e580ccd90 0x7f7e5806c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48700/0 (socket says 172.21.15.8:48700) 2023-11-18T23:41:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e57fff640 1 -- 172.21.15.8:0/283051220 learned_addr learned my addr 172.21.15.8:0/283051220 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e577fe640 1 --2- 172.21.15.8:0/283051220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e5815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e567fc640 1 -- 172.21.15.8:0/283051220 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174616777 0 0) 0x7f7e580b4070 con 0x7f7e580ccd90 2023-11-18T23:41:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e567fc640 1 -- 172.21.15.8:0/283051220 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e40003520 con 0x7f7e580ccd90 2023-11-18T23:41:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.190+0000 7f7e567fc640 1 -- 172.21.15.8:0/283051220 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834451978 0 0) 0x7f7e5815c4f0 con 0x7f7e580cb820 2023-11-18T23:41:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.191+0000 7f7e567fc640 1 -- 172.21.15.8:0/283051220 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e580b4070 con 0x7f7e580cb820 2023-11-18T23:41:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.191+0000 7f7e577fe640 1 -- 172.21.15.8:0/283051220 >> v1:172.21.15.116:6789/0 conn(0x7f7e580cb820 legacy=0x7f7e580cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.191+0000 7f7e577fe640 1 -- 172.21.15.8:0/283051220 >> v1:172.21.15.8:6789/0 conn(0x7f7e580ccd90 legacy=0x7f7e5806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.191+0000 7f7e577fe640 1 -- 172.21.15.8:0/283051220 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e580b3460 con 0x7f7e581448e0 2023-11-18T23:41:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.191+0000 7f7e577fe640 1 --2- 172.21.15.8:0/283051220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e5815bfb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009800 tx=0x7f7e4802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7859b21530103e69 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e567fc640 1 -- 172.21.15.8:0/283051220 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48031800 con 0x7f7e581448e0 2023-11-18T23:41:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e567fc640 1 -- 172.21.15.8:0/283051220 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e48031960 con 0x7f7e581448e0 2023-11-18T23:41:09.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e567fc640 1 -- 172.21.15.8:0/283051220 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48031cd0 con 0x7f7e581448e0 2023-11-18T23:41:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e5deaf640 1 -- 172.21.15.8:0/283051220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 msgr2=0x7f7e5815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/283051220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e5815bfb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009800 tx=0x7f7e4802b8a0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e5deaf640 1 -- 172.21.15.8:0/283051220 shutdown_connections 2023-11-18T23:41:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/283051220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e5815bfb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e5deaf640 1 -- 172.21.15.8:0/283051220 >> 172.21.15.8:0/283051220 conn(0x7f7e5806a6b0 msgr2=0x7f7e5806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e5deaf640 1 -- 172.21.15.8:0/283051220 shutdown_connections 2023-11-18T23:41:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.192+0000 7f7e5deaf640 1 -- 172.21.15.8:0/283051220 wait complete. 2023-11-18T23:41:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.193+0000 7f7e5deaf640 1 Processor -- start 2023-11-18T23:41:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.193+0000 7f7e5deaf640 1 -- start start 2023-11-18T23:41:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e5deaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e580cb820 0x7f7e58140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e5deaf640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e580ccd90 0x7f7e580ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e5deaf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e580cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e5deaf640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58130080 con 0x7f7e580ccd90 2023-11-18T23:41:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e5deaf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5812f6e0 con 0x7f7e580cb820 2023-11-18T23:41:09.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e5deaf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5812f9c0 con 0x7f7e581448e0 2023-11-18T23:41:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e56ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e580ccd90 0x7f7e580ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e56ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e580ccd90 0x7f7e580ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34640/0 (socket says 172.21.15.8:34640) 2023-11-18T23:41:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e56ffd640 1 -- 172.21.15.8:0/3762746332 learned_addr learned my addr 172.21.15.8:0/3762746332 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e580cb820 0x7f7e58140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.194+0000 7f7e57fff640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e580cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e56ffd640 1 -- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 msgr2=0x7f7e580cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e56ffd640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e580cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e56ffd640 1 -- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e580cb820 msgr2=0x7f7e58140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e56ffd640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e580cb820 0x7f7e58140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e56ffd640 1 -- 172.21.15.8:0/3762746332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48009400 con 0x7f7e580ccd90 2023-11-18T23:41:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e56ffd640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e580ccd90 0x7f7e580ca7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00c500 tx=0x7f7e4c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e3ffff640 1 -- 172.21.15.8:0/3762746332 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0052d0 con 0x7f7e580ccd90 2023-11-18T23:41:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e3ffff640 1 -- 172.21.15.8:0/3762746332 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c005450 con 0x7f7e580ccd90 2023-11-18T23:41:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5812fca0 con 0x7f7e580ccd90 2023-11-18T23:41:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e3ffff640 1 -- 172.21.15.8:0/3762746332 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c012870 con 0x7f7e580ccd90 2023-11-18T23:41:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.195+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e581407b0 con 0x7f7e580ccd90 2023-11-18T23:41:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.196+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e581301c0 con 0x7f7e580ccd90 2023-11-18T23:41:09.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.197+0000 7f7e3ffff640 1 -- 172.21.15.8:0/3762746332 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e4c0129d0 con 0x7f7e580ccd90 2023-11-18T23:41:09.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.197+0000 7f7e3ffff640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7e4406ae70 0x7f7e4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:09.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.197+0000 7f7e3ffff640 1 -- 172.21.15.8:0/3762746332 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e4c088d10 con 0x7f7e580ccd90 2023-11-18T23:41:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.197+0000 7f7e577fe640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7e4406ae70 0x7f7e4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.198+0000 7f7e577fe640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7e4406ae70 0x7f7e4406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e48036000 tx=0x7f7e4803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.202+0000 7f7e3ffff640 1 -- 172.21.15.8:0/3762746332 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e4c0541d0 con 0x7f7e580ccd90 2023-11-18T23:41:09.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.377+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7e58072ae0 con 0x7f7e580ccd90 2023-11-18T23:41:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.928+0000 7f7e3ffff640 1 -- 172.21.15.8:0/3762746332 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7e4c0577f0 con 0x7f7e580ccd90 2023-11-18T23:41:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-11-18T23:41:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7e4406ae70 msgr2=0x7f7e4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7e4406ae70 0x7f7e4406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e48036000 tx=0x7f7e4803c040 comp rx=0 tx=0).stop 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e580ccd90 msgr2=0x7f7e580ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e580ccd90 0x7f7e580ca7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00c500 tx=0x7f7e4c00c9c0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 shutdown_connections 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7e4406ae70 0x7f7e4406d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7e581448e0 0x7f7e580cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e580ccd90 0x7f7e580ca7a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 --2- 172.21.15.8:0/3762746332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e580cb820 0x7f7e58140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 >> 172.21.15.8:0/3762746332 conn(0x7f7e5806a6b0 msgr2=0x7f7e580cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 shutdown_connections 2023-11-18T23:41:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:09.931+0000 7f7e5deaf640 1 -- 172.21.15.8:0/3762746332 wait complete. 2023-11-18T23:41:09.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T23:41:10.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.068+0000 7f7b10e64640 1 Processor -- start 2023-11-18T23:41:10.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.068+0000 7f7b10e64640 1 -- start start 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.068+0000 7f7b10e64640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 0x7f7b0c0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.068+0000 7f7b10e64640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7b0c0cef00 0x7f7b0c161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.068+0000 7f7b10e64640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0c0ce360 con 0x7f7b0c0b2aa0 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.068+0000 7f7b10e64640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0c0b2f20 con 0x7f7b0c0cef00 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.068+0000 7f7b10e64640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cdd50 con 0x7f7b0c160b70 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b03fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7b0c0b2aa0 0x7f7b0c0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48704/0 (socket says 172.21.15.8:48704) 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b03fff640 1 -- 172.21.15.8:0/4021113288 learned_addr learned my addr 172.21.15.8:0/4021113288 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b0ad9d640 1 --2- 172.21.15.8:0/4021113288 >> v2:172.21.15.116:3300/0 conn(0x7f7b0c0cef00 0x7f7b0c161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b0a59c640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 0x7f7b0c0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438236596 0 0) 0x7f7b0c0ce360 con 0x7f7b0c0b2aa0 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af8003520 con 0x7f7b0c0b2aa0 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1084152924 0 0) 0x7f7af8003520 con 0x7f7b0c0b2aa0 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 msgr2=0x7f7b0c0d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 0x7f7b0c0d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 >> v2:172.21.15.116:3300/0 conn(0x7f7b0c0cef00 msgr2=0x7f7b0c161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 --2- 172.21.15.8:0/4021113288 >> v2:172.21.15.116:3300/0 conn(0x7f7b0c0cef00 0x7f7b0c161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c0d1c70 con 0x7f7b0c0b2aa0 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f7af4001670 con 0x7f7b0c0b2aa0 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 >> v1:172.21.15.8:6789/0 conn(0x7f7b0c0b2aa0 legacy=0x7f7b0c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 0x7f7af8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8003ef0 0x7f7af80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7af8004d00 0x7f7af8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0b2f20 con 0x7f7af8004d00 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cdd50 con 0x7f7af8003ef0 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af800b980 con 0x7f7b0c160b70 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b0ad9d640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7af8004d00 0x7f7af8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b0a59c640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 0x7f7af8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.069+0000 7f7b03fff640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8003ef0 0x7f7af80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.070+0000 7f7b0ad9d640 1 -- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 msgr2=0x7f7af8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.070+0000 7f7b0ad9d640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c160b70 0x7f7af8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.070+0000 7f7b0ad9d640 1 -- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8003ef0 msgr2=0x7f7af80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.070+0000 7f7b0ad9d640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8003ef0 0x7f7af80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.070+0000 7f7b0ad9d640 1 -- 172.21.15.8:0/4021113288 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8003520 con 0x7f7af8004d00 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.070+0000 7f7b0ad9d640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7af8004d00 0x7f7af8005180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009fc0 tx=0x7f7af80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa546ee7112c16af server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:10.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0402cc40 con 0x7f7af8004d00 2023-11-18T23:41:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0400f040 con 0x7f7af8004d00 2023-11-18T23:41:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b09d9b640 1 -- 172.21.15.8:0/4021113288 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04034440 con 0x7f7af8004d00 2023-11-18T23:41:10.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b10e64640 1 -- 172.21.15.8:0/4021113288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7af8004d00 msgr2=0x7f7af8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b10e64640 1 --2- 172.21.15.8:0/4021113288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7af8004d00 0x7f7af8005180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009fc0 tx=0x7f7af80057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b0ad9d640 1 -- 172.21.15.8:0/4021113288 reap_dead start 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b10e64640 1 -- 172.21.15.8:0/4021113288 shutdown_connections 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b10e64640 1 -- 172.21.15.8:0/4021113288 >> 172.21.15.8:0/4021113288 conn(0x7f7b0c09c470 msgr2=0x7f7b0c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b10e64640 1 -- 172.21.15.8:0/4021113288 shutdown_connections 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.071+0000 7f7b10e64640 1 -- 172.21.15.8:0/4021113288 wait complete. 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 Processor -- start 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 -- start start 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8004d00 0x7f7b0c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b0c15e640 0x7f7b0c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c1f65d0 0x7f7b0c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c15d120 con 0x7f7b0c15e640 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c1f6f90 con 0x7f7af8004d00 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b10e64640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0b6800 con 0x7f7b0c1f65d0 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b03fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b0c15e640 0x7f7b0c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b03fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b0c15e640 0x7f7b0c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34664/0 (socket says 172.21.15.8:34664) 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.073+0000 7f7b03fff640 1 -- 172.21.15.8:0/1014222779 learned_addr learned my addr 172.21.15.8:0/1014222779 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b0ad9d640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c1f65d0 0x7f7b0c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b0a59c640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8004d00 0x7f7b0c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b03fff640 1 -- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c1f65d0 msgr2=0x7f7b0c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b03fff640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c1f65d0 0x7f7b0c1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b03fff640 1 -- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8004d00 msgr2=0x7f7b0c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b03fff640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8004d00 0x7f7b0c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b03fff640 1 -- 172.21.15.8:0/1014222779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c0b6ae0 con 0x7f7b0c15e640 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b03fff640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b0c15e640 0x7f7b0c15eac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7af4007340 tx=0x7f7af4007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:10.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b02ffd640 1 -- 172.21.15.8:0/1014222779 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400f8e0 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b02ffd640 1 -- 172.21.15.8:0/1014222779 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af400fa60 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c0b6dc0 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b02ffd640 1 -- 172.21.15.8:0/1014222779 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400fe10 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.074+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0c0b7380 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.075+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0c0a1150 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.076+0000 7f7b02ffd640 1 -- 172.21.15.8:0/1014222779 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7af401d460 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.076+0000 7f7b02ffd640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7aec06ae40 0x7f7aec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.076+0000 7f7b02ffd640 1 -- 172.21.15.8:0/1014222779 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7af4089520 con 0x7f7b0c15e640 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.076+0000 7f7b0a59c640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7aec06ae40 0x7f7aec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:10.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.077+0000 7f7b0a59c640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7aec06ae40 0x7f7aec06d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c160580 tx=0x7f7afc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.081+0000 7f7b02ffd640 1 -- 172.21.15.8:0/1014222779 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7af40547b0 con 0x7f7b0c15e640 2023-11-18T23:41:10.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.261+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7b0c0b22d0 con 0x7f7b0c15e640 2023-11-18T23:41:10.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.930+0000 7f7b02ffd640 1 -- 172.21.15.8:0/1014222779 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7af4057dd0 con 0x7f7b0c15e640 2023-11-18T23:41:10.932 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-11-18T23:41:10.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.934+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7aec06ae40 msgr2=0x7f7aec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.934+0000 7f7b10e64640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7aec06ae40 0x7f7aec06d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c160580 tx=0x7f7afc009190 comp rx=0 tx=0).stop 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.934+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b0c15e640 msgr2=0x7f7b0c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.934+0000 7f7b10e64640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b0c15e640 0x7f7b0c15eac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7af4007340 tx=0x7f7af4007740 comp rx=0 tx=0).stop 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.935+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 shutdown_connections 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.935+0000 7f7b10e64640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7aec06ae40 0x7f7aec06d300 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c160580 tx=0x7f7afc009190 comp rx=0 tx=0).stop 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.935+0000 7f7b10e64640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0c1f65d0 0x7f7b0c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.935+0000 7f7b10e64640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b0c15e640 0x7f7b0c15eac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.935+0000 7f7b10e64640 1 --2- 172.21.15.8:0/1014222779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7af8004d00 0x7f7b0c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:10.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.935+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 >> 172.21.15.8:0/1014222779 conn(0x7f7b0c09c470 msgr2=0x7f7b0c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:10.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.941+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 shutdown_connections 2023-11-18T23:41:10.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:10.941+0000 7f7b10e64640 1 -- 172.21.15.8:0/1014222779 wait complete. 2023-11-18T23:41:10.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T23:41:11.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.077+0000 7f99645ce640 1 Processor -- start 2023-11-18T23:41:11.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.077+0000 7f99645ce640 1 -- start start 2023-11-18T23:41:11.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f99645ce640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f99645ce640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f995c06bc50 0x7f995c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f99645ce640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c0b3590 con 0x7f995c0b6b50 2023-11-18T23:41:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f99645ce640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c06b310 con 0x7f995c06bc50 2023-11-18T23:41:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f99645ce640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0cd3a0 con 0x7f995c09a080 2023-11-18T23:41:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9962b6b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f995c06bc50 0x7f995c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:11.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9961b69640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f996236a640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f995c0b6b50 0x7f995c099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:34792/0 (socket says 172.21.15.8:34792) 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9961b69640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c0cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:53318/0 (socket says 172.21.15.8:53318) 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f996236a640 1 -- 172.21.15.8:0/915272198 learned_addr learned my addr 172.21.15.8:0/915272198 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9962b6b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f995c06bc50 0x7f995c06c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:47094/0 (socket says 172.21.15.8:47094) 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9962b6b640 1 -- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 msgr2=0x7f995c0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9962b6b640 1 --2- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c0cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9962b6b640 1 -- 172.21.15.8:0/915272198 >> v1:172.21.15.116:6789/0 conn(0x7f995c0b6b50 legacy=0x7f995c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9962b6b640 1 -- 172.21.15.8:0/915272198 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0b37c0 con 0x7f995c06bc50 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9961368640 1 -- 172.21.15.8:0/915272198 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110058837 0 0) 0x7f995c0b3590 con 0x7f995c0b6b50 2023-11-18T23:41:11.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.078+0000 7f9961b69640 1 --2- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.079+0000 7f9962b6b640 1 --2- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c06bc50 0x7f995c06c100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9954009d90 tx=0x7f995402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a469f5f7c2f0cb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.079+0000 7f9961368640 1 -- 172.21.15.8:0/915272198 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995402cce0 con 0x7f995c06bc50 2023-11-18T23:41:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.079+0000 7f9961368640 1 -- 172.21.15.8:0/915272198 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995402ce40 con 0x7f995c06bc50 2023-11-18T23:41:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.079+0000 7f9961368640 1 -- 172.21.15.8:0/915272198 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954034660 con 0x7f995c06bc50 2023-11-18T23:41:11.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 -- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c06bc50 msgr2=0x7f995c06c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 --2- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c06bc50 0x7f995c06c100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9954009d90 tx=0x7f995402bf30 comp rx=0 tx=0).stop 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 -- 172.21.15.8:0/915272198 shutdown_connections 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 --2- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c06bc50 0x7f995c06c100 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 --2- 172.21.15.8:0/915272198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 -- 172.21.15.8:0/915272198 >> 172.21.15.8:0/915272198 conn(0x7f995c0b2a70 msgr2=0x7f995c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 -- 172.21.15.8:0/915272198 shutdown_connections 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.080+0000 7f99645ce640 1 -- 172.21.15.8:0/915272198 wait complete. 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.081+0000 7f99645ce640 1 Processor -- start 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.081+0000 7f99645ce640 1 -- start start 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f99645ce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f995c06bc50 0x7f995c0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f99645ce640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:11.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f99645ce640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c0b6b50 0x7f995c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f99645ce640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c54c0 con 0x7f995c06bc50 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f99645ce640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c15e8a0 con 0x7f995c0b6b50 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f99645ce640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c15eb80 con 0x7f995c09a080 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f995c06bc50 0x7f995c0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f995c06bc50 0x7f995c0c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34672/0 (socket says 172.21.15.8:34672) 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 -- 172.21.15.8:0/3194321239 learned_addr learned my addr 172.21.15.8:0/3194321239 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f9962b6b640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c0b6b50 0x7f995c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f9961b69640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 -- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 msgr2=0x7f995c153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 -- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c0b6b50 msgr2=0x7f995c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:11.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c0b6b50 0x7f995c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 -- 172.21.15.8:0/3194321239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c009400 con 0x7f995c06bc50 2023-11-18T23:41:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.082+0000 7f996236a640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f995c06bc50 0x7f995c0c5f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f995800c430 tx=0x7f995800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.083+0000 7f9952ffd640 1 -- 172.21.15.8:0/3194321239 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580074e0 con 0x7f995c06bc50 2023-11-18T23:41:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.083+0000 7f9952ffd640 1 -- 172.21.15.8:0/3194321239 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958007660 con 0x7f995c06bc50 2023-11-18T23:41:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.083+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9954009a70 con 0x7f995c06bc50 2023-11-18T23:41:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.083+0000 7f9952ffd640 1 -- 172.21.15.8:0/3194321239 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958004a20 con 0x7f995c06bc50 2023-11-18T23:41:11.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.083+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c0c5a60 con 0x7f995c06bc50 2023-11-18T23:41:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.084+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c0c5c80 con 0x7f995c06bc50 2023-11-18T23:41:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.084+0000 7f9952ffd640 1 -- 172.21.15.8:0/3194321239 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9958004b80 con 0x7f995c06bc50 2023-11-18T23:41:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.085+0000 7f9952ffd640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f994006ae40 0x7f994006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.085+0000 7f9952ffd640 1 -- 172.21.15.8:0/3194321239 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9958089320 con 0x7f995c06bc50 2023-11-18T23:41:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.085+0000 7f9961b69640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f994006ae40 0x7f994006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:11.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.085+0000 7f9961b69640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f994006ae40 0x7f994006d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f995c0caff0 tx=0x7f994c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:11.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.089+0000 7f9952ffd640 1 -- 172.21.15.8:0/3194321239 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9958054450 con 0x7f995c06bc50 2023-11-18T23:41:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.301+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f995c09ef40 con 0x7f995c06bc50 2023-11-18T23:41:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.950+0000 7f9952ffd640 1 -- 172.21.15.8:0/3194321239 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9958057a70 con 0x7f995c06bc50 2023-11-18T23:41:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f994006ae40 msgr2=0x7f994006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f994006ae40 0x7f994006d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f995c0caff0 tx=0x7f994c009190 comp rx=0 tx=0).stop 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f995c06bc50 msgr2=0x7f995c0c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f995c06bc50 0x7f995c0c5f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f995800c430 tx=0x7f995800c8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 shutdown_connections 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f994006ae40 0x7f994006d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f995c0b6b50 0x7f995c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f995c09a080 0x7f995c153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 --2- 172.21.15.8:0/3194321239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f995c06bc50 0x7f995c0c5f80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 >> 172.21.15.8:0/3194321239 conn(0x7f995c0b2a70 msgr2=0x7f995c099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 shutdown_connections 2023-11-18T23:41:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:11.953+0000 7f99645ce640 1 -- 172.21.15.8:0/3194321239 wait complete. 2023-11-18T23:41:11.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:12.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.080+0000 7f1c1495a640 1 Processor -- start 2023-11-18T23:41:12.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.080+0000 7f1c1495a640 1 -- start start 2023-11-18T23:41:12.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.081+0000 7f1c1495a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1c100d1720 0x7f1c100d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.081+0000 7f1c1495a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100b3db0 0x7f1c100b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.081+0000 7f1c1495a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100b5f90 con 0x7f1c1015d3e0 2023-11-18T23:41:12.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.081+0000 7f1c1495a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100d20a0 con 0x7f1c100d1720 2023-11-18T23:41:12.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.081+0000 7f1c1495a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100b61e0 con 0x7f1c100b3db0 2023-11-18T23:41:12.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.081+0000 7f1c0dd9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1c100d1720 0x7f1c100d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0e59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1c1015d3e0 0x7f1c100ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48714/0 (socket says 172.21.15.8:48714) 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0dd9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1c100d1720 0x7f1c100d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34688/0 (socket says 172.21.15.8:34688) 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0e59c640 1 -- 172.21.15.8:0/2696277249 learned_addr learned my addr 172.21.15.8:0/2696277249 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0ed9d640 1 --2- 172.21.15.8:0/2696277249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100b3db0 0x7f1c100b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0dd9b640 1 -- 172.21.15.8:0/2696277249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100b3db0 msgr2=0x7f1c100b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0dd9b640 1 --2- 172.21.15.8:0/2696277249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100b3db0 0x7f1c100b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0dd9b640 1 -- 172.21.15.8:0/2696277249 >> v1:172.21.15.8:6789/0 conn(0x7f1c1015d3e0 legacy=0x7f1c100ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0d59a640 1 -- 172.21.15.8:0/2696277249 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944287275 0 0) 0x7f1c100b5f90 con 0x7f1c1015d3e0 2023-11-18T23:41:12.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.082+0000 7f1c0dd9b640 1 -- 172.21.15.8:0/2696277249 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100b64c0 con 0x7f1c100d1720 2023-11-18T23:41:12.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c0dd9b640 1 --2- 172.21.15.8:0/2696277249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c100d1720 0x7f1c100d1b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c040097a0 tx=0x7f1c0402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb714e97ca0edb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c0d59a640 1 -- 172.21.15.8:0/2696277249 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04030610 con 0x7f1c100d1720 2023-11-18T23:41:12.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c0d59a640 1 -- 172.21.15.8:0/2696277249 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04030770 con 0x7f1c100d1720 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c0d59a640 1 -- 172.21.15.8:0/2696277249 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04030b00 con 0x7f1c100d1720 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c1495a640 1 -- 172.21.15.8:0/2696277249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c100d1720 msgr2=0x7f1c100d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c1495a640 1 --2- 172.21.15.8:0/2696277249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c100d1720 0x7f1c100d1b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c040097a0 tx=0x7f1c0402b960 comp rx=0 tx=0).stop 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c1495a640 1 -- 172.21.15.8:0/2696277249 shutdown_connections 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c1495a640 1 --2- 172.21.15.8:0/2696277249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100b3db0 0x7f1c100b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c1495a640 1 --2- 172.21.15.8:0/2696277249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c100d1720 0x7f1c100d1b60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c1495a640 1 -- 172.21.15.8:0/2696277249 >> 172.21.15.8:0/2696277249 conn(0x7f1c1009c480 msgr2=0x7f1c100d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.083+0000 7f1c1495a640 1 -- 172.21.15.8:0/2696277249 shutdown_connections 2023-11-18T23:41:12.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.084+0000 7f1c1495a640 1 -- 172.21.15.8:0/2696277249 wait complete. 2023-11-18T23:41:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.085+0000 7f1c1495a640 1 Processor -- start 2023-11-18T23:41:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.085+0000 7f1c1495a640 1 -- start start 2023-11-18T23:41:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c1495a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c100b3db0 0x7f1c1015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c1495a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100d1720 0x7f1c10155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c1495a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c1015d3e0 0x7f1c1006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c1495a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10160200 con 0x7f1c1015d3e0 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c1495a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101604e0 con 0x7f1c100b3db0 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c1495a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101607c0 con 0x7f1c100d1720 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c1015d3e0 0x7f1c1006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c1015d3e0 0x7f1c1006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34698/0 (socket says 172.21.15.8:34698) 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 -- 172.21.15.8:0/1984598944 learned_addr learned my addr 172.21.15.8:0/1984598944 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c100b3db0 0x7f1c1015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0dd9b640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100d1720 0x7f1c10155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 -- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100d1720 msgr2=0x7f1c10155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100d1720 0x7f1c10155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 -- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c100b3db0 msgr2=0x7f1c1015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c100b3db0 0x7f1c1015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 -- 172.21.15.8:0/1984598944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04009400 con 0x7f1c1015d3e0 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c0ed9d640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c1015d3e0 0x7f1c1006bae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000e7f0 tx=0x7f1c0000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1bfeffd640 1 -- 172.21.15.8:0/1984598944 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00009510 con 0x7f1c1015d3e0 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1bfeffd640 1 -- 172.21.15.8:0/1984598944 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0000ee40 con 0x7f1c1015d3e0 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1bfeffd640 1 -- 172.21.15.8:0/1984598944 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000cb80 con 0x7f1c1015d3e0 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.086+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c10156ff0 con 0x7f1c1015d3e0 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.087+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c10156a80 con 0x7f1c1015d3e0 2023-11-18T23:41:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.087+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10157510 con 0x7f1c1015d3e0 2023-11-18T23:41:12.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.088+0000 7f1bfeffd640 1 -- 172.21.15.8:0/1984598944 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c0000cce0 con 0x7f1c1015d3e0 2023-11-18T23:41:12.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.088+0000 7f1bfeffd640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1bf006ae40 0x7f1bf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.088+0000 7f1bfeffd640 1 -- 172.21.15.8:0/1984598944 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c00089710 con 0x7f1c1015d3e0 2023-11-18T23:41:12.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.089+0000 7f1c0e59c640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1bf006ae40 0x7f1bf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.089+0000 7f1c0e59c640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1bf006ae40 0x7f1bf006d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c080012e0 tx=0x7f1c08001700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.093+0000 7f1bfeffd640 1 -- 172.21.15.8:0/1984598944 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c10157510 con 0x7f1c1015d3e0 2023-11-18T23:41:12.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.269+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c10157510 con 0x7f1c1015d3e0 2023-11-18T23:41:12.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.271+0000 7f1bfeffd640 1 -- 172.21.15.8:0/1984598944 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16446 (secure 0 0 0) 0x7f1c10157510 con 0x7f1c1015d3e0 2023-11-18T23:41:12.274 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:12.274 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":19,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:11.303020+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.272+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1bf006ae40 msgr2=0x7f1bf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.272+0000 7f1c1495a640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1bf006ae40 0x7f1bf006d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c080012e0 tx=0x7f1c08001700 comp rx=0 tx=0).stop 2023-11-18T23:41:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.272+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c1015d3e0 msgr2=0x7f1c1006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.272+0000 7f1c1495a640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c1015d3e0 0x7f1c1006bae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000e7f0 tx=0x7f1c0000ebf0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 shutdown_connections 2023-11-18T23:41:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1bf006ae40 0x7f1bf006d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c1015d3e0 0x7f1c1006bae0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c100d1720 0x7f1c10155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 --2- 172.21.15.8:0/1984598944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c100b3db0 0x7f1c1015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 >> 172.21.15.8:0/1984598944 conn(0x7f1c1009c480 msgr2=0x7f1c100b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 shutdown_connections 2023-11-18T23:41:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.273+0000 7f1c1495a640 1 -- 172.21.15.8:0/1984598944 wait complete. 2023-11-18T23:41:12.285 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:12.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.390+0000 7fdfe527c640 1 Processor -- start 2023-11-18T23:41:12.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.390+0000 7fdfe527c640 1 -- start start 2023-11-18T23:41:12.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfe527c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00cce70 0x7fdfe0099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfe527c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdfe00d1c50 0x7fdfe0099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfe527c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe00d03a0 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfe527c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe006bfa0 con 0x7fdfe00d1c50 2023-11-18T23:41:12.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfe527c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe006f9d0 con 0x7fdfe00cce70 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfdf7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdfe00d1c50 0x7fdfe0099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfdeffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00cce70 0x7fdfe0099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfd67fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdfe00d0ab0 0x7fdfe006e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:34798/0 (socket says 172.21.15.8:34798) 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfd67fc640 1 -- 172.21.15.8:0/19802811 learned_addr learned my addr 172.21.15.8:0/19802811 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfde7fc640 1 -- 172.21.15.8:0/19802811 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180427832 0 0) 0x7fdfe00d03a0 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfde7fc640 1 -- 172.21.15.8:0/19802811 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfcc003520 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfdeffd640 1 -- 172.21.15.8:0/19802811 >> v2:172.21.15.116:3300/0 conn(0x7fdfe00d1c50 msgr2=0x7fdfe0099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfdeffd640 1 --2- 172.21.15.8:0/19802811 >> v2:172.21.15.116:3300/0 conn(0x7fdfe00d1c50 0x7fdfe0099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfdeffd640 1 -- 172.21.15.8:0/19802811 >> v1:172.21.15.116:6789/0 conn(0x7fdfe00d0ab0 legacy=0x7fdfe006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.391+0000 7fdfdeffd640 1 -- 172.21.15.8:0/19802811 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe006c190 con 0x7fdfe00cce70 2023-11-18T23:41:12.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.392+0000 7fdfdeffd640 1 --2- 172.21.15.8:0/19802811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00cce70 0x7fdfe0099970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097a0 tx=0x7fdfd002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c842e3b09ddc806d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.392+0000 7fdfde7fc640 1 -- 172.21.15.8:0/19802811 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0031830 con 0x7fdfe00cce70 2023-11-18T23:41:12.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.392+0000 7fdfde7fc640 1 -- 172.21.15.8:0/19802811 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0031990 con 0x7fdfe00cce70 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.392+0000 7fdfde7fc640 1 -- 172.21.15.8:0/19802811 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0031d00 con 0x7fdfe00cce70 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 -- 172.21.15.8:0/19802811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00cce70 msgr2=0x7fdfe0099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 --2- 172.21.15.8:0/19802811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00cce70 0x7fdfe0099970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097a0 tx=0x7fdfd002b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 -- 172.21.15.8:0/19802811 shutdown_connections 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 --2- 172.21.15.8:0/19802811 >> v2:172.21.15.116:3300/0 conn(0x7fdfe00d1c50 0x7fdfe0099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 --2- 172.21.15.8:0/19802811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00cce70 0x7fdfe0099970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 -- 172.21.15.8:0/19802811 >> 172.21.15.8:0/19802811 conn(0x7fdfe00d0f20 msgr2=0x7fdfe00d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 -- 172.21.15.8:0/19802811 shutdown_connections 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.393+0000 7fdfe527c640 1 -- 172.21.15.8:0/19802811 wait complete. 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.394+0000 7fdfe527c640 1 Processor -- start 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.394+0000 7fdfe527c640 1 -- start start 2023-11-18T23:41:12.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfe527c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe00cce70 0x7fdfe00c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfe527c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe00d0ab0 0x7fdfe00b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfe527c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00d1c50 0x7fdfe01f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfe527c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0159d00 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfe527c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe00b6400 con 0x7fdfe00cce70 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfe527c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe00b66e0 con 0x7fdfe00d1c50 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe00d0ab0 0x7fdfe00b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe00d0ab0 0x7fdfe00b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34700/0 (socket says 172.21.15.8:34700) 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 -- 172.21.15.8:0/1878643842 learned_addr learned my addr 172.21.15.8:0/1878643842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfdf7fe640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00d1c50 0x7fdfe01f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfdeffd640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe00cce70 0x7fdfe00c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 -- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00d1c50 msgr2=0x7fdfe01f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00d1c50 0x7fdfe01f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 -- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe00cce70 msgr2=0x7fdfe00c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe00cce70 0x7fdfe00c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.395+0000 7fdfd67fc640 1 -- 172.21.15.8:0/1878643842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009400 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.396+0000 7fdfd67fc640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe00d0ab0 0x7fdfe00b3b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c430 tx=0x7fdfc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.396+0000 7fdfd7fff640 1 -- 172.21.15.8:0/1878643842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8005ce0 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.396+0000 7fdfd7fff640 1 -- 172.21.15.8:0/1878643842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8005e40 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.396+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe00b69c0 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.396+0000 7fdfd7fff640 1 -- 172.21.15.8:0/1878643842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80072f0 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.396+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe00c66d0 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.397+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe0159e40 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.397+0000 7fdfd7fff640 1 -- 172.21.15.8:0/1878643842 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfc8007450 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.398+0000 7fdfd7fff640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdfc006ae40 0x7fdfc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.398+0000 7fdfd7fff640 1 -- 172.21.15.8:0/1878643842 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfc8088cf0 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.398+0000 7fdfdeffd640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdfc006ae40 0x7fdfc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.398+0000 7fdfdeffd640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdfc006ae40 0x7fdfc006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0036000 tx=0x7fdfd003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.402+0000 7fdfd7fff640 1 -- 172.21.15.8:0/1878643842 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdfe0159e40 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:41:12.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:41:12.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.579+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfe0159e40 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.581+0000 7fdfd7fff640 1 -- 172.21.15.8:0/1878643842 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16446 (secure 0 0 0) 0x7fdfe0159e40 con 0x7fdfe00d0ab0 2023-11-18T23:41:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:12.582 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":19,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:11.303020+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdfc006ae40 msgr2=0x7fdfc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdfc006ae40 0x7fdfc006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0036000 tx=0x7fdfd003c040 comp rx=0 tx=0).stop 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe00d0ab0 msgr2=0x7fdfe00b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe00d0ab0 0x7fdfe00b3b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c430 tx=0x7fdfc800c8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 shutdown_connections 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdfc006ae40 0x7fdfc006d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfe00d1c50 0x7fdfe01f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdfe00d0ab0 0x7fdfe00b3b40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 --2- 172.21.15.8:0/1878643842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe00cce70 0x7fdfe00c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.582+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 >> 172.21.15.8:0/1878643842 conn(0x7fdfe00d0f20 msgr2=0x7fdfe015d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.583+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 shutdown_connections 2023-11-18T23:41:12.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.583+0000 7fdfe527c640 1 -- 172.21.15.8:0/1878643842 wait complete. 2023-11-18T23:41:12.594 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T23:41:12.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.741+0000 7fc93a4e0640 1 Processor -- start 2023-11-18T23:41:12.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.741+0000 7fc93a4e0640 1 -- start start 2023-11-18T23:41:12.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc93a4e0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc93a4e0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc9340b2aa0 0x7fc9340ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc93a4e0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9340ce360 con 0x7fc9340ced30 2023-11-18T23:41:12.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc93a4e0640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9340b2f20 con 0x7fc9340b2aa0 2023-11-18T23:41:12.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc93a4e0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340cdd50 con 0x7fc934160b70 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc9337fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc9340b2aa0 0x7fc9340ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc9337fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc9340b2aa0 0x7fc9340ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34716/0 (socket says 172.21.15.8:34716) 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.742+0000 7fc9337fe640 1 -- 172.21.15.8:0/3778764259 learned_addr learned my addr 172.21.15.8:0/3778764259 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.743+0000 7fc933fff640 1 --2- 172.21.15.8:0/3778764259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.743+0000 7fc9337fe640 1 -- 172.21.15.8:0/3778764259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 msgr2=0x7fc9340d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.743+0000 7fc9337fe640 1 --2- 172.21.15.8:0/3778764259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.743+0000 7fc9337fe640 1 -- 172.21.15.8:0/3778764259 >> v1:172.21.15.116:6789/0 conn(0x7fc9340ced30 legacy=0x7fc9340cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.743+0000 7fc9337fe640 1 -- 172.21.15.8:0/3778764259 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9340d1c70 con 0x7fc9340b2aa0 2023-11-18T23:41:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.743+0000 7fc933fff640 1 --2- 172.21.15.8:0/3778764259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.743+0000 7fc9337fe640 1 --2- 172.21.15.8:0/3778764259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc9340ce7f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc928009870 tx=0x7fc92802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6d33214ebd5728 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc932ffd640 1 -- 172.21.15.8:0/3778764259 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928030840 con 0x7fc9340b2aa0 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc932ffd640 1 -- 172.21.15.8:0/3778764259 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9280309a0 con 0x7fc9340b2aa0 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc932ffd640 1 -- 172.21.15.8:0/3778764259 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928030d30 con 0x7fc9340b2aa0 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 -- 172.21.15.8:0/3778764259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 msgr2=0x7fc9340ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/3778764259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc9340ce7f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc928009870 tx=0x7fc92802b980 comp rx=0 tx=0).stop 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 -- 172.21.15.8:0/3778764259 shutdown_connections 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/3778764259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc9340ce7f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/3778764259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 -- 172.21.15.8:0/3778764259 >> 172.21.15.8:0/3778764259 conn(0x7fc93409c470 msgr2=0x7fc9340d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 -- 172.21.15.8:0/3778764259 shutdown_connections 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.744+0000 7fc93a4e0640 1 -- 172.21.15.8:0/3778764259 wait complete. 2023-11-18T23:41:12.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.745+0000 7fc93a4e0640 1 Processor -- start 2023-11-18T23:41:12.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.745+0000 7fc93a4e0640 1 -- start start 2023-11-18T23:41:12.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc93a4e0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc934156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc93a4e0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9340ced30 0x7fc9340a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc93a4e0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc93a4e0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340a0da0 con 0x7fc9340b2aa0 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc93a4e0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93409d6f0 con 0x7fc9340ced30 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc93a4e0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93409cee0 con 0x7fc934160b70 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc933fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc934156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc933fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc934156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34730/0 (socket says 172.21.15.8:34730) 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc933fff640 1 -- 172.21.15.8:0/807300125 learned_addr learned my addr 172.21.15.8:0/807300125 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.746+0000 7fc9337fe640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9340ced30 0x7fc9340a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc938a7d640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc933fff640 1 -- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 msgr2=0x7fc9340cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc933fff640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc933fff640 1 -- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9340ced30 msgr2=0x7fc9340a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc933fff640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9340ced30 0x7fc9340a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc933fff640 1 -- 172.21.15.8:0/807300125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280094d0 con 0x7fc9340b2aa0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc933fff640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc934156250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc92400d7d0 tx=0x7fc92400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc930ff9640 1 -- 172.21.15.8:0/807300125 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924004030 con 0x7fc9340b2aa0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc930ff9640 1 -- 172.21.15.8:0/807300125 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924004190 con 0x7fc9340b2aa0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9340cc1f0 con 0x7fc9340b2aa0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc930ff9640 1 -- 172.21.15.8:0/807300125 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924004520 con 0x7fc9340b2aa0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.747+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93409d130 con 0x7fc9340b2aa0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.748+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9340a1150 con 0x7fc9340b2aa0 2023-11-18T23:41:12.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.748+0000 7fc930ff9640 1 -- 172.21.15.8:0/807300125 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9240096a0 con 0x7fc9340b2aa0 2023-11-18T23:41:12.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.749+0000 7fc930ff9640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc92006ae70 0x7fc92006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:12.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.749+0000 7fc930ff9640 1 -- 172.21.15.8:0/807300125 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9240897a0 con 0x7fc9340b2aa0 2023-11-18T23:41:12.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.749+0000 7fc9337fe640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc92006ae70 0x7fc92006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:12.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.750+0000 7fc9337fe640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc92006ae70 0x7fc92006d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc928036000 tx=0x7fc928008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:12.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.753+0000 7fc930ff9640 1 -- 172.21.15.8:0/807300125 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9240547d0 con 0x7fc9340b2aa0 2023-11-18T23:41:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:12.972+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9340b22d0 con 0x7fc9340b2aa0 2023-11-18T23:41:13.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.962+0000 7fc930ff9640 1 -- 172.21.15.8:0/807300125 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc924057df0 con 0x7fc9340b2aa0 2023-11-18T23:41:13.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc92006ae70 msgr2=0x7fc92006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:13.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc92006ae70 0x7fc92006d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc928036000 tx=0x7fc928008030 comp rx=0 tx=0).stop 2023-11-18T23:41:13.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 msgr2=0x7fc934156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:13.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc934156250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc92400d7d0 tx=0x7fc92400dc90 comp rx=0 tx=0).stop 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 shutdown_connections 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc92006ae70 0x7fc92006d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc934160b70 0x7fc9340cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9340ced30 0x7fc9340a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 --2- 172.21.15.8:0/807300125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9340b2aa0 0x7fc934156250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 >> 172.21.15.8:0/807300125 conn(0x7fc93409c470 msgr2=0x7fc93406b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 shutdown_connections 2023-11-18T23:41:13.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:13.966+0000 7fc93a4e0640 1 -- 172.21.15.8:0/807300125 wait complete. 2023-11-18T23:41:13.980 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T23:41:13.980 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T23:41:14.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.094+0000 7fee5b78a640 1 Processor -- start 2023-11-18T23:41:14.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.095+0000 7fee5b78a640 1 -- start start 2023-11-18T23:41:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.095+0000 7fee5b78a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee54160b70 0x7fee540d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.095+0000 7fee5b78a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.095+0000 7fee5b78a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fee540ced30 0x7fee540cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.095+0000 7fee5b78a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540ce360 con 0x7fee54160b70 2023-11-18T23:41:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.095+0000 7fee5b78a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540b2f20 con 0x7fee540ced30 2023-11-18T23:41:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.095+0000 7fee5b78a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540cdd50 con 0x7fee540b2aa0 2023-11-18T23:41:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee54160b70 0x7fee540d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee54160b70 0x7fee540d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34738/0 (socket says 172.21.15.8:34738) 2023-11-18T23:41:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 -- 172.21.15.8:0/3146319980 learned_addr learned my addr 172.21.15.8:0/3146319980 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59d27640 1 --2- 172.21.15.8:0/3146319980 >> v2:172.21.15.116:3300/0 conn(0x7fee540ced30 0x7fee540cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee58d25640 1 --2- 172.21.15.8:0/3146319980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 -- 172.21.15.8:0/3146319980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 msgr2=0x7fee540ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 --2- 172.21.15.8:0/3146319980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 -- 172.21.15.8:0/3146319980 >> v2:172.21.15.116:3300/0 conn(0x7fee540ced30 msgr2=0x7fee540cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 --2- 172.21.15.8:0/3146319980 >> v2:172.21.15.116:3300/0 conn(0x7fee540ced30 0x7fee540cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee59526640 1 -- 172.21.15.8:0/3146319980 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540d1c70 con 0x7fee54160b70 2023-11-18T23:41:14.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.096+0000 7fee58d25640 1 --2- 172.21.15.8:0/3146319980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee59526640 1 --2- 172.21.15.8:0/3146319980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee54160b70 0x7fee540d1570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fee5408b780 tx=0x7fee5002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103a14dd6977b2d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee4bfff640 1 -- 172.21.15.8:0/3146319980 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50031870 con 0x7fee54160b70 2023-11-18T23:41:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee4bfff640 1 -- 172.21.15.8:0/3146319980 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500319d0 con 0x7fee54160b70 2023-11-18T23:41:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee4bfff640 1 -- 172.21.15.8:0/3146319980 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50031d60 con 0x7fee54160b70 2023-11-18T23:41:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 -- 172.21.15.8:0/3146319980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee54160b70 msgr2=0x7fee540d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 --2- 172.21.15.8:0/3146319980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee54160b70 0x7fee540d1570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fee5408b780 tx=0x7fee5002b910 comp rx=0 tx=0).stop 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 -- 172.21.15.8:0/3146319980 shutdown_connections 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 --2- 172.21.15.8:0/3146319980 >> v2:172.21.15.116:3300/0 conn(0x7fee540ced30 0x7fee540cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 --2- 172.21.15.8:0/3146319980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 --2- 172.21.15.8:0/3146319980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee54160b70 0x7fee540d1570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 -- 172.21.15.8:0/3146319980 >> 172.21.15.8:0/3146319980 conn(0x7fee5409c470 msgr2=0x7fee540d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.097+0000 7fee5b78a640 1 -- 172.21.15.8:0/3146319980 shutdown_connections 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.098+0000 7fee5b78a640 1 -- 172.21.15.8:0/3146319980 wait complete. 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.099+0000 7fee5b78a640 1 Processor -- start 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.099+0000 7fee5b78a640 1 -- start start 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.099+0000 7fee5b78a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.099+0000 7fee5b78a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee540ced30 0x7fee54156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.099+0000 7fee5b78a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee54160b70 0x7fee54157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.099+0000 7fee5b78a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540cbec0 con 0x7fee540ced30 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.099+0000 7fee5b78a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540cc1a0 con 0x7fee54160b70 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee5b78a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540cc480 con 0x7fee540b2aa0 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee540ced30 0x7fee54156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee540ced30 0x7fee54156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34744/0 (socket says 172.21.15.8:34744) 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 -- 172.21.15.8:0/1991432987 learned_addr learned my addr 172.21.15.8:0/1991432987 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee59d27640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee54160b70 0x7fee54157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee59526640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 -- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 msgr2=0x7fee540cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 -- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee54160b70 msgr2=0x7fee54157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:14.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee54160b70 0x7fee54157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 -- 172.21.15.8:0/1991432987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500094d0 con 0x7fee540ced30 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee59526640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee58d25640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee540ced30 0x7fee54156dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c7c0 tx=0x7fee4400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee49ffb640 1 -- 172.21.15.8:0/1991432987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44007a30 con 0x7fee540ced30 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee49ffb640 1 -- 172.21.15.8:0/1991432987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44007b90 con 0x7fee540ced30 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540cc760 con 0x7fee540ced30 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee49ffb640 1 -- 172.21.15.8:0/1991432987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400ce70 con 0x7fee540ced30 2023-11-18T23:41:14.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.100+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540ccf60 con 0x7fee540ced30 2023-11-18T23:41:14.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.102+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee540ccc80 con 0x7fee540ced30 2023-11-18T23:41:14.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.102+0000 7fee49ffb640 1 -- 172.21.15.8:0/1991432987 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee440113f0 con 0x7fee540ced30 2023-11-18T23:41:14.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.102+0000 7fee49ffb640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fee3806ae40 0x7fee3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:14.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.102+0000 7fee49ffb640 1 -- 172.21.15.8:0/1991432987 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee44089710 con 0x7fee540ced30 2023-11-18T23:41:14.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.102+0000 7fee59526640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fee3806ae40 0x7fee3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:14.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.103+0000 7fee59526640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fee3806ae40 0x7fee3806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee50036000 tx=0x7fee5003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.107+0000 7fee49ffb640 1 -- 172.21.15.8:0/1991432987 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee540ccc80 con 0x7fee540ced30 2023-11-18T23:41:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.319+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fee540ccc80 con 0x7fee540ced30 2023-11-18T23:41:14.914 INFO:tasks.ceph.mds.d.smithi116.stderr:2023-11-18T23:41:14.913+0000 7fab654bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T23:41:14.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.967+0000 7fee49ffb640 1 -- 172.21.15.8:0/1991432987 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fee540ccc80 con 0x7fee540ced30 2023-11-18T23:41:14.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.969+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fee3806ae40 msgr2=0x7fee3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:14.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.969+0000 7fee5b78a640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fee3806ae40 0x7fee3806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee50036000 tx=0x7fee5003c040 comp rx=0 tx=0).stop 2023-11-18T23:41:14.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.969+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee540ced30 msgr2=0x7fee54156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:14.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.969+0000 7fee5b78a640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee540ced30 0x7fee54156dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c7c0 tx=0x7fee4400cc80 comp rx=0 tx=0).stop 2023-11-18T23:41:14.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.969+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 shutdown_connections 2023-11-18T23:41:14.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.969+0000 7fee5b78a640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fee3806ae40 0x7fee3806d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.969+0000 7fee5b78a640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee54160b70 0x7fee54157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.970+0000 7fee5b78a640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee540ced30 0x7fee54156dc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.970+0000 7fee5b78a640 1 --2- 172.21.15.8:0/1991432987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee540b2aa0 0x7fee540cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:14.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.970+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 >> 172.21.15.8:0/1991432987 conn(0x7fee5409c470 msgr2=0x7fee540afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:14.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.970+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 shutdown_connections 2023-11-18T23:41:14.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:14.970+0000 7fee5b78a640 1 -- 172.21.15.8:0/1991432987 wait complete. 2023-11-18T23:41:14.984 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T23:41:14.984 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.095+0000 7fbc72aa9640 1 Processor -- start 2023-11-18T23:41:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.095+0000 7fbc72aa9640 1 -- start start 2023-11-18T23:41:15.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc72aa9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc6c160ab0 0x7fbc6c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc72aa9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c0d1450 0x7fbc6c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc72aa9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0cdd30 con 0x7fbc6c0b2450 2023-11-18T23:41:15.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc72aa9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c0d1e00 con 0x7fbc6c160ab0 2023-11-18T23:41:15.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc72aa9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c0ce2d0 con 0x7fbc6c0d1450 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc70845640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc6c160ab0 0x7fbc6c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc63fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbc6c0b2450 0x7fbc6c0cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48716/0 (socket says 172.21.15.8:48716) 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc63fff640 1 -- 172.21.15.8:0/2030932933 learned_addr learned my addr 172.21.15.8:0/2030932933 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc70845640 1 -- 172.21.15.8:0/2030932933 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c0d1450 msgr2=0x7fbc6c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc71046640 1 --2- 172.21.15.8:0/2030932933 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c0d1450 0x7fbc6c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc70845640 1 --2- 172.21.15.8:0/2030932933 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c0d1450 0x7fbc6c0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc637fe640 1 -- 172.21.15.8:0/2030932933 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200355076 0 0) 0x7fbc6c0cdd30 con 0x7fbc6c0b2450 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc70845640 1 -- 172.21.15.8:0/2030932933 >> v1:172.21.15.8:6789/0 conn(0x7fbc6c0b2450 legacy=0x7fbc6c0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.096+0000 7fbc70845640 1 -- 172.21.15.8:0/2030932933 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0d0a90 con 0x7fbc6c160ab0 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.097+0000 7fbc70845640 1 --2- 172.21.15.8:0/2030932933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c160ab0 0x7fbc6c0afdb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc680097a0 tx=0x7fbc6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ff94f211193a1e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.097+0000 7fbc637fe640 1 -- 172.21.15.8:0/2030932933 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6802e070 con 0x7fbc6c160ab0 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.097+0000 7fbc637fe640 1 -- 172.21.15.8:0/2030932933 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc680315a0 con 0x7fbc6c160ab0 2023-11-18T23:41:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.097+0000 7fbc637fe640 1 -- 172.21.15.8:0/2030932933 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68031930 con 0x7fbc6c160ab0 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 -- 172.21.15.8:0/2030932933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c160ab0 msgr2=0x7fbc6c0afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/2030932933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c160ab0 0x7fbc6c0afdb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc680097a0 tx=0x7fbc6802b840 comp rx=0 tx=0).stop 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 -- 172.21.15.8:0/2030932933 shutdown_connections 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/2030932933 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c0d1450 0x7fbc6c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/2030932933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c160ab0 0x7fbc6c0afdb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 -- 172.21.15.8:0/2030932933 >> 172.21.15.8:0/2030932933 conn(0x7fbc6c09c450 msgr2=0x7fbc6c0d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 -- 172.21.15.8:0/2030932933 shutdown_connections 2023-11-18T23:41:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.098+0000 7fbc72aa9640 1 -- 172.21.15.8:0/2030932933 wait complete. 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.099+0000 7fbc72aa9640 1 Processor -- start 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.099+0000 7fbc72aa9640 1 -- start start 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc72aa9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0b2450 0x7fbc6c0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc72aa9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc6c0d1450 0x7fbc6c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc72aa9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c160ab0 0x7fbc6c14dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc72aa9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c15cf30 con 0x7fbc6c0b2450 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc72aa9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c15d210 con 0x7fbc6c0d1450 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc72aa9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c15d4f0 con 0x7fbc6c160ab0 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0b2450 0x7fbc6c0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0b2450 0x7fbc6c0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34764/0 (socket says 172.21.15.8:34764) 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 -- 172.21.15.8:0/1905249093 learned_addr learned my addr 172.21.15.8:0/1905249093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc71046640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c160ab0 0x7fbc6c14dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc63fff640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc6c0d1450 0x7fbc6c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 -- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c160ab0 msgr2=0x7fbc6c14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c160ab0 0x7fbc6c14dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 -- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc6c0d1450 msgr2=0x7fbc6c0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc6c0d1450 0x7fbc6c0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 -- 172.21.15.8:0/1905249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68009400 con 0x7fbc6c0b2450 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc70845640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0b2450 0x7fbc6c0ccd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc68034040 tx=0x7fbc680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.100+0000 7fbc617fa640 1 -- 172.21.15.8:0/1905249093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68032840 con 0x7fbc6c0b2450 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.101+0000 7fbc617fa640 1 -- 172.21.15.8:0/1905249093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc680329c0 con 0x7fbc6c0b2450 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.101+0000 7fbc617fa640 1 -- 172.21.15.8:0/1905249093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68032d70 con 0x7fbc6c0b2450 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.101+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c15d7d0 con 0x7fbc6c0b2450 2023-11-18T23:41:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.101+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c158610 con 0x7fbc6c0b2450 2023-11-18T23:41:15.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.102+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c15dcf0 con 0x7fbc6c0b2450 2023-11-18T23:41:15.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.102+0000 7fbc617fa640 1 -- 172.21.15.8:0/1905249093 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc6804e430 con 0x7fbc6c0b2450 2023-11-18T23:41:15.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.102+0000 7fbc617fa640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc5806ae40 0x7fbc5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.103+0000 7fbc617fa640 1 -- 172.21.15.8:0/1905249093 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc680ab810 con 0x7fbc6c0b2450 2023-11-18T23:41:15.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.103+0000 7fbc63fff640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc5806ae40 0x7fbc5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.103+0000 7fbc63fff640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc5806ae40 0x7fbc5806d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c15e6b0 tx=0x7fbc5c007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.107+0000 7fbc617fa640 1 -- 172.21.15.8:0/1905249093 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc6c15dcf0 con 0x7fbc6c0b2450 2023-11-18T23:41:15.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.319+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc6c067420 con 0x7fbc6c0b2450 2023-11-18T23:41:15.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.319+0000 7fbc617fa640 1 -- 172.21.15.8:0/1905249093 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fbc68076820 con 0x7fbc6c0b2450 2023-11-18T23:41:15.321 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:15.321 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:15.321 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc5806ae40 msgr2=0x7fbc5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc5806ae40 0x7fbc5806d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c15e6b0 tx=0x7fbc5c007b50 comp rx=0 tx=0).stop 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0b2450 msgr2=0x7fbc6c0ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0b2450 0x7fbc6c0ccd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc68034040 tx=0x7fbc680046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 shutdown_connections 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc5806ae40 0x7fbc5806d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6c160ab0 0x7fbc6c14dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc6c0d1450 0x7fbc6c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 --2- 172.21.15.8:0/1905249093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0b2450 0x7fbc6c0ccd90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 >> 172.21.15.8:0/1905249093 conn(0x7fbc6c09c450 msgr2=0x7fbc6c06c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:15.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 shutdown_connections 2023-11-18T23:41:15.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.321+0000 7fbc72aa9640 1 -- 172.21.15.8:0/1905249093 wait complete. 2023-11-18T23:41:15.333 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:15.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.438+0000 7fb4b2651640 1 Processor -- start 2023-11-18T23:41:15.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.438+0000 7fb4b2651640 1 -- start start 2023-11-18T23:41:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4b2651640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb4ac15d310 0x7fb4ac0cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4b2651640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 0x7fb4ac0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4b2651640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0b2830 con 0x7fb4ac15d6f0 2023-11-18T23:41:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4b2651640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0cf220 con 0x7fb4ac15d310 2023-11-18T23:41:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4b2651640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b2c60 con 0x7fb4ac0ce3b0 2023-11-18T23:41:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4ab7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb4ac15d6f0 0x7fb4ac0cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48718/0 (socket says 172.21.15.8:48718) 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4ab7fe640 1 -- 172.21.15.8:0/3889555220 learned_addr learned my addr 172.21.15.8:0/3889555220 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4abfff640 1 --2- 172.21.15.8:0/3889555220 >> v2:172.21.15.116:3300/0 conn(0x7fb4ac15d310 0x7fb4ac0cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4b0bee640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 0x7fb4ac0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998993877 0 0) 0x7fb4ac0b2830 con 0x7fb4ac15d6f0 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.439+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb494003520 con 0x7fb4ac15d6f0 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949042462 0 0) 0x7fb494003520 con 0x7fb4ac15d6f0 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 msgr2=0x7fb4ac0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 0x7fb4ac0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 >> v2:172.21.15.116:3300/0 conn(0x7fb4ac15d310 msgr2=0x7fb4ac0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 --2- 172.21.15.8:0/3889555220 >> v2:172.21.15.116:3300/0 conn(0x7fb4ac15d310 0x7fb4ac0cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0ce980 con 0x7fb4ac15d6f0 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fb49c001670 con 0x7fb4ac15d6f0 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 >> v1:172.21.15.8:6789/0 conn(0x7fb4ac15d6f0 legacy=0x7fb4ac0cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb494003970 0x7fb494003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 0x7fb4940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb494004d00 0x7fb494005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0cf220 con 0x7fb494004d00 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b2c60 con 0x7fb494003970 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49400b980 con 0x7fb4ac0ce3b0 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4b0bee640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb494004d00 0x7fb494005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4ab7fe640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 0x7fb4940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4abfff640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb494003970 0x7fb494003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4b0bee640 1 -- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 msgr2=0x7fb4940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4b0bee640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4ac0ce3b0 0x7fb4940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4b0bee640 1 -- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb494003970 msgr2=0x7fb494003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4b0bee640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb494003970 0x7fb494003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.440+0000 7fb4b0bee640 1 -- 172.21.15.8:0/3889555220 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494003520 con 0x7fb494004d00 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.441+0000 7fb4b0bee640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb494004d00 0x7fb494005180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009fc0 tx=0x7fb4940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab445c29fceedf02 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.441+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a402cc20 con 0x7fb494004d00 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.441+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400f040 con 0x7fb494004d00 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.441+0000 7fb4aaffd640 1 -- 172.21.15.8:0/3889555220 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4034440 con 0x7fb494004d00 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.442+0000 7fb4b2651640 1 -- 172.21.15.8:0/3889555220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb494004d00 msgr2=0x7fb494005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.442+0000 7fb4b2651640 1 --2- 172.21.15.8:0/3889555220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb494004d00 0x7fb494005180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009fc0 tx=0x7fb4940057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.442+0000 7fb4b0bee640 1 -- 172.21.15.8:0/3889555220 reap_dead start 2023-11-18T23:41:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.442+0000 7fb4b2651640 1 -- 172.21.15.8:0/3889555220 shutdown_connections 2023-11-18T23:41:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.442+0000 7fb4b2651640 1 -- 172.21.15.8:0/3889555220 >> 172.21.15.8:0/3889555220 conn(0x7fb4ac09c460 msgr2=0x7fb4ac0d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.442+0000 7fb4b2651640 1 -- 172.21.15.8:0/3889555220 shutdown_connections 2023-11-18T23:41:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.442+0000 7fb4b2651640 1 -- 172.21.15.8:0/3889555220 wait complete. 2023-11-18T23:41:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.443+0000 7fb4b2651640 1 Processor -- start 2023-11-18T23:41:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.443+0000 7fb4b2651640 1 -- start start 2023-11-18T23:41:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4b2651640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb494004d00 0x7fb4ac1f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4b2651640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4ac0ca9c0 0x7fb4ac14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4b2651640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4ac14d390 0x7fb4ac0d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4b2651640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1f6430 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4b2651640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac14d9c0 con 0x7fb4ac14d390 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4b2651640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac14dca0 con 0x7fb494004d00 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4ac0ca9c0 0x7fb4ac14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4ac0ca9c0 0x7fb4ac14ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34782/0 (socket says 172.21.15.8:34782) 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 -- 172.21.15.8:0/244358283 learned_addr learned my addr 172.21.15.8:0/244358283 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4b0bee640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4ac14d390 0x7fb4ac0d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4abfff640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb494004d00 0x7fb4ac1f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 -- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb494004d00 msgr2=0x7fb4ac1f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb494004d00 0x7fb4ac1f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 -- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4ac14d390 msgr2=0x7fb4ac0d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4ac14d390 0x7fb4ac0d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 -- 172.21.15.8:0/244358283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac1f5d70 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4ab7fe640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4ac0ca9c0 0x7fb4ac14ce50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb49c007310 tx=0x7fb49c007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.444+0000 7fb4a8ff9640 1 -- 172.21.15.8:0/244358283 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00f960 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.445+0000 7fb4a8ff9640 1 -- 172.21.15.8:0/244358283 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00fac0 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.445+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac1f6050 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.445+0000 7fb4a8ff9640 1 -- 172.21.15.8:0/244358283 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00fe70 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.445+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac0cae40 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.446+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac0cb030 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.446+0000 7fb4a8ff9640 1 -- 172.21.15.8:0/244358283 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb49c01d460 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.446+0000 7fb4a8ff9640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49806ae70 0x7fb49806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.447+0000 7fb4a8ff9640 1 -- 172.21.15.8:0/244358283 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb49c089710 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.447+0000 7fb4abfff640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49806ae70 0x7fb49806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.447+0000 7fb4abfff640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49806ae70 0x7fb49806d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009bc0 tx=0x7fb4a0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.451+0000 7fb4a8ff9640 1 -- 172.21.15.8:0/244358283 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4ac0cb030 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.631+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4ac0cb030 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.632+0000 7fb4a8ff9640 1 -- 172.21.15.8:0/244358283 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fb4ac0cb030 con 0x7fb4ac0ca9c0 2023-11-18T23:41:15.633 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:15.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49806ae70 msgr2=0x7fb49806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49806ae70 0x7fb49806d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009bc0 tx=0x7fb4a0009190 comp rx=0 tx=0).stop 2023-11-18T23:41:15.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4ac0ca9c0 msgr2=0x7fb4ac14ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4ac0ca9c0 0x7fb4ac14ce50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb49c007310 tx=0x7fb49c007710 comp rx=0 tx=0).stop 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 shutdown_connections 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49806ae70 0x7fb49806d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4ac14d390 0x7fb4ac0d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4ac0ca9c0 0x7fb4ac14ce50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 --2- 172.21.15.8:0/244358283 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb494004d00 0x7fb4ac1f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 >> 172.21.15.8:0/244358283 conn(0x7fb4ac09c460 msgr2=0x7fb4ac0b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 shutdown_connections 2023-11-18T23:41:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.634+0000 7fb4b2651640 1 -- 172.21.15.8:0/244358283 wait complete. 2023-11-18T23:41:15.646 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T23:41:15.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:41:15.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 Processor -- start 2023-11-18T23:41:15.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 -- start start 2023-11-18T23:41:15.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d9015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d9006a4d0 0x7f7d9006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7d900cfde0 0x7f7d900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9006ae70 con 0x7f7d9006a4d0 2023-11-18T23:41:15.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900b2ee0 con 0x7f7d900cfde0 2023-11-18T23:41:15.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.751+0000 7f7d965e3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900b34a0 con 0x7f7d90144a50 2023-11-18T23:41:15.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d9006a4d0 0x7f7d9006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d9006a4d0 0x7f7d9006a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34786/0 (socket says 172.21.15.8:34786) 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/1206429161 learned_addr learned my addr 172.21.15.8:0/1206429161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d94b80640 1 --2- 172.21.15.8:0/1206429161 >> v2:172.21.15.116:3300/0 conn(0x7f7d900cfde0 0x7f7d900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8ffff640 1 --2- 172.21.15.8:0/1206429161 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d9015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/1206429161 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 msgr2=0x7f7d9015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 --2- 172.21.15.8:0/1206429161 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d9015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/1206429161 >> v2:172.21.15.116:3300/0 conn(0x7f7d900cfde0 msgr2=0x7f7d900d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 --2- 172.21.15.8:0/1206429161 >> v2:172.21.15.116:3300/0 conn(0x7f7d900cfde0 0x7f7d900d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/1206429161 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90144e30 con 0x7f7d9006a4d0 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d8ffff640 1 --2- 172.21.15.8:0/1206429161 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d9015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:15.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.752+0000 7f7d94b80640 1 --2- 172.21.15.8:0/1206429161 >> v2:172.21.15.116:3300/0 conn(0x7f7d900cfde0 0x7f7d900d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d8f7fe640 1 --2- 172.21.15.8:0/1206429161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d9006a4d0 0x7f7d9006a930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d900cbf50 tx=0x7f7d8402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac9e3582db26ea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d8effd640 1 -- 172.21.15.8:0/1206429161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84031860 con 0x7f7d9006a4d0 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d8effd640 1 -- 172.21.15.8:0/1206429161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840319c0 con 0x7f7d9006a4d0 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d8effd640 1 -- 172.21.15.8:0/1206429161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84031d50 con 0x7f7d9006a4d0 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 -- 172.21.15.8:0/1206429161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d9006a4d0 msgr2=0x7f7d9006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 --2- 172.21.15.8:0/1206429161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d9006a4d0 0x7f7d9006a930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d900cbf50 tx=0x7f7d8402b900 comp rx=0 tx=0).stop 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 -- 172.21.15.8:0/1206429161 shutdown_connections 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 --2- 172.21.15.8:0/1206429161 >> v2:172.21.15.116:3300/0 conn(0x7f7d900cfde0 0x7f7d900d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 --2- 172.21.15.8:0/1206429161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d9006a4d0 0x7f7d9006a930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 --2- 172.21.15.8:0/1206429161 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d9015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 -- 172.21.15.8:0/1206429161 >> 172.21.15.8:0/1206429161 conn(0x7f7d900cc930 msgr2=0x7f7d900ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:15.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 -- 172.21.15.8:0/1206429161 shutdown_connections 2023-11-18T23:41:15.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.753+0000 7f7d965e3640 1 -- 172.21.15.8:0/1206429161 wait complete. 2023-11-18T23:41:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 Processor -- start 2023-11-18T23:41:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 -- start start 2023-11-18T23:41:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d9006a4d0 0x7f7d9014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d900cfde0 0x7f7d90139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d900b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9013bdb0 con 0x7f7d900cfde0 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9013c090 con 0x7f7d9006a4d0 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.755+0000 7f7d965e3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9013c370 con 0x7f7d90144a50 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d900cfde0 0x7f7d90139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d900cfde0 0x7f7d90139d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34792/0 (socket says 172.21.15.8:34792) 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/2844157641 learned_addr learned my addr 172.21.15.8:0/2844157641 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d94b80640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d900b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8ffff640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d9006a4d0 0x7f7d9014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 msgr2=0x7f7d900b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d900b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d9006a4d0 msgr2=0x7f7d9014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d9006a4d0 0x7f7d9014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 -- 172.21.15.8:0/2844157641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840094d0 con 0x7f7d900cfde0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8f7fe640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d900cfde0 0x7f7d90139d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7d84000c00 tx=0x7f7d840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8cff9640 1 -- 172.21.15.8:0/2844157641 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84031830 con 0x7f7d900cfde0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8cff9640 1 -- 172.21.15.8:0/2844157641 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840443f0 con 0x7f7d900cfde0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9013c650 con 0x7f7d900cfde0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d8cff9640 1 -- 172.21.15.8:0/2844157641 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840447a0 con 0x7f7d900cfde0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.756+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9013ba60 con 0x7f7d900cfde0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.757+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9015f950 con 0x7f7d900cfde0 2023-11-18T23:41:15.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.758+0000 7f7d8cff9640 1 -- 172.21.15.8:0/2844157641 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d8404d450 con 0x7f7d900cfde0 2023-11-18T23:41:15.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.758+0000 7f7d8cff9640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7d7c06ae40 0x7f7d7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:15.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.758+0000 7f7d8cff9640 1 -- 172.21.15.8:0/2844157641 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d840abcc0 con 0x7f7d900cfde0 2023-11-18T23:41:15.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.758+0000 7f7d8ffff640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7d7c06ae40 0x7f7d7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:15.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.759+0000 7f7d8ffff640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7d7c06ae40 0x7f7d7c06d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000a950 tx=0x7f7d80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:15.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.762+0000 7f7d8cff9640 1 -- 172.21.15.8:0/2844157641 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d84076e00 con 0x7f7d900cfde0 2023-11-18T23:41:15.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.934+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d9013c200 con 0x7f7d7c06ae40 2023-11-18T23:41:15.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.942+0000 7f7d8cff9640 1 -- 172.21.15.8:0/2844157641 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264690 (secure 0 0 0) 0x7f7d9013c200 con 0x7f7d7c06ae40 2023-11-18T23:41:15.946 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:15.948 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:41:15.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7d7c06ae40 msgr2=0x7f7d7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7d7c06ae40 0x7f7d7c06d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000a950 tx=0x7f7d80008040 comp rx=0 tx=0).stop 2023-11-18T23:41:15.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d900cfde0 msgr2=0x7f7d90139d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:15.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d900cfde0 0x7f7d90139d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7d84000c00 tx=0x7f7d840046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 shutdown_connections 2023-11-18T23:41:15.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7d7c06ae40 0x7f7d7c06d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d90144a50 0x7f7d900b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d900cfde0 0x7f7d90139d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 --2- 172.21.15.8:0/2844157641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d9006a4d0 0x7f7d9014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:15.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 >> 172.21.15.8:0/2844157641 conn(0x7f7d900cc930 msgr2=0x7f7d9006f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:15.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 shutdown_connections 2023-11-18T23:41:15.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:15.945+0000 7f7d965e3640 1 -- 172.21.15.8:0/2844157641 wait complete. 2023-11-18T23:41:15.957 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-18T23:41:15.243889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235544,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739176,"statfs":{"total":773094113280,"available":772852916224,"internally_reserved":0,"allocated":2793472,"data_stored":1702436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.309529"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171816+0000","last_change":"2023-11-18T23:41:11.946811+0000","last_active":"2023-11-18T23:41:13.171816+0000","last_peered":"2023-11-18T23:41:13.171816+0000","last_clean":"2023-11-18T23:41:13.171816+0000","last_became_active":"2023-11-18T23:41:11.946364+0000","last_became_peered":"2023-11-18T23:41:11.946364+0000","last_unstale":"2023-11-18T23:41:13.171816+0000","last_undegraded":"2023-11-18T23:41:13.171816+0000","last_fullsized":"2023-11-18T23:41:13.171816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:01:13.637927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942179+0000","last_change":"2023-11-18T23:41:11.940115+0000","last_active":"2023-11-18T23:41:11.942179+0000","last_peered":"2023-11-18T23:41:11.942179+0000","last_clean":"2023-11-18T23:41:11.942179+0000","last_became_active":"2023-11-18T23:41:11.939851+0000","last_became_peered":"2023-11-18T23:41:11.939851+0000","last_unstale":"2023-11-18T23:41:11.942179+0000","last_undegraded":"2023-11-18T23:41:11.942179+0000","last_fullsized":"2023-11-18T23:41:11.942179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:42:00.578989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924769+0000","last_change":"2023-11-18T23:41:11.933794+0000","last_active":"2023-11-18T23:41:12.924769+0000","last_peered":"2023-11-18T23:41:12.924769+0000","last_clean":"2023-11-18T23:41:12.924769+0000","last_became_active":"2023-11-18T23:41:11.931711+0000","last_became_peered":"2023-11-18T23:41:11.931711+0000","last_unstale":"2023-11-18T23:41:12.924769+0000","last_undegraded":"2023-11-18T23:41:12.924769+0000","last_fullsized":"2023-11-18T23:41:12.924769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926073+0000","last_change":"2023-11-18T23:41:11.941706+0000","last_active":"2023-11-18T23:41:12.926073+0000","last_peered":"2023-11-18T23:41:12.926073+0000","last_clean":"2023-11-18T23:41:12.926073+0000","last_became_active":"2023-11-18T23:41:11.941441+0000","last_became_peered":"2023-11-18T23:41:11.941441+0000","last_unstale":"2023-11-18T23:41:12.926073+0000","last_undegraded":"2023-11-18T23:41:12.926073+0000","last_fullsized":"2023-11-18T23:41:12.926073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171510+0000","last_change":"2023-11-18T23:41:11.940717+0000","last_active":"2023-11-18T23:41:13.171510+0000","last_peered":"2023-11-18T23:41:13.171510+0000","last_clean":"2023-11-18T23:41:13.171510+0000","last_became_active":"2023-11-18T23:41:11.939288+0000","last_became_peered":"2023-11-18T23:41:11.939288+0000","last_unstale":"2023-11-18T23:41:13.171510+0000","last_undegraded":"2023-11-18T23:41:13.171510+0000","last_fullsized":"2023-11-18T23:41:13.171510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925518+0000","last_change":"2023-11-18T23:41:11.938211+0000","last_active":"2023-11-18T23:41:12.925518+0000","last_peered":"2023-11-18T23:41:12.925518+0000","last_clean":"2023-11-18T23:41:12.925518+0000","last_became_active":"2023-11-18T23:41:11.937953+0000","last_became_peered":"2023-11-18T23:41:11.937953+0000","last_unstale":"2023-11-18T23:41:12.925518+0000","last_undegraded":"2023-11-18T23:41:12.925518+0000","last_fullsized":"2023-11-18T23:41:12.925518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171265+0000","last_change":"2023-11-18T23:41:11.943648+0000","last_active":"2023-11-18T23:41:13.171265+0000","last_peered":"2023-11-18T23:41:13.171265+0000","last_clean":"2023-11-18T23:41:13.171265+0000","last_became_active":"2023-11-18T23:41:11.943321+0000","last_became_peered":"2023-11-18T23:41:11.943321+0000","last_unstale":"2023-11-18T23:41:13.171265+0000","last_undegraded":"2023-11-18T23:41:13.171265+0000","last_fullsized":"2023-11-18T23:41:13.171265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925699+0000","last_change":"2023-11-18T23:41:11.944907+0000","last_active":"2023-11-18T23:41:12.925699+0000","last_peered":"2023-11-18T23:41:12.925699+0000","last_clean":"2023-11-18T23:41:12.925699+0000","last_became_active":"2023-11-18T23:41:11.944546+0000","last_became_peered":"2023-11-18T23:41:11.944546+0000","last_unstale":"2023-11-18T23:41:12.925699+0000","last_undegraded":"2023-11-18T23:41:12.925699+0000","last_fullsized":"2023-11-18T23:41:12.925699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171795+0000","last_change":"2023-11-18T23:41:11.945133+0000","last_active":"2023-11-18T23:41:13.171795+0000","last_peered":"2023-11-18T23:41:13.171795+0000","last_clean":"2023-11-18T23:41:13.171795+0000","last_became_active":"2023-11-18T23:41:11.944763+0000","last_became_peered":"2023-11-18T23:41:11.944763+0000","last_unstale":"2023-11-18T23:41:13.171795+0000","last_undegraded":"2023-11-18T23:41:13.171795+0000","last_fullsized":"2023-11-18T23:41:13.171795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:21.419360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.949139+0000","last_change":"2023-11-18T23:41:11.945314+0000","last_active":"2023-11-18T23:41:11.949139+0000","last_peered":"2023-11-18T23:41:11.949139+0000","last_clean":"2023-11-18T23:41:11.949139+0000","last_became_active":"2023-11-18T23:41:11.945040+0000","last_became_peered":"2023-11-18T23:41:11.945040+0000","last_unstale":"2023-11-18T23:41:11.949139+0000","last_undegraded":"2023-11-18T23:41:11.949139+0000","last_fullsized":"2023-11-18T23:41:11.949139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942630+0000","last_change":"2023-11-18T23:41:11.939307+0000","last_active":"2023-11-18T23:41:11.942630+0000","last_peered":"2023-11-18T23:41:11.942630+0000","last_clean":"2023-11-18T23:41:11.942630+0000","last_became_active":"2023-11-18T23:41:11.939039+0000","last_became_peered":"2023-11-18T23:41:11.939039+0000","last_unstale":"2023-11-18T23:41:11.942630+0000","last_undegraded":"2023-11-18T23:41:11.942630+0000","last_fullsized":"2023-11-18T23:41:11.942630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941951+0000","last_change":"2023-11-18T23:41:11.940131+0000","last_active":"2023-11-18T23:41:11.941951+0000","last_peered":"2023-11-18T23:41:11.941951+0000","last_clean":"2023-11-18T23:41:11.941951+0000","last_became_active":"2023-11-18T23:41:11.939870+0000","last_became_peered":"2023-11-18T23:41:11.939870+0000","last_unstale":"2023-11-18T23:41:11.941951+0000","last_undegraded":"2023-11-18T23:41:11.941951+0000","last_fullsized":"2023-11-18T23:41:11.941951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:40:41.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925790+0000","last_change":"2023-11-18T23:41:11.940144+0000","last_active":"2023-11-18T23:41:12.925790+0000","last_peered":"2023-11-18T23:41:12.925790+0000","last_clean":"2023-11-18T23:41:12.925790+0000","last_became_active":"2023-11-18T23:41:11.939856+0000","last_became_peered":"2023-11-18T23:41:11.939856+0000","last_unstale":"2023-11-18T23:41:12.925790+0000","last_undegraded":"2023-11-18T23:41:12.925790+0000","last_fullsized":"2023-11-18T23:41:12.925790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924731+0000","last_change":"2023-11-18T23:41:11.934160+0000","last_active":"2023-11-18T23:41:12.924731+0000","last_peered":"2023-11-18T23:41:12.924731+0000","last_clean":"2023-11-18T23:41:12.924731+0000","last_became_active":"2023-11-18T23:41:11.933765+0000","last_became_peered":"2023-11-18T23:41:11.933765+0000","last_unstale":"2023-11-18T23:41:12.924731+0000","last_undegraded":"2023-11-18T23:41:12.924731+0000","last_fullsized":"2023-11-18T23:41:12.924731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:13.836738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941020+0000","last_change":"2023-11-18T23:41:11.936206+0000","last_active":"2023-11-18T23:41:11.941020+0000","last_peered":"2023-11-18T23:41:11.941020+0000","last_clean":"2023-11-18T23:41:11.941020+0000","last_became_active":"2023-11-18T23:41:11.935928+0000","last_became_peered":"2023-11-18T23:41:11.935928+0000","last_unstale":"2023-11-18T23:41:11.941020+0000","last_undegraded":"2023-11-18T23:41:11.941020+0000","last_fullsized":"2023-11-18T23:41:11.941020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925537+0000","last_change":"2023-11-18T23:41:11.933938+0000","last_active":"2023-11-18T23:41:12.925537+0000","last_peered":"2023-11-18T23:41:12.925537+0000","last_clean":"2023-11-18T23:41:12.925537+0000","last_became_active":"2023-11-18T23:41:11.933650+0000","last_became_peered":"2023-11-18T23:41:11.933650+0000","last_unstale":"2023-11-18T23:41:12.925537+0000","last_undegraded":"2023-11-18T23:41:12.925537+0000","last_fullsized":"2023-11-18T23:41:12.925537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926339+0000","last_change":"2023-11-18T23:41:11.939059+0000","last_active":"2023-11-18T23:41:12.926339+0000","last_peered":"2023-11-18T23:41:12.926339+0000","last_clean":"2023-11-18T23:41:12.926339+0000","last_became_active":"2023-11-18T23:41:11.938794+0000","last_became_peered":"2023-11-18T23:41:11.938794+0000","last_unstale":"2023-11-18T23:41:12.926339+0000","last_undegraded":"2023-11-18T23:41:12.926339+0000","last_fullsized":"2023-11-18T23:41:12.926339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942370+0000","last_change":"2023-11-18T23:41:11.940827+0000","last_active":"2023-11-18T23:41:11.942370+0000","last_peered":"2023-11-18T23:41:11.942370+0000","last_clean":"2023-11-18T23:41:11.942370+0000","last_became_active":"2023-11-18T23:41:11.940536+0000","last_became_peered":"2023-11-18T23:41:11.940536+0000","last_unstale":"2023-11-18T23:41:11.942370+0000","last_undegraded":"2023-11-18T23:41:11.942370+0000","last_fullsized":"2023-11-18T23:41:11.942370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:40:41.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171737+0000","last_change":"2023-11-18T23:41:11.940969+0000","last_active":"2023-11-18T23:41:13.171737+0000","last_peered":"2023-11-18T23:41:13.171737+0000","last_clean":"2023-11-18T23:41:13.171737+0000","last_became_active":"2023-11-18T23:41:11.940183+0000","last_became_peered":"2023-11-18T23:41:11.940183+0000","last_unstale":"2023-11-18T23:41:13.171737+0000","last_undegraded":"2023-11-18T23:41:13.171737+0000","last_fullsized":"2023-11-18T23:41:13.171737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.943302+0000","last_change":"2023-11-18T23:41:11.941178+0000","last_active":"2023-11-18T23:41:11.943302+0000","last_peered":"2023-11-18T23:41:11.943302+0000","last_clean":"2023-11-18T23:41:11.943302+0000","last_became_active":"2023-11-18T23:41:11.940898+0000","last_became_peered":"2023-11-18T23:41:11.940898+0000","last_unstale":"2023-11-18T23:41:11.943302+0000","last_undegraded":"2023-11-18T23:41:11.943302+0000","last_fullsized":"2023-11-18T23:41:11.943302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:13.836738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924966+0000","last_change":"2023-11-18T23:41:11.942903+0000","last_active":"2023-11-18T23:41:12.924966+0000","last_peered":"2023-11-18T23:41:12.924966+0000","last_clean":"2023-11-18T23:41:12.924966+0000","last_became_active":"2023-11-18T23:41:11.942534+0000","last_became_peered":"2023-11-18T23:41:11.942534+0000","last_unstale":"2023-11-18T23:41:12.924966+0000","last_undegraded":"2023-11-18T23:41:12.924966+0000","last_fullsized":"2023-11-18T23:41:12.924966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925720+0000","last_change":"2023-11-18T23:41:11.944563+0000","last_active":"2023-11-18T23:41:12.925720+0000","last_peered":"2023-11-18T23:41:12.925720+0000","last_clean":"2023-11-18T23:41:12.925720+0000","last_became_active":"2023-11-18T23:41:11.943198+0000","last_became_peered":"2023-11-18T23:41:11.943198+0000","last_unstale":"2023-11-18T23:41:12.925720+0000","last_undegraded":"2023-11-18T23:41:12.925720+0000","last_fullsized":"2023-11-18T23:41:12.925720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926277+0000","last_change":"2023-11-18T23:41:11.934900+0000","last_active":"2023-11-18T23:41:12.926277+0000","last_peered":"2023-11-18T23:41:12.926277+0000","last_clean":"2023-11-18T23:41:12.926277+0000","last_became_active":"2023-11-18T23:41:11.934615+0000","last_became_peered":"2023-11-18T23:41:11.934615+0000","last_unstale":"2023-11-18T23:41:12.926277+0000","last_undegraded":"2023-11-18T23:41:12.926277+0000","last_fullsized":"2023-11-18T23:41:12.926277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925552+0000","last_change":"2023-11-18T23:41:11.940124+0000","last_active":"2023-11-18T23:41:12.925552+0000","last_peered":"2023-11-18T23:41:12.925552+0000","last_clean":"2023-11-18T23:41:12.925552+0000","last_became_active":"2023-11-18T23:41:11.939772+0000","last_became_peered":"2023-11-18T23:41:11.939772+0000","last_unstale":"2023-11-18T23:41:12.925552+0000","last_undegraded":"2023-11-18T23:41:12.925552+0000","last_fullsized":"2023-11-18T23:41:12.925552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925849+0000","last_change":"2023-11-18T23:41:11.935614+0000","last_active":"2023-11-18T23:41:12.925849+0000","last_peered":"2023-11-18T23:41:12.925849+0000","last_clean":"2023-11-18T23:41:12.925849+0000","last_became_active":"2023-11-18T23:41:11.935359+0000","last_became_peered":"2023-11-18T23:41:11.935359+0000","last_unstale":"2023-11-18T23:41:12.925849+0000","last_undegraded":"2023-11-18T23:41:12.925849+0000","last_fullsized":"2023-11-18T23:41:12.925849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.946533+0000","last_change":"2023-11-18T23:41:11.942859+0000","last_active":"2023-11-18T23:41:11.946533+0000","last_peered":"2023-11-18T23:41:11.946533+0000","last_clean":"2023-11-18T23:41:11.946533+0000","last_became_active":"2023-11-18T23:41:11.940443+0000","last_became_peered":"2023-11-18T23:41:11.940443+0000","last_unstale":"2023-11-18T23:41:11.946533+0000","last_undegraded":"2023-11-18T23:41:11.946533+0000","last_fullsized":"2023-11-18T23:41:11.946533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:04.851861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942158+0000","last_change":"2023-11-18T23:41:11.939763+0000","last_active":"2023-11-18T23:41:11.942158+0000","last_peered":"2023-11-18T23:41:11.942158+0000","last_clean":"2023-11-18T23:41:11.942158+0000","last_became_active":"2023-11-18T23:41:11.939467+0000","last_became_peered":"2023-11-18T23:41:11.939467+0000","last_unstale":"2023-11-18T23:41:11.942158+0000","last_undegraded":"2023-11-18T23:41:11.942158+0000","last_fullsized":"2023-11-18T23:41:11.942158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:05.668242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926083+0000","last_change":"2023-11-18T23:41:11.938804+0000","last_active":"2023-11-18T23:41:12.926083+0000","last_peered":"2023-11-18T23:41:12.926083+0000","last_clean":"2023-11-18T23:41:12.926083+0000","last_became_active":"2023-11-18T23:41:11.938399+0000","last_became_peered":"2023-11-18T23:41:11.938399+0000","last_unstale":"2023-11-18T23:41:12.926083+0000","last_undegraded":"2023-11-18T23:41:12.926083+0000","last_fullsized":"2023-11-18T23:41:12.926083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924943+0000","last_change":"2023-11-18T23:41:11.938618+0000","last_active":"2023-11-18T23:41:12.924943+0000","last_peered":"2023-11-18T23:41:12.924943+0000","last_clean":"2023-11-18T23:41:12.924943+0000","last_became_active":"2023-11-18T23:41:11.938221+0000","last_became_peered":"2023-11-18T23:41:11.938221+0000","last_unstale":"2023-11-18T23:41:12.924943+0000","last_undegraded":"2023-11-18T23:41:12.924943+0000","last_fullsized":"2023-11-18T23:41:12.924943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925751+0000","last_change":"2023-11-18T23:41:11.939803+0000","last_active":"2023-11-18T23:41:12.925751+0000","last_peered":"2023-11-18T23:41:12.925751+0000","last_clean":"2023-11-18T23:41:12.925751+0000","last_became_active":"2023-11-18T23:41:11.939543+0000","last_became_peered":"2023-11-18T23:41:11.939543+0000","last_unstale":"2023-11-18T23:41:12.925751+0000","last_undegraded":"2023-11-18T23:41:12.925751+0000","last_fullsized":"2023-11-18T23:41:12.925751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.934653+0000","last_change":"2023-11-18T23:41:11.933138+0000","last_active":"2023-11-18T23:41:11.934653+0000","last_peered":"2023-11-18T23:41:11.934653+0000","last_clean":"2023-11-18T23:41:11.934653+0000","last_became_active":"2023-11-18T23:41:11.932851+0000","last_became_peered":"2023-11-18T23:41:11.932851+0000","last_unstale":"2023-11-18T23:41:11.934653+0000","last_undegraded":"2023-11-18T23:41:11.934653+0000","last_fullsized":"2023-11-18T23:41:11.934653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.949152+0000","last_change":"2023-11-18T23:41:11.945502+0000","last_active":"2023-11-18T23:41:11.949152+0000","last_peered":"2023-11-18T23:41:11.949152+0000","last_clean":"2023-11-18T23:41:11.949152+0000","last_became_active":"2023-11-18T23:41:11.944702+0000","last_became_peered":"2023-11-18T23:41:11.944702+0000","last_unstale":"2023-11-18T23:41:11.949152+0000","last_undegraded":"2023-11-18T23:41:11.949152+0000","last_fullsized":"2023-11-18T23:41:11.949152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:06.672979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.937039+0000","last_change":"2023-11-18T23:41:11.935750+0000","last_active":"2023-11-18T23:41:11.937039+0000","last_peered":"2023-11-18T23:41:11.937039+0000","last_clean":"2023-11-18T23:41:11.937039+0000","last_became_active":"2023-11-18T23:41:11.935328+0000","last_became_peered":"2023-11-18T23:41:11.935328+0000","last_unstale":"2023-11-18T23:41:11.937039+0000","last_undegraded":"2023-11-18T23:41:11.937039+0000","last_fullsized":"2023-11-18T23:41:11.937039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:38.222019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925897+0000","last_change":"2023-11-18T23:41:10.953149+0000","last_active":"2023-11-18T23:41:12.925897+0000","last_peered":"2023-11-18T23:41:12.925897+0000","last_clean":"2023-11-18T23:41:12.925897+0000","last_became_active":"2023-11-18T23:41:10.952850+0000","last_became_peered":"2023-11-18T23:41:10.952850+0000","last_unstale":"2023-11-18T23:41:12.925897+0000","last_undegraded":"2023-11-18T23:41:12.925897+0000","last_fullsized":"2023-11-18T23:41:12.925897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925028+0000","last_change":"2023-11-18T23:41:11.932987+0000","last_active":"2023-11-18T23:41:12.925028+0000","last_peered":"2023-11-18T23:41:12.925028+0000","last_clean":"2023-11-18T23:41:12.925028+0000","last_became_active":"2023-11-18T23:41:11.932403+0000","last_became_peered":"2023-11-18T23:41:11.932403+0000","last_unstale":"2023-11-18T23:41:12.925028+0000","last_undegraded":"2023-11-18T23:41:12.925028+0000","last_fullsized":"2023-11-18T23:41:12.925028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961571+0000","last_change":"2023-11-18T23:41:10.949837+0000","last_active":"2023-11-18T23:41:11.961571+0000","last_peered":"2023-11-18T23:41:11.961571+0000","last_clean":"2023-11-18T23:41:11.961571+0000","last_became_active":"2023-11-18T23:41:10.949583+0000","last_became_peered":"2023-11-18T23:41:10.949583+0000","last_unstale":"2023-11-18T23:41:11.961571+0000","last_undegraded":"2023-11-18T23:41:11.961571+0000","last_fullsized":"2023-11-18T23:41:11.961571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:20.074426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926272+0000","last_change":"2023-11-18T23:41:10.948701+0000","last_active":"2023-11-18T23:41:12.926272+0000","last_peered":"2023-11-18T23:41:12.926272+0000","last_clean":"2023-11-18T23:41:12.926272+0000","last_became_active":"2023-11-18T23:41:10.947786+0000","last_became_peered":"2023-11-18T23:41:10.947786+0000","last_unstale":"2023-11-18T23:41:12.926272+0000","last_undegraded":"2023-11-18T23:41:12.926272+0000","last_fullsized":"2023-11-18T23:41:12.926272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925862+0000","last_change":"2023-11-18T23:41:11.935863+0000","last_active":"2023-11-18T23:41:12.925862+0000","last_peered":"2023-11-18T23:41:12.925862+0000","last_clean":"2023-11-18T23:41:12.925862+0000","last_became_active":"2023-11-18T23:41:11.935550+0000","last_became_peered":"2023-11-18T23:41:11.935550+0000","last_unstale":"2023-11-18T23:41:12.925862+0000","last_undegraded":"2023-11-18T23:41:12.925862+0000","last_fullsized":"2023-11-18T23:41:12.925862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925638+0000","last_change":"2023-11-18T23:41:10.944934+0000","last_active":"2023-11-18T23:41:12.925638+0000","last_peered":"2023-11-18T23:41:12.925638+0000","last_clean":"2023-11-18T23:41:12.925638+0000","last_became_active":"2023-11-18T23:41:10.944648+0000","last_became_peered":"2023-11-18T23:41:10.944648+0000","last_unstale":"2023-11-18T23:41:12.925638+0000","last_undegraded":"2023-11-18T23:41:12.925638+0000","last_fullsized":"2023-11-18T23:41:12.925638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941221+0000","last_change":"2023-11-18T23:41:11.937179+0000","last_active":"2023-11-18T23:41:11.941221+0000","last_peered":"2023-11-18T23:41:11.941221+0000","last_clean":"2023-11-18T23:41:11.941221+0000","last_became_active":"2023-11-18T23:41:11.936855+0000","last_became_peered":"2023-11-18T23:41:11.936855+0000","last_unstale":"2023-11-18T23:41:11.941221+0000","last_undegraded":"2023-11-18T23:41:11.941221+0000","last_fullsized":"2023-11-18T23:41:11.941221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:21.079188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.929477+0000","last_change":"2023-11-18T23:41:10.954127+0000","last_active":"2023-11-18T23:41:11.929477+0000","last_peered":"2023-11-18T23:41:11.929477+0000","last_clean":"2023-11-18T23:41:11.929477+0000","last_became_active":"2023-11-18T23:41:10.953785+0000","last_became_peered":"2023-11-18T23:41:10.953785+0000","last_unstale":"2023-11-18T23:41:11.929477+0000","last_undegraded":"2023-11-18T23:41:11.929477+0000","last_fullsized":"2023-11-18T23:41:11.929477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926194+0000","last_change":"2023-11-18T23:41:11.944161+0000","last_active":"2023-11-18T23:41:12.926194+0000","last_peered":"2023-11-18T23:41:12.926194+0000","last_clean":"2023-11-18T23:41:12.926194+0000","last_became_active":"2023-11-18T23:41:11.943897+0000","last_became_peered":"2023-11-18T23:41:11.943897+0000","last_unstale":"2023-11-18T23:41:12.926194+0000","last_undegraded":"2023-11-18T23:41:12.926194+0000","last_fullsized":"2023-11-18T23:41:12.926194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926026+0000","last_change":"2023-11-18T23:41:10.949653+0000","last_active":"2023-11-18T23:41:12.926026+0000","last_peered":"2023-11-18T23:41:12.926026+0000","last_clean":"2023-11-18T23:41:12.926026+0000","last_became_active":"2023-11-18T23:41:10.949342+0000","last_became_peered":"2023-11-18T23:41:10.949342+0000","last_unstale":"2023-11-18T23:41:12.926026+0000","last_undegraded":"2023-11-18T23:41:12.926026+0000","last_fullsized":"2023-11-18T23:41:12.926026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:11.932620+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:11.932076+0000","last_became_peered":"2023-11-18T23:41:11.932076+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.962191+0000","last_change":"2023-11-18T23:41:10.944409+0000","last_active":"2023-11-18T23:41:11.962191+0000","last_peered":"2023-11-18T23:41:11.962191+0000","last_clean":"2023-11-18T23:41:11.962191+0000","last_became_active":"2023-11-18T23:41:10.944114+0000","last_became_peered":"2023-11-18T23:41:10.944114+0000","last_unstale":"2023-11-18T23:41:11.962191+0000","last_undegraded":"2023-11-18T23:41:11.962191+0000","last_fullsized":"2023-11-18T23:41:11.962191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.948101+0000","last_change":"2023-11-18T23:41:11.943003+0000","last_active":"2023-11-18T23:41:11.948101+0000","last_peered":"2023-11-18T23:41:11.948101+0000","last_clean":"2023-11-18T23:41:11.948101+0000","last_became_active":"2023-11-18T23:41:11.942700+0000","last_became_peered":"2023-11-18T23:41:11.942700+0000","last_unstale":"2023-11-18T23:41:11.948101+0000","last_undegraded":"2023-11-18T23:41:11.948101+0000","last_fullsized":"2023-11-18T23:41:11.948101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:36.686430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.963485+0000","last_change":"2023-11-18T23:41:10.949432+0000","last_active":"2023-11-18T23:41:11.963485+0000","last_peered":"2023-11-18T23:41:11.963485+0000","last_clean":"2023-11-18T23:41:11.963485+0000","last_became_active":"2023-11-18T23:41:10.949070+0000","last_became_peered":"2023-11-18T23:41:10.949070+0000","last_unstale":"2023-11-18T23:41:11.963485+0000","last_undegraded":"2023-11-18T23:41:11.963485+0000","last_fullsized":"2023-11-18T23:41:11.963485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171506+0000","last_change":"2023-11-18T23:41:11.944440+0000","last_active":"2023-11-18T23:41:13.171506+0000","last_peered":"2023-11-18T23:41:13.171506+0000","last_clean":"2023-11-18T23:41:13.171506+0000","last_became_active":"2023-11-18T23:41:11.944144+0000","last_became_peered":"2023-11-18T23:41:11.944144+0000","last_unstale":"2023-11-18T23:41:13.171506+0000","last_undegraded":"2023-11-18T23:41:13.171506+0000","last_fullsized":"2023-11-18T23:41:13.171506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925055+0000","last_change":"2023-11-18T23:41:10.953937+0000","last_active":"2023-11-18T23:41:12.925055+0000","last_peered":"2023-11-18T23:41:12.925055+0000","last_clean":"2023-11-18T23:41:12.925055+0000","last_became_active":"2023-11-18T23:41:10.953500+0000","last_became_peered":"2023-11-18T23:41:10.953500+0000","last_unstale":"2023-11-18T23:41:12.925055+0000","last_undegraded":"2023-11-18T23:41:12.925055+0000","last_fullsized":"2023-11-18T23:41:12.925055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924751+0000","last_change":"2023-11-18T23:41:11.941920+0000","last_active":"2023-11-18T23:41:12.924751+0000","last_peered":"2023-11-18T23:41:12.924751+0000","last_clean":"2023-11-18T23:41:12.924751+0000","last_became_active":"2023-11-18T23:41:11.941599+0000","last_became_peered":"2023-11-18T23:41:11.941599+0000","last_unstale":"2023-11-18T23:41:12.924751+0000","last_undegraded":"2023-11-18T23:41:12.924751+0000","last_fullsized":"2023-11-18T23:41:12.924751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:46.123581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925846+0000","last_change":"2023-11-18T23:41:10.948691+0000","last_active":"2023-11-18T23:41:12.925846+0000","last_peered":"2023-11-18T23:41:12.925846+0000","last_clean":"2023-11-18T23:41:12.925846+0000","last_became_active":"2023-11-18T23:41:10.948397+0000","last_became_peered":"2023-11-18T23:41:10.948397+0000","last_unstale":"2023-11-18T23:41:12.925846+0000","last_undegraded":"2023-11-18T23:41:12.925846+0000","last_fullsized":"2023-11-18T23:41:12.925846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:06.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171508+0000","last_change":"2023-11-18T23:41:11.942006+0000","last_active":"2023-11-18T23:41:13.171508+0000","last_peered":"2023-11-18T23:41:13.171508+0000","last_clean":"2023-11-18T23:41:13.171508+0000","last_became_active":"2023-11-18T23:41:11.941752+0000","last_became_peered":"2023-11-18T23:41:11.941752+0000","last_unstale":"2023-11-18T23:41:13.171508+0000","last_undegraded":"2023-11-18T23:41:13.171508+0000","last_fullsized":"2023-11-18T23:41:13.171508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.930020+0000","last_change":"2023-11-18T23:41:10.948626+0000","last_active":"2023-11-18T23:41:11.930020+0000","last_peered":"2023-11-18T23:41:11.930020+0000","last_clean":"2023-11-18T23:41:11.930020+0000","last_became_active":"2023-11-18T23:41:10.948356+0000","last_became_peered":"2023-11-18T23:41:10.948356+0000","last_unstale":"2023-11-18T23:41:11.930020+0000","last_undegraded":"2023-11-18T23:41:11.930020+0000","last_fullsized":"2023-11-18T23:41:11.930020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.949132+0000","last_change":"2023-11-18T23:41:11.945196+0000","last_active":"2023-11-18T23:41:11.949132+0000","last_peered":"2023-11-18T23:41:11.949132+0000","last_clean":"2023-11-18T23:41:11.949132+0000","last_became_active":"2023-11-18T23:41:11.944330+0000","last_became_peered":"2023-11-18T23:41:11.944330+0000","last_unstale":"2023-11-18T23:41:11.949132+0000","last_undegraded":"2023-11-18T23:41:11.949132+0000","last_fullsized":"2023-11-18T23:41:11.949132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:05.668242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.963494+0000","last_change":"2023-11-18T23:41:10.949827+0000","last_active":"2023-11-18T23:41:11.963494+0000","last_peered":"2023-11-18T23:41:11.963494+0000","last_clean":"2023-11-18T23:41:11.963494+0000","last_became_active":"2023-11-18T23:41:10.949513+0000","last_became_peered":"2023-11-18T23:41:10.949513+0000","last_unstale":"2023-11-18T23:41:11.963494+0000","last_undegraded":"2023-11-18T23:41:11.963494+0000","last_fullsized":"2023-11-18T23:41:11.963494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:08.933359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171323+0000","last_change":"2023-11-18T23:41:11.942116+0000","last_active":"2023-11-18T23:41:13.171323+0000","last_peered":"2023-11-18T23:41:13.171323+0000","last_clean":"2023-11-18T23:41:13.171323+0000","last_became_active":"2023-11-18T23:41:11.940777+0000","last_became_peered":"2023-11-18T23:41:11.940777+0000","last_unstale":"2023-11-18T23:41:13.171323+0000","last_undegraded":"2023-11-18T23:41:13.171323+0000","last_fullsized":"2023-11-18T23:41:13.171323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961139+0000","last_change":"2023-11-18T23:41:10.952130+0000","last_active":"2023-11-18T23:41:11.961139+0000","last_peered":"2023-11-18T23:41:11.961139+0000","last_clean":"2023-11-18T23:41:11.961139+0000","last_became_active":"2023-11-18T23:41:10.951783+0000","last_became_peered":"2023-11-18T23:41:10.951783+0000","last_unstale":"2023-11-18T23:41:11.961139+0000","last_undegraded":"2023-11-18T23:41:11.961139+0000","last_fullsized":"2023-11-18T23:41:11.961139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171739+0000","last_change":"2023-11-18T23:41:11.941524+0000","last_active":"2023-11-18T23:41:13.171739+0000","last_peered":"2023-11-18T23:41:13.171739+0000","last_clean":"2023-11-18T23:41:13.171739+0000","last_became_active":"2023-11-18T23:41:11.941261+0000","last_became_peered":"2023-11-18T23:41:11.941261+0000","last_unstale":"2023-11-18T23:41:13.171739+0000","last_undegraded":"2023-11-18T23:41:13.171739+0000","last_fullsized":"2023-11-18T23:41:13.171739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.962636+0000","last_change":"2023-11-18T23:41:10.948977+0000","last_active":"2023-11-18T23:41:11.962636+0000","last_peered":"2023-11-18T23:41:11.962636+0000","last_clean":"2023-11-18T23:41:11.962636+0000","last_became_active":"2023-11-18T23:41:10.948618+0000","last_became_peered":"2023-11-18T23:41:10.948618+0000","last_unstale":"2023-11-18T23:41:11.962636+0000","last_undegraded":"2023-11-18T23:41:11.962636+0000","last_fullsized":"2023-11-18T23:41:11.962636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:05.668218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171873+0000","last_change":"2023-11-18T23:41:11.945585+0000","last_active":"2023-11-18T23:41:13.171873+0000","last_peered":"2023-11-18T23:41:13.171873+0000","last_clean":"2023-11-18T23:41:13.171873+0000","last_became_active":"2023-11-18T23:41:11.945267+0000","last_became_peered":"2023-11-18T23:41:11.945267+0000","last_unstale":"2023-11-18T23:41:13.171873+0000","last_undegraded":"2023-11-18T23:41:13.171873+0000","last_fullsized":"2023-11-18T23:41:13.171873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:32.618829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961158+0000","last_change":"2023-11-18T23:41:10.948326+0000","last_active":"2023-11-18T23:41:11.961158+0000","last_peered":"2023-11-18T23:41:11.961158+0000","last_clean":"2023-11-18T23:41:11.961158+0000","last_became_active":"2023-11-18T23:41:10.947924+0000","last_became_peered":"2023-11-18T23:41:10.947924+0000","last_unstale":"2023-11-18T23:41:11.961158+0000","last_undegraded":"2023-11-18T23:41:11.961158+0000","last_fullsized":"2023-11-18T23:41:11.961158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926090+0000","last_change":"2023-11-18T23:41:11.941133+0000","last_active":"2023-11-18T23:41:12.926090+0000","last_peered":"2023-11-18T23:41:12.926090+0000","last_clean":"2023-11-18T23:41:12.926090+0000","last_became_active":"2023-11-18T23:41:11.940871+0000","last_became_peered":"2023-11-18T23:41:11.940871+0000","last_unstale":"2023-11-18T23:41:12.926090+0000","last_undegraded":"2023-11-18T23:41:12.926090+0000","last_fullsized":"2023-11-18T23:41:12.926090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.927581+0000","last_change":"2023-11-18T23:41:10.951625+0000","last_active":"2023-11-18T23:41:11.927581+0000","last_peered":"2023-11-18T23:41:11.927581+0000","last_clean":"2023-11-18T23:41:11.927581+0000","last_became_active":"2023-11-18T23:41:10.951341+0000","last_became_peered":"2023-11-18T23:41:10.951341+0000","last_unstale":"2023-11-18T23:41:11.927581+0000","last_undegraded":"2023-11-18T23:41:11.927581+0000","last_fullsized":"2023-11-18T23:41:11.927581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171564+0000","last_change":"2023-11-18T23:41:11.946155+0000","last_active":"2023-11-18T23:41:13.171564+0000","last_peered":"2023-11-18T23:41:13.171564+0000","last_clean":"2023-11-18T23:41:13.171564+0000","last_became_active":"2023-11-18T23:41:11.945888+0000","last_became_peered":"2023-11-18T23:41:11.945888+0000","last_unstale":"2023-11-18T23:41:13.171564+0000","last_undegraded":"2023-11-18T23:41:13.171564+0000","last_fullsized":"2023-11-18T23:41:13.171564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.935408+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:41:11.935408+0000","last_peered":"2023-11-18T23:41:11.935408+0000","last_clean":"2023-11-18T23:41:11.935408+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:41:11.935408+0000","last_undegraded":"2023-11-18T23:41:11.935408+0000","last_fullsized":"2023-11-18T23:41:11.935408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925730+0000","last_change":"2023-11-18T23:41:10.950732+0000","last_active":"2023-11-18T23:41:12.925730+0000","last_peered":"2023-11-18T23:41:12.925730+0000","last_clean":"2023-11-18T23:41:12.925730+0000","last_became_active":"2023-11-18T23:41:10.950412+0000","last_became_peered":"2023-11-18T23:41:10.950412+0000","last_unstale":"2023-11-18T23:41:12.925730+0000","last_undegraded":"2023-11-18T23:41:12.925730+0000","last_fullsized":"2023-11-18T23:41:12.925730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925876+0000","last_change":"2023-11-18T23:41:11.944801+0000","last_active":"2023-11-18T23:41:12.925876+0000","last_peered":"2023-11-18T23:41:12.925876+0000","last_clean":"2023-11-18T23:41:12.925876+0000","last_became_active":"2023-11-18T23:41:11.944571+0000","last_became_peered":"2023-11-18T23:41:11.944571+0000","last_unstale":"2023-11-18T23:41:12.925876+0000","last_undegraded":"2023-11-18T23:41:12.925876+0000","last_fullsized":"2023-11-18T23:41:12.925876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.953232+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.952918+0000","last_became_peered":"2023-11-18T23:41:10.952918+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924571+0000","last_change":"2023-11-18T23:41:11.936302+0000","last_active":"2023-11-18T23:41:12.924571+0000","last_peered":"2023-11-18T23:41:12.924571+0000","last_clean":"2023-11-18T23:41:12.924571+0000","last_became_active":"2023-11-18T23:41:11.935466+0000","last_became_peered":"2023-11-18T23:41:11.935466+0000","last_unstale":"2023-11-18T23:41:12.924571+0000","last_undegraded":"2023-11-18T23:41:12.924571+0000","last_fullsized":"2023-11-18T23:41:12.924571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:30.278282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.928158+0000","last_change":"2023-11-18T23:41:10.949423+0000","last_active":"2023-11-18T23:41:11.928158+0000","last_peered":"2023-11-18T23:41:11.928158+0000","last_clean":"2023-11-18T23:41:11.928158+0000","last_became_active":"2023-11-18T23:41:10.949116+0000","last_became_peered":"2023-11-18T23:41:10.949116+0000","last_unstale":"2023-11-18T23:41:11.928158+0000","last_undegraded":"2023-11-18T23:41:11.928158+0000","last_fullsized":"2023-11-18T23:41:11.928158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942031+0000","last_change":"2023-11-18T23:41:11.938131+0000","last_active":"2023-11-18T23:41:11.942031+0000","last_peered":"2023-11-18T23:41:11.942031+0000","last_clean":"2023-11-18T23:41:11.942031+0000","last_became_active":"2023-11-18T23:41:11.937846+0000","last_became_peered":"2023-11-18T23:41:11.937846+0000","last_unstale":"2023-11-18T23:41:11.942031+0000","last_undegraded":"2023-11-18T23:41:11.942031+0000","last_fullsized":"2023-11-18T23:41:11.942031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926059+0000","last_change":"2023-11-18T23:41:10.940990+0000","last_active":"2023-11-18T23:41:12.926059+0000","last_peered":"2023-11-18T23:41:12.926059+0000","last_clean":"2023-11-18T23:41:12.926059+0000","last_became_active":"2023-11-18T23:41:10.940710+0000","last_became_peered":"2023-11-18T23:41:10.940710+0000","last_unstale":"2023-11-18T23:41:12.926059+0000","last_undegraded":"2023-11-18T23:41:12.926059+0000","last_fullsized":"2023-11-18T23:41:12.926059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:19.427443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941869+0000","last_change":"2023-11-18T23:41:11.938142+0000","last_active":"2023-11-18T23:41:11.941869+0000","last_peered":"2023-11-18T23:41:11.941869+0000","last_clean":"2023-11-18T23:41:11.941869+0000","last_became_active":"2023-11-18T23:41:11.937563+0000","last_became_peered":"2023-11-18T23:41:11.937563+0000","last_unstale":"2023-11-18T23:41:11.941869+0000","last_undegraded":"2023-11-18T23:41:11.941869+0000","last_fullsized":"2023-11-18T23:41:11.941869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:02.723199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.931690+0000","last_change":"2023-11-18T23:41:10.949142+0000","last_active":"2023-11-18T23:41:11.931690+0000","last_peered":"2023-11-18T23:41:11.931690+0000","last_clean":"2023-11-18T23:41:11.931690+0000","last_became_active":"2023-11-18T23:41:10.948855+0000","last_became_peered":"2023-11-18T23:41:10.948855+0000","last_unstale":"2023-11-18T23:41:11.931690+0000","last_undegraded":"2023-11-18T23:41:11.931690+0000","last_fullsized":"2023-11-18T23:41:11.931690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:03.847100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926199+0000","last_change":"2023-11-18T23:41:11.941744+0000","last_active":"2023-11-18T23:41:12.926199+0000","last_peered":"2023-11-18T23:41:12.926199+0000","last_clean":"2023-11-18T23:41:12.926199+0000","last_became_active":"2023-11-18T23:41:11.941469+0000","last_became_peered":"2023-11-18T23:41:11.941469+0000","last_unstale":"2023-11-18T23:41:12.926199+0000","last_undegraded":"2023-11-18T23:41:12.926199+0000","last_fullsized":"2023-11-18T23:41:12.926199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171719+0000","last_change":"2023-11-18T23:41:10.955650+0000","last_active":"2023-11-18T23:41:13.171719+0000","last_peered":"2023-11-18T23:41:13.171719+0000","last_clean":"2023-11-18T23:41:13.171719+0000","last_became_active":"2023-11-18T23:41:10.955331+0000","last_became_peered":"2023-11-18T23:41:10.955331+0000","last_unstale":"2023-11-18T23:41:13.171719+0000","last_undegraded":"2023-11-18T23:41:13.171719+0000","last_fullsized":"2023-11-18T23:41:13.171719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:50.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.935646+0000","last_change":"2023-11-18T23:41:11.934954+0000","last_active":"2023-11-18T23:41:11.935646+0000","last_peered":"2023-11-18T23:41:11.935646+0000","last_clean":"2023-11-18T23:41:11.935646+0000","last_became_active":"2023-11-18T23:41:11.934651+0000","last_became_peered":"2023-11-18T23:41:11.934651+0000","last_unstale":"2023-11-18T23:41:11.935646+0000","last_undegraded":"2023-11-18T23:41:11.935646+0000","last_fullsized":"2023-11-18T23:41:11.935646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:06.672979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.932484+0000","last_change":"2023-11-18T23:41:10.947031+0000","last_active":"2023-11-18T23:41:11.932484+0000","last_peered":"2023-11-18T23:41:11.932484+0000","last_clean":"2023-11-18T23:41:11.932484+0000","last_became_active":"2023-11-18T23:41:10.946758+0000","last_became_peered":"2023-11-18T23:41:10.946758+0000","last_unstale":"2023-11-18T23:41:11.932484+0000","last_undegraded":"2023-11-18T23:41:11.932484+0000","last_fullsized":"2023-11-18T23:41:11.932484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925991+0000","last_change":"2023-11-18T23:41:11.941903+0000","last_active":"2023-11-18T23:41:12.925991+0000","last_peered":"2023-11-18T23:41:12.925991+0000","last_clean":"2023-11-18T23:41:12.925991+0000","last_became_active":"2023-11-18T23:41:11.941319+0000","last_became_peered":"2023-11-18T23:41:11.941319+0000","last_unstale":"2023-11-18T23:41:12.925991+0000","last_undegraded":"2023-11-18T23:41:12.925991+0000","last_fullsized":"2023-11-18T23:41:12.925991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961847+0000","last_change":"2023-11-18T23:41:10.953396+0000","last_active":"2023-11-18T23:41:11.961847+0000","last_peered":"2023-11-18T23:41:11.961847+0000","last_clean":"2023-11-18T23:41:11.961847+0000","last_became_active":"2023-11-18T23:41:10.952840+0000","last_became_peered":"2023-11-18T23:41:10.952840+0000","last_unstale":"2023-11-18T23:41:11.961847+0000","last_undegraded":"2023-11-18T23:41:11.961847+0000","last_fullsized":"2023-11-18T23:41:11.961847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924847+0000","last_change":"2023-11-18T23:41:11.938451+0000","last_active":"2023-11-18T23:41:12.924847+0000","last_peered":"2023-11-18T23:41:12.924847+0000","last_clean":"2023-11-18T23:41:12.924847+0000","last_became_active":"2023-11-18T23:41:11.938166+0000","last_became_peered":"2023-11-18T23:41:11.938166+0000","last_unstale":"2023-11-18T23:41:12.924847+0000","last_undegraded":"2023-11-18T23:41:12.924847+0000","last_fullsized":"2023-11-18T23:41:12.924847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.955647+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.955339+0000","last_became_peered":"2023-11-18T23:41:10.955339+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:33.115860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.937065+0000","last_change":"2023-11-18T23:41:11.935837+0000","last_active":"2023-11-18T23:41:11.937065+0000","last_peered":"2023-11-18T23:41:11.937065+0000","last_clean":"2023-11-18T23:41:11.937065+0000","last_became_active":"2023-11-18T23:41:11.935574+0000","last_became_peered":"2023-11-18T23:41:11.935574+0000","last_unstale":"2023-11-18T23:41:11.937065+0000","last_undegraded":"2023-11-18T23:41:11.937065+0000","last_fullsized":"2023-11-18T23:41:11.937065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:09.938120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.932114+0000","last_change":"2023-11-18T23:41:10.952633+0000","last_active":"2023-11-18T23:41:11.932114+0000","last_peered":"2023-11-18T23:41:11.932114+0000","last_clean":"2023-11-18T23:41:11.932114+0000","last_became_active":"2023-11-18T23:41:10.952172+0000","last_became_peered":"2023-11-18T23:41:10.952172+0000","last_unstale":"2023-11-18T23:41:11.932114+0000","last_undegraded":"2023-11-18T23:41:11.932114+0000","last_fullsized":"2023-11-18T23:41:11.932114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926000+0000","last_change":"2023-11-18T23:41:11.935331+0000","last_active":"2023-11-18T23:41:12.926000+0000","last_peered":"2023-11-18T23:41:12.926000+0000","last_clean":"2023-11-18T23:41:12.926000+0000","last_became_active":"2023-11-18T23:41:11.935022+0000","last_became_peered":"2023-11-18T23:41:11.935022+0000","last_unstale":"2023-11-18T23:41:12.926000+0000","last_undegraded":"2023-11-18T23:41:12.926000+0000","last_fullsized":"2023-11-18T23:41:12.926000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.932196+0000","last_change":"2023-11-18T23:41:10.942836+0000","last_active":"2023-11-18T23:41:11.932196+0000","last_peered":"2023-11-18T23:41:11.932196+0000","last_clean":"2023-11-18T23:41:11.932196+0000","last_became_active":"2023-11-18T23:41:10.942491+0000","last_became_peered":"2023-11-18T23:41:10.942491+0000","last_unstale":"2023-11-18T23:41:11.932196+0000","last_undegraded":"2023-11-18T23:41:11.932196+0000","last_fullsized":"2023-11-18T23:41:11.932196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:12.831977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926129+0000","last_change":"2023-11-18T23:41:11.937215+0000","last_active":"2023-11-18T23:41:12.926129+0000","last_peered":"2023-11-18T23:41:12.926129+0000","last_clean":"2023-11-18T23:41:12.926129+0000","last_became_active":"2023-11-18T23:41:11.936805+0000","last_became_peered":"2023-11-18T23:41:11.936805+0000","last_unstale":"2023-11-18T23:41:12.926129+0000","last_undegraded":"2023-11-18T23:41:12.926129+0000","last_fullsized":"2023-11-18T23:41:12.926129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171642+0000","last_change":"2023-11-18T23:41:10.954159+0000","last_active":"2023-11-18T23:41:13.171642+0000","last_peered":"2023-11-18T23:41:13.171642+0000","last_clean":"2023-11-18T23:41:13.171642+0000","last_became_active":"2023-11-18T23:41:10.953615+0000","last_became_peered":"2023-11-18T23:41:10.953615+0000","last_unstale":"2023-11-18T23:41:13.171642+0000","last_undegraded":"2023-11-18T23:41:13.171642+0000","last_fullsized":"2023-11-18T23:41:13.171642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.938635+0000","last_change":"2023-11-18T23:41:11.936655+0000","last_active":"2023-11-18T23:41:11.938635+0000","last_peered":"2023-11-18T23:41:11.938635+0000","last_clean":"2023-11-18T23:41:11.938635+0000","last_became_active":"2023-11-18T23:41:11.936383+0000","last_became_peered":"2023-11-18T23:41:11.936383+0000","last_unstale":"2023-11-18T23:41:11.938635+0000","last_undegraded":"2023-11-18T23:41:11.938635+0000","last_fullsized":"2023-11-18T23:41:11.938635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926177+0000","last_change":"2023-11-18T23:41:11.932101+0000","last_active":"2023-11-18T23:41:12.926177+0000","last_peered":"2023-11-18T23:41:12.926177+0000","last_clean":"2023-11-18T23:41:12.926177+0000","last_became_active":"2023-11-18T23:41:11.931783+0000","last_became_peered":"2023-11-18T23:41:11.931783+0000","last_unstale":"2023-11-18T23:41:12.926177+0000","last_undegraded":"2023-11-18T23:41:12.926177+0000","last_fullsized":"2023-11-18T23:41:12.926177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171386+0000","last_change":"2023-11-18T23:41:10.952684+0000","last_active":"2023-11-18T23:41:13.171386+0000","last_peered":"2023-11-18T23:41:13.171386+0000","last_clean":"2023-11-18T23:41:13.171386+0000","last_became_active":"2023-11-18T23:41:10.952350+0000","last_became_peered":"2023-11-18T23:41:10.952350+0000","last_unstale":"2023-11-18T23:41:13.171386+0000","last_undegraded":"2023-11-18T23:41:13.171386+0000","last_fullsized":"2023-11-18T23:41:13.171386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925917+0000","last_change":"2023-11-18T23:41:11.936793+0000","last_active":"2023-11-18T23:41:12.925917+0000","last_peered":"2023-11-18T23:41:12.925917+0000","last_clean":"2023-11-18T23:41:12.925917+0000","last_became_active":"2023-11-18T23:41:11.936505+0000","last_became_peered":"2023-11-18T23:41:11.936505+0000","last_unstale":"2023-11-18T23:41:12.925917+0000","last_undegraded":"2023-11-18T23:41:12.925917+0000","last_fullsized":"2023-11-18T23:41:12.925917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171615+0000","last_change":"2023-11-18T23:41:10.952889+0000","last_active":"2023-11-18T23:41:13.171615+0000","last_peered":"2023-11-18T23:41:13.171615+0000","last_clean":"2023-11-18T23:41:13.171615+0000","last_became_active":"2023-11-18T23:41:10.952351+0000","last_became_peered":"2023-11-18T23:41:10.952351+0000","last_unstale":"2023-11-18T23:41:13.171615+0000","last_undegraded":"2023-11-18T23:41:13.171615+0000","last_fullsized":"2023-11-18T23:41:13.171615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924965+0000","last_change":"2023-11-18T23:41:11.932536+0000","last_active":"2023-11-18T23:41:12.924965+0000","last_peered":"2023-11-18T23:41:12.924965+0000","last_clean":"2023-11-18T23:41:12.924965+0000","last_became_active":"2023-11-18T23:41:11.931747+0000","last_became_peered":"2023-11-18T23:41:11.931747+0000","last_unstale":"2023-11-18T23:41:12.924965+0000","last_undegraded":"2023-11-18T23:41:12.924965+0000","last_fullsized":"2023-11-18T23:41:12.924965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926169+0000","last_change":"2023-11-18T23:41:10.948118+0000","last_active":"2023-11-18T23:41:12.926169+0000","last_peered":"2023-11-18T23:41:12.926169+0000","last_clean":"2023-11-18T23:41:12.926169+0000","last_became_active":"2023-11-18T23:41:10.947802+0000","last_became_peered":"2023-11-18T23:41:10.947802+0000","last_unstale":"2023-11-18T23:41:12.926169+0000","last_undegraded":"2023-11-18T23:41:12.926169+0000","last_fullsized":"2023-11-18T23:41:12.926169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926158+0000","last_change":"2023-11-18T23:41:11.939056+0000","last_active":"2023-11-18T23:41:12.926158+0000","last_peered":"2023-11-18T23:41:12.926158+0000","last_clean":"2023-11-18T23:41:12.926158+0000","last_became_active":"2023-11-18T23:41:11.938752+0000","last_became_peered":"2023-11-18T23:41:11.938752+0000","last_unstale":"2023-11-18T23:41:12.926158+0000","last_undegraded":"2023-11-18T23:41:12.926158+0000","last_fullsized":"2023-11-18T23:41:12.926158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:10.954940+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:10.954216+0000","last_became_peered":"2023-11-18T23:41:10.954216+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:41:15.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:41:16.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.102+0000 7f2993aaf640 1 Processor -- start 2023-11-18T23:41:16.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.102+0000 7f2993aaf640 1 -- start start 2023-11-18T23:41:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f2993aaf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c15b270 0x7f298c0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f2993aaf640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f298c0b0cb0 0x7f298c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f2993aaf640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c0b3260 con 0x7f298c0b2e50 2023-11-18T23:41:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f2993aaf640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0cbb50 con 0x7f298c0b0cb0 2023-11-18T23:41:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f2993aaf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c15b650 con 0x7f298c15b270 2023-11-18T23:41:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f299104a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f298c0b0cb0 0x7f298c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f299204c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f298c0b2e50 0x7f298c15ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48730/0 (socket says 172.21.15.8:48730) 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f299204c640 1 -- 172.21.15.8:0/832510042 learned_addr learned my addr 172.21.15.8:0/832510042 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.103+0000 7f299104a640 1 --2- 172.21.15.8:0/832510042 >> v2:172.21.15.8:3300/0 conn(0x7f298c0b0cb0 0x7f298c0b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34808/0 (socket says 172.21.15.8:34808) 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.104+0000 7f299184b640 1 --2- 172.21.15.8:0/832510042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c15b270 0x7f298c0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.104+0000 7f299104a640 1 -- 172.21.15.8:0/832510042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c15b270 msgr2=0x7f298c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.104+0000 7f299104a640 1 --2- 172.21.15.8:0/832510042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c15b270 0x7f298c0ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.104+0000 7f299104a640 1 -- 172.21.15.8:0/832510042 >> v1:172.21.15.8:6789/0 conn(0x7f298c0b2e50 legacy=0x7f298c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.104+0000 7f299104a640 1 -- 172.21.15.8:0/832510042 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0ce7c0 con 0x7f298c0b0cb0 2023-11-18T23:41:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.104+0000 7f2990849640 1 -- 172.21.15.8:0/832510042 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238969969 0 0) 0x7f298c0b3260 con 0x7f298c0b2e50 2023-11-18T23:41:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.104+0000 7f299104a640 1 --2- 172.21.15.8:0/832510042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c0b0cb0 0x7f298c0b2910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f297c0097a0 tx=0x7f297c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d31c3ea47deeba server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2990849640 1 -- 172.21.15.8:0/832510042 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c031830 con 0x7f298c0b0cb0 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2990849640 1 -- 172.21.15.8:0/832510042 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c031990 con 0x7f298c0b0cb0 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2990849640 1 -- 172.21.15.8:0/832510042 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c031d20 con 0x7f298c0b0cb0 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 -- 172.21.15.8:0/832510042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c0b0cb0 msgr2=0x7f298c0b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 --2- 172.21.15.8:0/832510042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c0b0cb0 0x7f298c0b2910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f297c0097a0 tx=0x7f297c02b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 -- 172.21.15.8:0/832510042 shutdown_connections 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 --2- 172.21.15.8:0/832510042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c0b0cb0 0x7f298c0b2910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 --2- 172.21.15.8:0/832510042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c15b270 0x7f298c0ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 -- 172.21.15.8:0/832510042 >> 172.21.15.8:0/832510042 conn(0x7f298c0d0f60 msgr2=0x7f298c0d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 -- 172.21.15.8:0/832510042 shutdown_connections 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.105+0000 7f2993aaf640 1 -- 172.21.15.8:0/832510042 wait complete. 2023-11-18T23:41:16.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.106+0000 7f2993aaf640 1 Processor -- start 2023-11-18T23:41:16.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.106+0000 7f2993aaf640 1 -- start start 2023-11-18T23:41:16.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f2993aaf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c0b0cb0 0x7f298c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f2993aaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f298c0b2e50 0x7f298c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f2993aaf640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c15b270 0x7f298c0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f2993aaf640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0ca960 con 0x7f298c15b270 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f2993aaf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0b4050 con 0x7f298c0b2e50 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f2993aaf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0b42f0 con 0x7f298c0b0cb0 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c15b270 0x7f298c0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c15b270 0x7f298c0c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34824/0 (socket says 172.21.15.8:34824) 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 -- 172.21.15.8:0/3005025055 learned_addr learned my addr 172.21.15.8:0/3005025055 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299104a640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f298c0b2e50 0x7f298c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299184b640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c0b0cb0 0x7f298c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 -- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c0b0cb0 msgr2=0x7f298c14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c0b0cb0 0x7f298c14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 -- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f298c0b2e50 msgr2=0x7f298c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f298c0b2e50 0x7f298c0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.107+0000 7f299204c640 1 -- 172.21.15.8:0/3005025055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c009400 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.108+0000 7f299204c640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c15b270 0x7f298c0c54a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f298800c7e0 tx=0x7f298800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.108+0000 7f29827fc640 1 -- 172.21.15.8:0/3005025055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800a640 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.108+0000 7f29827fc640 1 -- 172.21.15.8:0/3005025055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800a7c0 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.108+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c0b45d0 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.108+0000 7f29827fc640 1 -- 172.21.15.8:0/3005025055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800ab70 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.108+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c0b4b90 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.109+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c0b4d80 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.109+0000 7f29827fc640 1 -- 172.21.15.8:0/3005025055 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f298800acd0 con 0x7f298c15b270 2023-11-18T23:41:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.109+0000 7f29827fc640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f297006ae70 0x7f297006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.110+0000 7f29827fc640 1 -- 172.21.15.8:0/3005025055 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2988088e30 con 0x7f298c15b270 2023-11-18T23:41:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.110+0000 7f299184b640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f297006ae70 0x7f297006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.110+0000 7f299184b640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f297006ae70 0x7f297006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f298400a970 tx=0x7f2984008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.114+0000 7f29827fc640 1 -- 172.21.15.8:0/3005025055 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2988053ee0 con 0x7f298c15b270 2023-11-18T23:41:16.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.285+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f298c0b1830 con 0x7f297006ae70 2023-11-18T23:41:16.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.292+0000 7f29827fc640 1 -- 172.21.15.8:0/3005025055 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264690 (secure 0 0 0) 0x7f298400c050 con 0x7f297006ae70 2023-11-18T23:41:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:16.297 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f297006ae70 msgr2=0x7f297006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f297006ae70 0x7f297006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f298400a970 tx=0x7f2984008040 comp rx=0 tx=0).stop 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c15b270 msgr2=0x7f298c0c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c15b270 0x7f298c0c54a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f298800c7e0 tx=0x7f298800cca0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 shutdown_connections 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f297006ae70 0x7f297006d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f298c15b270 0x7f298c0c54a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f298c0b2e50 0x7f298c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 --2- 172.21.15.8:0/3005025055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f298c0b0cb0 0x7f298c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 >> 172.21.15.8:0/3005025055 conn(0x7f298c0d0f60 msgr2=0x7f298c06ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 shutdown_connections 2023-11-18T23:41:16.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.295+0000 7f2993aaf640 1 -- 172.21.15.8:0/3005025055 wait complete. 2023-11-18T23:41:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-18T23:41:15.243889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235544,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739176,"statfs":{"total":773094113280,"available":772852916224,"internally_reserved":0,"allocated":2793472,"data_stored":1702436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.309529"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171816+0000","last_change":"2023-11-18T23:41:11.946811+0000","last_active":"2023-11-18T23:41:13.171816+0000","last_peered":"2023-11-18T23:41:13.171816+0000","last_clean":"2023-11-18T23:41:13.171816+0000","last_became_active":"2023-11-18T23:41:11.946364+0000","last_became_peered":"2023-11-18T23:41:11.946364+0000","last_unstale":"2023-11-18T23:41:13.171816+0000","last_undegraded":"2023-11-18T23:41:13.171816+0000","last_fullsized":"2023-11-18T23:41:13.171816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:01:13.637927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942179+0000","last_change":"2023-11-18T23:41:11.940115+0000","last_active":"2023-11-18T23:41:11.942179+0000","last_peered":"2023-11-18T23:41:11.942179+0000","last_clean":"2023-11-18T23:41:11.942179+0000","last_became_active":"2023-11-18T23:41:11.939851+0000","last_became_peered":"2023-11-18T23:41:11.939851+0000","last_unstale":"2023-11-18T23:41:11.942179+0000","last_undegraded":"2023-11-18T23:41:11.942179+0000","last_fullsized":"2023-11-18T23:41:11.942179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:42:00.578989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924769+0000","last_change":"2023-11-18T23:41:11.933794+0000","last_active":"2023-11-18T23:41:12.924769+0000","last_peered":"2023-11-18T23:41:12.924769+0000","last_clean":"2023-11-18T23:41:12.924769+0000","last_became_active":"2023-11-18T23:41:11.931711+0000","last_became_peered":"2023-11-18T23:41:11.931711+0000","last_unstale":"2023-11-18T23:41:12.924769+0000","last_undegraded":"2023-11-18T23:41:12.924769+0000","last_fullsized":"2023-11-18T23:41:12.924769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926073+0000","last_change":"2023-11-18T23:41:11.941706+0000","last_active":"2023-11-18T23:41:12.926073+0000","last_peered":"2023-11-18T23:41:12.926073+0000","last_clean":"2023-11-18T23:41:12.926073+0000","last_became_active":"2023-11-18T23:41:11.941441+0000","last_became_peered":"2023-11-18T23:41:11.941441+0000","last_unstale":"2023-11-18T23:41:12.926073+0000","last_undegraded":"2023-11-18T23:41:12.926073+0000","last_fullsized":"2023-11-18T23:41:12.926073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171510+0000","last_change":"2023-11-18T23:41:11.940717+0000","last_active":"2023-11-18T23:41:13.171510+0000","last_peered":"2023-11-18T23:41:13.171510+0000","last_clean":"2023-11-18T23:41:13.171510+0000","last_became_active":"2023-11-18T23:41:11.939288+0000","last_became_peered":"2023-11-18T23:41:11.939288+0000","last_unstale":"2023-11-18T23:41:13.171510+0000","last_undegraded":"2023-11-18T23:41:13.171510+0000","last_fullsized":"2023-11-18T23:41:13.171510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925518+0000","last_change":"2023-11-18T23:41:11.938211+0000","last_active":"2023-11-18T23:41:12.925518+0000","last_peered":"2023-11-18T23:41:12.925518+0000","last_clean":"2023-11-18T23:41:12.925518+0000","last_became_active":"2023-11-18T23:41:11.937953+0000","last_became_peered":"2023-11-18T23:41:11.937953+0000","last_unstale":"2023-11-18T23:41:12.925518+0000","last_undegraded":"2023-11-18T23:41:12.925518+0000","last_fullsized":"2023-11-18T23:41:12.925518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171265+0000","last_change":"2023-11-18T23:41:11.943648+0000","last_active":"2023-11-18T23:41:13.171265+0000","last_peered":"2023-11-18T23:41:13.171265+0000","last_clean":"2023-11-18T23:41:13.171265+0000","last_became_active":"2023-11-18T23:41:11.943321+0000","last_became_peered":"2023-11-18T23:41:11.943321+0000","last_unstale":"2023-11-18T23:41:13.171265+0000","last_undegraded":"2023-11-18T23:41:13.171265+0000","last_fullsized":"2023-11-18T23:41:13.171265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925699+0000","last_change":"2023-11-18T23:41:11.944907+0000","last_active":"2023-11-18T23:41:12.925699+0000","last_peered":"2023-11-18T23:41:12.925699+0000","last_clean":"2023-11-18T23:41:12.925699+0000","last_became_active":"2023-11-18T23:41:11.944546+0000","last_became_peered":"2023-11-18T23:41:11.944546+0000","last_unstale":"2023-11-18T23:41:12.925699+0000","last_undegraded":"2023-11-18T23:41:12.925699+0000","last_fullsized":"2023-11-18T23:41:12.925699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171795+0000","last_change":"2023-11-18T23:41:11.945133+0000","last_active":"2023-11-18T23:41:13.171795+0000","last_peered":"2023-11-18T23:41:13.171795+0000","last_clean":"2023-11-18T23:41:13.171795+0000","last_became_active":"2023-11-18T23:41:11.944763+0000","last_became_peered":"2023-11-18T23:41:11.944763+0000","last_unstale":"2023-11-18T23:41:13.171795+0000","last_undegraded":"2023-11-18T23:41:13.171795+0000","last_fullsized":"2023-11-18T23:41:13.171795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:21.419360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.949139+0000","last_change":"2023-11-18T23:41:11.945314+0000","last_active":"2023-11-18T23:41:11.949139+0000","last_peered":"2023-11-18T23:41:11.949139+0000","last_clean":"2023-11-18T23:41:11.949139+0000","last_became_active":"2023-11-18T23:41:11.945040+0000","last_became_peered":"2023-11-18T23:41:11.945040+0000","last_unstale":"2023-11-18T23:41:11.949139+0000","last_undegraded":"2023-11-18T23:41:11.949139+0000","last_fullsized":"2023-11-18T23:41:11.949139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942630+0000","last_change":"2023-11-18T23:41:11.939307+0000","last_active":"2023-11-18T23:41:11.942630+0000","last_peered":"2023-11-18T23:41:11.942630+0000","last_clean":"2023-11-18T23:41:11.942630+0000","last_became_active":"2023-11-18T23:41:11.939039+0000","last_became_peered":"2023-11-18T23:41:11.939039+0000","last_unstale":"2023-11-18T23:41:11.942630+0000","last_undegraded":"2023-11-18T23:41:11.942630+0000","last_fullsized":"2023-11-18T23:41:11.942630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941951+0000","last_change":"2023-11-18T23:41:11.940131+0000","last_active":"2023-11-18T23:41:11.941951+0000","last_peered":"2023-11-18T23:41:11.941951+0000","last_clean":"2023-11-18T23:41:11.941951+0000","last_became_active":"2023-11-18T23:41:11.939870+0000","last_became_peered":"2023-11-18T23:41:11.939870+0000","last_unstale":"2023-11-18T23:41:11.941951+0000","last_undegraded":"2023-11-18T23:41:11.941951+0000","last_fullsized":"2023-11-18T23:41:11.941951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:40:41.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925790+0000","last_change":"2023-11-18T23:41:11.940144+0000","last_active":"2023-11-18T23:41:12.925790+0000","last_peered":"2023-11-18T23:41:12.925790+0000","last_clean":"2023-11-18T23:41:12.925790+0000","last_became_active":"2023-11-18T23:41:11.939856+0000","last_became_peered":"2023-11-18T23:41:11.939856+0000","last_unstale":"2023-11-18T23:41:12.925790+0000","last_undegraded":"2023-11-18T23:41:12.925790+0000","last_fullsized":"2023-11-18T23:41:12.925790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924731+0000","last_change":"2023-11-18T23:41:11.934160+0000","last_active":"2023-11-18T23:41:12.924731+0000","last_peered":"2023-11-18T23:41:12.924731+0000","last_clean":"2023-11-18T23:41:12.924731+0000","last_became_active":"2023-11-18T23:41:11.933765+0000","last_became_peered":"2023-11-18T23:41:11.933765+0000","last_unstale":"2023-11-18T23:41:12.924731+0000","last_undegraded":"2023-11-18T23:41:12.924731+0000","last_fullsized":"2023-11-18T23:41:12.924731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:13.836738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941020+0000","last_change":"2023-11-18T23:41:11.936206+0000","last_active":"2023-11-18T23:41:11.941020+0000","last_peered":"2023-11-18T23:41:11.941020+0000","last_clean":"2023-11-18T23:41:11.941020+0000","last_became_active":"2023-11-18T23:41:11.935928+0000","last_became_peered":"2023-11-18T23:41:11.935928+0000","last_unstale":"2023-11-18T23:41:11.941020+0000","last_undegraded":"2023-11-18T23:41:11.941020+0000","last_fullsized":"2023-11-18T23:41:11.941020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925537+0000","last_change":"2023-11-18T23:41:11.933938+0000","last_active":"2023-11-18T23:41:12.925537+0000","last_peered":"2023-11-18T23:41:12.925537+0000","last_clean":"2023-11-18T23:41:12.925537+0000","last_became_active":"2023-11-18T23:41:11.933650+0000","last_became_peered":"2023-11-18T23:41:11.933650+0000","last_unstale":"2023-11-18T23:41:12.925537+0000","last_undegraded":"2023-11-18T23:41:12.925537+0000","last_fullsized":"2023-11-18T23:41:12.925537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926339+0000","last_change":"2023-11-18T23:41:11.939059+0000","last_active":"2023-11-18T23:41:12.926339+0000","last_peered":"2023-11-18T23:41:12.926339+0000","last_clean":"2023-11-18T23:41:12.926339+0000","last_became_active":"2023-11-18T23:41:11.938794+0000","last_became_peered":"2023-11-18T23:41:11.938794+0000","last_unstale":"2023-11-18T23:41:12.926339+0000","last_undegraded":"2023-11-18T23:41:12.926339+0000","last_fullsized":"2023-11-18T23:41:12.926339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942370+0000","last_change":"2023-11-18T23:41:11.940827+0000","last_active":"2023-11-18T23:41:11.942370+0000","last_peered":"2023-11-18T23:41:11.942370+0000","last_clean":"2023-11-18T23:41:11.942370+0000","last_became_active":"2023-11-18T23:41:11.940536+0000","last_became_peered":"2023-11-18T23:41:11.940536+0000","last_unstale":"2023-11-18T23:41:11.942370+0000","last_undegraded":"2023-11-18T23:41:11.942370+0000","last_fullsized":"2023-11-18T23:41:11.942370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:40:41.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171737+0000","last_change":"2023-11-18T23:41:11.940969+0000","last_active":"2023-11-18T23:41:13.171737+0000","last_peered":"2023-11-18T23:41:13.171737+0000","last_clean":"2023-11-18T23:41:13.171737+0000","last_became_active":"2023-11-18T23:41:11.940183+0000","last_became_peered":"2023-11-18T23:41:11.940183+0000","last_unstale":"2023-11-18T23:41:13.171737+0000","last_undegraded":"2023-11-18T23:41:13.171737+0000","last_fullsized":"2023-11-18T23:41:13.171737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.943302+0000","last_change":"2023-11-18T23:41:11.941178+0000","last_active":"2023-11-18T23:41:11.943302+0000","last_peered":"2023-11-18T23:41:11.943302+0000","last_clean":"2023-11-18T23:41:11.943302+0000","last_became_active":"2023-11-18T23:41:11.940898+0000","last_became_peered":"2023-11-18T23:41:11.940898+0000","last_unstale":"2023-11-18T23:41:11.943302+0000","last_undegraded":"2023-11-18T23:41:11.943302+0000","last_fullsized":"2023-11-18T23:41:11.943302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:13.836738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924966+0000","last_change":"2023-11-18T23:41:11.942903+0000","last_active":"2023-11-18T23:41:12.924966+0000","last_peered":"2023-11-18T23:41:12.924966+0000","last_clean":"2023-11-18T23:41:12.924966+0000","last_became_active":"2023-11-18T23:41:11.942534+0000","last_became_peered":"2023-11-18T23:41:11.942534+0000","last_unstale":"2023-11-18T23:41:12.924966+0000","last_undegraded":"2023-11-18T23:41:12.924966+0000","last_fullsized":"2023-11-18T23:41:12.924966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925720+0000","last_change":"2023-11-18T23:41:11.944563+0000","last_active":"2023-11-18T23:41:12.925720+0000","last_peered":"2023-11-18T23:41:12.925720+0000","last_clean":"2023-11-18T23:41:12.925720+0000","last_became_active":"2023-11-18T23:41:11.943198+0000","last_became_peered":"2023-11-18T23:41:11.943198+0000","last_unstale":"2023-11-18T23:41:12.925720+0000","last_undegraded":"2023-11-18T23:41:12.925720+0000","last_fullsized":"2023-11-18T23:41:12.925720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926277+0000","last_change":"2023-11-18T23:41:11.934900+0000","last_active":"2023-11-18T23:41:12.926277+0000","last_peered":"2023-11-18T23:41:12.926277+0000","last_clean":"2023-11-18T23:41:12.926277+0000","last_became_active":"2023-11-18T23:41:11.934615+0000","last_became_peered":"2023-11-18T23:41:11.934615+0000","last_unstale":"2023-11-18T23:41:12.926277+0000","last_undegraded":"2023-11-18T23:41:12.926277+0000","last_fullsized":"2023-11-18T23:41:12.926277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925552+0000","last_change":"2023-11-18T23:41:11.940124+0000","last_active":"2023-11-18T23:41:12.925552+0000","last_peered":"2023-11-18T23:41:12.925552+0000","last_clean":"2023-11-18T23:41:12.925552+0000","last_became_active":"2023-11-18T23:41:11.939772+0000","last_became_peered":"2023-11-18T23:41:11.939772+0000","last_unstale":"2023-11-18T23:41:12.925552+0000","last_undegraded":"2023-11-18T23:41:12.925552+0000","last_fullsized":"2023-11-18T23:41:12.925552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925849+0000","last_change":"2023-11-18T23:41:11.935614+0000","last_active":"2023-11-18T23:41:12.925849+0000","last_peered":"2023-11-18T23:41:12.925849+0000","last_clean":"2023-11-18T23:41:12.925849+0000","last_became_active":"2023-11-18T23:41:11.935359+0000","last_became_peered":"2023-11-18T23:41:11.935359+0000","last_unstale":"2023-11-18T23:41:12.925849+0000","last_undegraded":"2023-11-18T23:41:12.925849+0000","last_fullsized":"2023-11-18T23:41:12.925849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.946533+0000","last_change":"2023-11-18T23:41:11.942859+0000","last_active":"2023-11-18T23:41:11.946533+0000","last_peered":"2023-11-18T23:41:11.946533+0000","last_clean":"2023-11-18T23:41:11.946533+0000","last_became_active":"2023-11-18T23:41:11.940443+0000","last_became_peered":"2023-11-18T23:41:11.940443+0000","last_unstale":"2023-11-18T23:41:11.946533+0000","last_undegraded":"2023-11-18T23:41:11.946533+0000","last_fullsized":"2023-11-18T23:41:11.946533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:04.851861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942158+0000","last_change":"2023-11-18T23:41:11.939763+0000","last_active":"2023-11-18T23:41:11.942158+0000","last_peered":"2023-11-18T23:41:11.942158+0000","last_clean":"2023-11-18T23:41:11.942158+0000","last_became_active":"2023-11-18T23:41:11.939467+0000","last_became_peered":"2023-11-18T23:41:11.939467+0000","last_unstale":"2023-11-18T23:41:11.942158+0000","last_undegraded":"2023-11-18T23:41:11.942158+0000","last_fullsized":"2023-11-18T23:41:11.942158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:05.668242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926083+0000","last_change":"2023-11-18T23:41:11.938804+0000","last_active":"2023-11-18T23:41:12.926083+0000","last_peered":"2023-11-18T23:41:12.926083+0000","last_clean":"2023-11-18T23:41:12.926083+0000","last_became_active":"2023-11-18T23:41:11.938399+0000","last_became_peered":"2023-11-18T23:41:11.938399+0000","last_unstale":"2023-11-18T23:41:12.926083+0000","last_undegraded":"2023-11-18T23:41:12.926083+0000","last_fullsized":"2023-11-18T23:41:12.926083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924943+0000","last_change":"2023-11-18T23:41:11.938618+0000","last_active":"2023-11-18T23:41:12.924943+0000","last_peered":"2023-11-18T23:41:12.924943+0000","last_clean":"2023-11-18T23:41:12.924943+0000","last_became_active":"2023-11-18T23:41:11.938221+0000","last_became_peered":"2023-11-18T23:41:11.938221+0000","last_unstale":"2023-11-18T23:41:12.924943+0000","last_undegraded":"2023-11-18T23:41:12.924943+0000","last_fullsized":"2023-11-18T23:41:12.924943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925751+0000","last_change":"2023-11-18T23:41:11.939803+0000","last_active":"2023-11-18T23:41:12.925751+0000","last_peered":"2023-11-18T23:41:12.925751+0000","last_clean":"2023-11-18T23:41:12.925751+0000","last_became_active":"2023-11-18T23:41:11.939543+0000","last_became_peered":"2023-11-18T23:41:11.939543+0000","last_unstale":"2023-11-18T23:41:12.925751+0000","last_undegraded":"2023-11-18T23:41:12.925751+0000","last_fullsized":"2023-11-18T23:41:12.925751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.934653+0000","last_change":"2023-11-18T23:41:11.933138+0000","last_active":"2023-11-18T23:41:11.934653+0000","last_peered":"2023-11-18T23:41:11.934653+0000","last_clean":"2023-11-18T23:41:11.934653+0000","last_became_active":"2023-11-18T23:41:11.932851+0000","last_became_peered":"2023-11-18T23:41:11.932851+0000","last_unstale":"2023-11-18T23:41:11.934653+0000","last_undegraded":"2023-11-18T23:41:11.934653+0000","last_fullsized":"2023-11-18T23:41:11.934653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.949152+0000","last_change":"2023-11-18T23:41:11.945502+0000","last_active":"2023-11-18T23:41:11.949152+0000","last_peered":"2023-11-18T23:41:11.949152+0000","last_clean":"2023-11-18T23:41:11.949152+0000","last_became_active":"2023-11-18T23:41:11.944702+0000","last_became_peered":"2023-11-18T23:41:11.944702+0000","last_unstale":"2023-11-18T23:41:11.949152+0000","last_undegraded":"2023-11-18T23:41:11.949152+0000","last_fullsized":"2023-11-18T23:41:11.949152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:06.672979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.937039+0000","last_change":"2023-11-18T23:41:11.935750+0000","last_active":"2023-11-18T23:41:11.937039+0000","last_peered":"2023-11-18T23:41:11.937039+0000","last_clean":"2023-11-18T23:41:11.937039+0000","last_became_active":"2023-11-18T23:41:11.935328+0000","last_became_peered":"2023-11-18T23:41:11.935328+0000","last_unstale":"2023-11-18T23:41:11.937039+0000","last_undegraded":"2023-11-18T23:41:11.937039+0000","last_fullsized":"2023-11-18T23:41:11.937039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:38.222019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925897+0000","last_change":"2023-11-18T23:41:10.953149+0000","last_active":"2023-11-18T23:41:12.925897+0000","last_peered":"2023-11-18T23:41:12.925897+0000","last_clean":"2023-11-18T23:41:12.925897+0000","last_became_active":"2023-11-18T23:41:10.952850+0000","last_became_peered":"2023-11-18T23:41:10.952850+0000","last_unstale":"2023-11-18T23:41:12.925897+0000","last_undegraded":"2023-11-18T23:41:12.925897+0000","last_fullsized":"2023-11-18T23:41:12.925897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925028+0000","last_change":"2023-11-18T23:41:11.932987+0000","last_active":"2023-11-18T23:41:12.925028+0000","last_peered":"2023-11-18T23:41:12.925028+0000","last_clean":"2023-11-18T23:41:12.925028+0000","last_became_active":"2023-11-18T23:41:11.932403+0000","last_became_peered":"2023-11-18T23:41:11.932403+0000","last_unstale":"2023-11-18T23:41:12.925028+0000","last_undegraded":"2023-11-18T23:41:12.925028+0000","last_fullsized":"2023-11-18T23:41:12.925028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961571+0000","last_change":"2023-11-18T23:41:10.949837+0000","last_active":"2023-11-18T23:41:11.961571+0000","last_peered":"2023-11-18T23:41:11.961571+0000","last_clean":"2023-11-18T23:41:11.961571+0000","last_became_active":"2023-11-18T23:41:10.949583+0000","last_became_peered":"2023-11-18T23:41:10.949583+0000","last_unstale":"2023-11-18T23:41:11.961571+0000","last_undegraded":"2023-11-18T23:41:11.961571+0000","last_fullsized":"2023-11-18T23:41:11.961571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:20.074426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926272+0000","last_change":"2023-11-18T23:41:10.948701+0000","last_active":"2023-11-18T23:41:12.926272+0000","last_peered":"2023-11-18T23:41:12.926272+0000","last_clean":"2023-11-18T23:41:12.926272+0000","last_became_active":"2023-11-18T23:41:10.947786+0000","last_became_peered":"2023-11-18T23:41:10.947786+0000","last_unstale":"2023-11-18T23:41:12.926272+0000","last_undegraded":"2023-11-18T23:41:12.926272+0000","last_fullsized":"2023-11-18T23:41:12.926272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925862+0000","last_change":"2023-11-18T23:41:11.935863+0000","last_active":"2023-11-18T23:41:12.925862+0000","last_peered":"2023-11-18T23:41:12.925862+0000","last_clean":"2023-11-18T23:41:12.925862+0000","last_became_active":"2023-11-18T23:41:11.935550+0000","last_became_peered":"2023-11-18T23:41:11.935550+0000","last_unstale":"2023-11-18T23:41:12.925862+0000","last_undegraded":"2023-11-18T23:41:12.925862+0000","last_fullsized":"2023-11-18T23:41:12.925862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925638+0000","last_change":"2023-11-18T23:41:10.944934+0000","last_active":"2023-11-18T23:41:12.925638+0000","last_peered":"2023-11-18T23:41:12.925638+0000","last_clean":"2023-11-18T23:41:12.925638+0000","last_became_active":"2023-11-18T23:41:10.944648+0000","last_became_peered":"2023-11-18T23:41:10.944648+0000","last_unstale":"2023-11-18T23:41:12.925638+0000","last_undegraded":"2023-11-18T23:41:12.925638+0000","last_fullsized":"2023-11-18T23:41:12.925638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941221+0000","last_change":"2023-11-18T23:41:11.937179+0000","last_active":"2023-11-18T23:41:11.941221+0000","last_peered":"2023-11-18T23:41:11.941221+0000","last_clean":"2023-11-18T23:41:11.941221+0000","last_became_active":"2023-11-18T23:41:11.936855+0000","last_became_peered":"2023-11-18T23:41:11.936855+0000","last_unstale":"2023-11-18T23:41:11.941221+0000","last_undegraded":"2023-11-18T23:41:11.941221+0000","last_fullsized":"2023-11-18T23:41:11.941221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:21.079188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.929477+0000","last_change":"2023-11-18T23:41:10.954127+0000","last_active":"2023-11-18T23:41:11.929477+0000","last_peered":"2023-11-18T23:41:11.929477+0000","last_clean":"2023-11-18T23:41:11.929477+0000","last_became_active":"2023-11-18T23:41:10.953785+0000","last_became_peered":"2023-11-18T23:41:10.953785+0000","last_unstale":"2023-11-18T23:41:11.929477+0000","last_undegraded":"2023-11-18T23:41:11.929477+0000","last_fullsized":"2023-11-18T23:41:11.929477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926194+0000","last_change":"2023-11-18T23:41:11.944161+0000","last_active":"2023-11-18T23:41:12.926194+0000","last_peered":"2023-11-18T23:41:12.926194+0000","last_clean":"2023-11-18T23:41:12.926194+0000","last_became_active":"2023-11-18T23:41:11.943897+0000","last_became_peered":"2023-11-18T23:41:11.943897+0000","last_unstale":"2023-11-18T23:41:12.926194+0000","last_undegraded":"2023-11-18T23:41:12.926194+0000","last_fullsized":"2023-11-18T23:41:12.926194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926026+0000","last_change":"2023-11-18T23:41:10.949653+0000","last_active":"2023-11-18T23:41:12.926026+0000","last_peered":"2023-11-18T23:41:12.926026+0000","last_clean":"2023-11-18T23:41:12.926026+0000","last_became_active":"2023-11-18T23:41:10.949342+0000","last_became_peered":"2023-11-18T23:41:10.949342+0000","last_unstale":"2023-11-18T23:41:12.926026+0000","last_undegraded":"2023-11-18T23:41:12.926026+0000","last_fullsized":"2023-11-18T23:41:12.926026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:11.932620+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:11.932076+0000","last_became_peered":"2023-11-18T23:41:11.932076+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.962191+0000","last_change":"2023-11-18T23:41:10.944409+0000","last_active":"2023-11-18T23:41:11.962191+0000","last_peered":"2023-11-18T23:41:11.962191+0000","last_clean":"2023-11-18T23:41:11.962191+0000","last_became_active":"2023-11-18T23:41:10.944114+0000","last_became_peered":"2023-11-18T23:41:10.944114+0000","last_unstale":"2023-11-18T23:41:11.962191+0000","last_undegraded":"2023-11-18T23:41:11.962191+0000","last_fullsized":"2023-11-18T23:41:11.962191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.948101+0000","last_change":"2023-11-18T23:41:11.943003+0000","last_active":"2023-11-18T23:41:11.948101+0000","last_peered":"2023-11-18T23:41:11.948101+0000","last_clean":"2023-11-18T23:41:11.948101+0000","last_became_active":"2023-11-18T23:41:11.942700+0000","last_became_peered":"2023-11-18T23:41:11.942700+0000","last_unstale":"2023-11-18T23:41:11.948101+0000","last_undegraded":"2023-11-18T23:41:11.948101+0000","last_fullsized":"2023-11-18T23:41:11.948101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:50:36.686430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.963485+0000","last_change":"2023-11-18T23:41:10.949432+0000","last_active":"2023-11-18T23:41:11.963485+0000","last_peered":"2023-11-18T23:41:11.963485+0000","last_clean":"2023-11-18T23:41:11.963485+0000","last_became_active":"2023-11-18T23:41:10.949070+0000","last_became_peered":"2023-11-18T23:41:10.949070+0000","last_unstale":"2023-11-18T23:41:11.963485+0000","last_undegraded":"2023-11-18T23:41:11.963485+0000","last_fullsized":"2023-11-18T23:41:11.963485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171506+0000","last_change":"2023-11-18T23:41:11.944440+0000","last_active":"2023-11-18T23:41:13.171506+0000","last_peered":"2023-11-18T23:41:13.171506+0000","last_clean":"2023-11-18T23:41:13.171506+0000","last_became_active":"2023-11-18T23:41:11.944144+0000","last_became_peered":"2023-11-18T23:41:11.944144+0000","last_unstale":"2023-11-18T23:41:13.171506+0000","last_undegraded":"2023-11-18T23:41:13.171506+0000","last_fullsized":"2023-11-18T23:41:13.171506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925055+0000","last_change":"2023-11-18T23:41:10.953937+0000","last_active":"2023-11-18T23:41:12.925055+0000","last_peered":"2023-11-18T23:41:12.925055+0000","last_clean":"2023-11-18T23:41:12.925055+0000","last_became_active":"2023-11-18T23:41:10.953500+0000","last_became_peered":"2023-11-18T23:41:10.953500+0000","last_unstale":"2023-11-18T23:41:12.925055+0000","last_undegraded":"2023-11-18T23:41:12.925055+0000","last_fullsized":"2023-11-18T23:41:12.925055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924751+0000","last_change":"2023-11-18T23:41:11.941920+0000","last_active":"2023-11-18T23:41:12.924751+0000","last_peered":"2023-11-18T23:41:12.924751+0000","last_clean":"2023-11-18T23:41:12.924751+0000","last_became_active":"2023-11-18T23:41:11.941599+0000","last_became_peered":"2023-11-18T23:41:11.941599+0000","last_unstale":"2023-11-18T23:41:12.924751+0000","last_undegraded":"2023-11-18T23:41:12.924751+0000","last_fullsized":"2023-11-18T23:41:12.924751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:46.123581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925846+0000","last_change":"2023-11-18T23:41:10.948691+0000","last_active":"2023-11-18T23:41:12.925846+0000","last_peered":"2023-11-18T23:41:12.925846+0000","last_clean":"2023-11-18T23:41:12.925846+0000","last_became_active":"2023-11-18T23:41:10.948397+0000","last_became_peered":"2023-11-18T23:41:10.948397+0000","last_unstale":"2023-11-18T23:41:12.925846+0000","last_undegraded":"2023-11-18T23:41:12.925846+0000","last_fullsized":"2023-11-18T23:41:12.925846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:06.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171508+0000","last_change":"2023-11-18T23:41:11.942006+0000","last_active":"2023-11-18T23:41:13.171508+0000","last_peered":"2023-11-18T23:41:13.171508+0000","last_clean":"2023-11-18T23:41:13.171508+0000","last_became_active":"2023-11-18T23:41:11.941752+0000","last_became_peered":"2023-11-18T23:41:11.941752+0000","last_unstale":"2023-11-18T23:41:13.171508+0000","last_undegraded":"2023-11-18T23:41:13.171508+0000","last_fullsized":"2023-11-18T23:41:13.171508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.930020+0000","last_change":"2023-11-18T23:41:10.948626+0000","last_active":"2023-11-18T23:41:11.930020+0000","last_peered":"2023-11-18T23:41:11.930020+0000","last_clean":"2023-11-18T23:41:11.930020+0000","last_became_active":"2023-11-18T23:41:10.948356+0000","last_became_peered":"2023-11-18T23:41:10.948356+0000","last_unstale":"2023-11-18T23:41:11.930020+0000","last_undegraded":"2023-11-18T23:41:11.930020+0000","last_fullsized":"2023-11-18T23:41:11.930020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.949132+0000","last_change":"2023-11-18T23:41:11.945196+0000","last_active":"2023-11-18T23:41:11.949132+0000","last_peered":"2023-11-18T23:41:11.949132+0000","last_clean":"2023-11-18T23:41:11.949132+0000","last_became_active":"2023-11-18T23:41:11.944330+0000","last_became_peered":"2023-11-18T23:41:11.944330+0000","last_unstale":"2023-11-18T23:41:11.949132+0000","last_undegraded":"2023-11-18T23:41:11.949132+0000","last_fullsized":"2023-11-18T23:41:11.949132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:05.668242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.963494+0000","last_change":"2023-11-18T23:41:10.949827+0000","last_active":"2023-11-18T23:41:11.963494+0000","last_peered":"2023-11-18T23:41:11.963494+0000","last_clean":"2023-11-18T23:41:11.963494+0000","last_became_active":"2023-11-18T23:41:10.949513+0000","last_became_peered":"2023-11-18T23:41:10.949513+0000","last_unstale":"2023-11-18T23:41:11.963494+0000","last_undegraded":"2023-11-18T23:41:11.963494+0000","last_fullsized":"2023-11-18T23:41:11.963494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:08.933359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171323+0000","last_change":"2023-11-18T23:41:11.942116+0000","last_active":"2023-11-18T23:41:13.171323+0000","last_peered":"2023-11-18T23:41:13.171323+0000","last_clean":"2023-11-18T23:41:13.171323+0000","last_became_active":"2023-11-18T23:41:11.940777+0000","last_became_peered":"2023-11-18T23:41:11.940777+0000","last_unstale":"2023-11-18T23:41:13.171323+0000","last_undegraded":"2023-11-18T23:41:13.171323+0000","last_fullsized":"2023-11-18T23:41:13.171323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961139+0000","last_change":"2023-11-18T23:41:10.952130+0000","last_active":"2023-11-18T23:41:11.961139+0000","last_peered":"2023-11-18T23:41:11.961139+0000","last_clean":"2023-11-18T23:41:11.961139+0000","last_became_active":"2023-11-18T23:41:10.951783+0000","last_became_peered":"2023-11-18T23:41:10.951783+0000","last_unstale":"2023-11-18T23:41:11.961139+0000","last_undegraded":"2023-11-18T23:41:11.961139+0000","last_fullsized":"2023-11-18T23:41:11.961139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171739+0000","last_change":"2023-11-18T23:41:11.941524+0000","last_active":"2023-11-18T23:41:13.171739+0000","last_peered":"2023-11-18T23:41:13.171739+0000","last_clean":"2023-11-18T23:41:13.171739+0000","last_became_active":"2023-11-18T23:41:11.941261+0000","last_became_peered":"2023-11-18T23:41:11.941261+0000","last_unstale":"2023-11-18T23:41:13.171739+0000","last_undegraded":"2023-11-18T23:41:13.171739+0000","last_fullsized":"2023-11-18T23:41:13.171739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.962636+0000","last_change":"2023-11-18T23:41:10.948977+0000","last_active":"2023-11-18T23:41:11.962636+0000","last_peered":"2023-11-18T23:41:11.962636+0000","last_clean":"2023-11-18T23:41:11.962636+0000","last_became_active":"2023-11-18T23:41:10.948618+0000","last_became_peered":"2023-11-18T23:41:10.948618+0000","last_unstale":"2023-11-18T23:41:11.962636+0000","last_undegraded":"2023-11-18T23:41:11.962636+0000","last_fullsized":"2023-11-18T23:41:11.962636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:05.668218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171873+0000","last_change":"2023-11-18T23:41:11.945585+0000","last_active":"2023-11-18T23:41:13.171873+0000","last_peered":"2023-11-18T23:41:13.171873+0000","last_clean":"2023-11-18T23:41:13.171873+0000","last_became_active":"2023-11-18T23:41:11.945267+0000","last_became_peered":"2023-11-18T23:41:11.945267+0000","last_unstale":"2023-11-18T23:41:13.171873+0000","last_undegraded":"2023-11-18T23:41:13.171873+0000","last_fullsized":"2023-11-18T23:41:13.171873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:32.618829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961158+0000","last_change":"2023-11-18T23:41:10.948326+0000","last_active":"2023-11-18T23:41:11.961158+0000","last_peered":"2023-11-18T23:41:11.961158+0000","last_clean":"2023-11-18T23:41:11.961158+0000","last_became_active":"2023-11-18T23:41:10.947924+0000","last_became_peered":"2023-11-18T23:41:10.947924+0000","last_unstale":"2023-11-18T23:41:11.961158+0000","last_undegraded":"2023-11-18T23:41:11.961158+0000","last_fullsized":"2023-11-18T23:41:11.961158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926090+0000","last_change":"2023-11-18T23:41:11.941133+0000","last_active":"2023-11-18T23:41:12.926090+0000","last_peered":"2023-11-18T23:41:12.926090+0000","last_clean":"2023-11-18T23:41:12.926090+0000","last_became_active":"2023-11-18T23:41:11.940871+0000","last_became_peered":"2023-11-18T23:41:11.940871+0000","last_unstale":"2023-11-18T23:41:12.926090+0000","last_undegraded":"2023-11-18T23:41:12.926090+0000","last_fullsized":"2023-11-18T23:41:12.926090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.927581+0000","last_change":"2023-11-18T23:41:10.951625+0000","last_active":"2023-11-18T23:41:11.927581+0000","last_peered":"2023-11-18T23:41:11.927581+0000","last_clean":"2023-11-18T23:41:11.927581+0000","last_became_active":"2023-11-18T23:41:10.951341+0000","last_became_peered":"2023-11-18T23:41:10.951341+0000","last_unstale":"2023-11-18T23:41:11.927581+0000","last_undegraded":"2023-11-18T23:41:11.927581+0000","last_fullsized":"2023-11-18T23:41:11.927581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171564+0000","last_change":"2023-11-18T23:41:11.946155+0000","last_active":"2023-11-18T23:41:13.171564+0000","last_peered":"2023-11-18T23:41:13.171564+0000","last_clean":"2023-11-18T23:41:13.171564+0000","last_became_active":"2023-11-18T23:41:11.945888+0000","last_became_peered":"2023-11-18T23:41:11.945888+0000","last_unstale":"2023-11-18T23:41:13.171564+0000","last_undegraded":"2023-11-18T23:41:13.171564+0000","last_fullsized":"2023-11-18T23:41:13.171564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.935408+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:41:11.935408+0000","last_peered":"2023-11-18T23:41:11.935408+0000","last_clean":"2023-11-18T23:41:11.935408+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:41:11.935408+0000","last_undegraded":"2023-11-18T23:41:11.935408+0000","last_fullsized":"2023-11-18T23:41:11.935408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925730+0000","last_change":"2023-11-18T23:41:10.950732+0000","last_active":"2023-11-18T23:41:12.925730+0000","last_peered":"2023-11-18T23:41:12.925730+0000","last_clean":"2023-11-18T23:41:12.925730+0000","last_became_active":"2023-11-18T23:41:10.950412+0000","last_became_peered":"2023-11-18T23:41:10.950412+0000","last_unstale":"2023-11-18T23:41:12.925730+0000","last_undegraded":"2023-11-18T23:41:12.925730+0000","last_fullsized":"2023-11-18T23:41:12.925730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925876+0000","last_change":"2023-11-18T23:41:11.944801+0000","last_active":"2023-11-18T23:41:12.925876+0000","last_peered":"2023-11-18T23:41:12.925876+0000","last_clean":"2023-11-18T23:41:12.925876+0000","last_became_active":"2023-11-18T23:41:11.944571+0000","last_became_peered":"2023-11-18T23:41:11.944571+0000","last_unstale":"2023-11-18T23:41:12.925876+0000","last_undegraded":"2023-11-18T23:41:12.925876+0000","last_fullsized":"2023-11-18T23:41:12.925876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.953232+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.952918+0000","last_became_peered":"2023-11-18T23:41:10.952918+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924571+0000","last_change":"2023-11-18T23:41:11.936302+0000","last_active":"2023-11-18T23:41:12.924571+0000","last_peered":"2023-11-18T23:41:12.924571+0000","last_clean":"2023-11-18T23:41:12.924571+0000","last_became_active":"2023-11-18T23:41:11.935466+0000","last_became_peered":"2023-11-18T23:41:11.935466+0000","last_unstale":"2023-11-18T23:41:12.924571+0000","last_undegraded":"2023-11-18T23:41:12.924571+0000","last_fullsized":"2023-11-18T23:41:12.924571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:30.278282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.928158+0000","last_change":"2023-11-18T23:41:10.949423+0000","last_active":"2023-11-18T23:41:11.928158+0000","last_peered":"2023-11-18T23:41:11.928158+0000","last_clean":"2023-11-18T23:41:11.928158+0000","last_became_active":"2023-11-18T23:41:10.949116+0000","last_became_peered":"2023-11-18T23:41:10.949116+0000","last_unstale":"2023-11-18T23:41:11.928158+0000","last_undegraded":"2023-11-18T23:41:11.928158+0000","last_fullsized":"2023-11-18T23:41:11.928158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.942031+0000","last_change":"2023-11-18T23:41:11.938131+0000","last_active":"2023-11-18T23:41:11.942031+0000","last_peered":"2023-11-18T23:41:11.942031+0000","last_clean":"2023-11-18T23:41:11.942031+0000","last_became_active":"2023-11-18T23:41:11.937846+0000","last_became_peered":"2023-11-18T23:41:11.937846+0000","last_unstale":"2023-11-18T23:41:11.942031+0000","last_undegraded":"2023-11-18T23:41:11.942031+0000","last_fullsized":"2023-11-18T23:41:11.942031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926059+0000","last_change":"2023-11-18T23:41:10.940990+0000","last_active":"2023-11-18T23:41:12.926059+0000","last_peered":"2023-11-18T23:41:12.926059+0000","last_clean":"2023-11-18T23:41:12.926059+0000","last_became_active":"2023-11-18T23:41:10.940710+0000","last_became_peered":"2023-11-18T23:41:10.940710+0000","last_unstale":"2023-11-18T23:41:12.926059+0000","last_undegraded":"2023-11-18T23:41:12.926059+0000","last_fullsized":"2023-11-18T23:41:12.926059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:19.427443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.941869+0000","last_change":"2023-11-18T23:41:11.938142+0000","last_active":"2023-11-18T23:41:11.941869+0000","last_peered":"2023-11-18T23:41:11.941869+0000","last_clean":"2023-11-18T23:41:11.941869+0000","last_became_active":"2023-11-18T23:41:11.937563+0000","last_became_peered":"2023-11-18T23:41:11.937563+0000","last_unstale":"2023-11-18T23:41:11.941869+0000","last_undegraded":"2023-11-18T23:41:11.941869+0000","last_fullsized":"2023-11-18T23:41:11.941869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:02.723199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.931690+0000","last_change":"2023-11-18T23:41:10.949142+0000","last_active":"2023-11-18T23:41:11.931690+0000","last_peered":"2023-11-18T23:41:11.931690+0000","last_clean":"2023-11-18T23:41:11.931690+0000","last_became_active":"2023-11-18T23:41:10.948855+0000","last_became_peered":"2023-11-18T23:41:10.948855+0000","last_unstale":"2023-11-18T23:41:11.931690+0000","last_undegraded":"2023-11-18T23:41:11.931690+0000","last_fullsized":"2023-11-18T23:41:11.931690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:03.847100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926199+0000","last_change":"2023-11-18T23:41:11.941744+0000","last_active":"2023-11-18T23:41:12.926199+0000","last_peered":"2023-11-18T23:41:12.926199+0000","last_clean":"2023-11-18T23:41:12.926199+0000","last_became_active":"2023-11-18T23:41:11.941469+0000","last_became_peered":"2023-11-18T23:41:11.941469+0000","last_unstale":"2023-11-18T23:41:12.926199+0000","last_undegraded":"2023-11-18T23:41:12.926199+0000","last_fullsized":"2023-11-18T23:41:12.926199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171719+0000","last_change":"2023-11-18T23:41:10.955650+0000","last_active":"2023-11-18T23:41:13.171719+0000","last_peered":"2023-11-18T23:41:13.171719+0000","last_clean":"2023-11-18T23:41:13.171719+0000","last_became_active":"2023-11-18T23:41:10.955331+0000","last_became_peered":"2023-11-18T23:41:10.955331+0000","last_unstale":"2023-11-18T23:41:13.171719+0000","last_undegraded":"2023-11-18T23:41:13.171719+0000","last_fullsized":"2023-11-18T23:41:13.171719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:50.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.935646+0000","last_change":"2023-11-18T23:41:11.934954+0000","last_active":"2023-11-18T23:41:11.935646+0000","last_peered":"2023-11-18T23:41:11.935646+0000","last_clean":"2023-11-18T23:41:11.935646+0000","last_became_active":"2023-11-18T23:41:11.934651+0000","last_became_peered":"2023-11-18T23:41:11.934651+0000","last_unstale":"2023-11-18T23:41:11.935646+0000","last_undegraded":"2023-11-18T23:41:11.935646+0000","last_fullsized":"2023-11-18T23:41:11.935646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:06.672979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.932484+0000","last_change":"2023-11-18T23:41:10.947031+0000","last_active":"2023-11-18T23:41:11.932484+0000","last_peered":"2023-11-18T23:41:11.932484+0000","last_clean":"2023-11-18T23:41:11.932484+0000","last_became_active":"2023-11-18T23:41:10.946758+0000","last_became_peered":"2023-11-18T23:41:10.946758+0000","last_unstale":"2023-11-18T23:41:11.932484+0000","last_undegraded":"2023-11-18T23:41:11.932484+0000","last_fullsized":"2023-11-18T23:41:11.932484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925991+0000","last_change":"2023-11-18T23:41:11.941903+0000","last_active":"2023-11-18T23:41:12.925991+0000","last_peered":"2023-11-18T23:41:12.925991+0000","last_clean":"2023-11-18T23:41:12.925991+0000","last_became_active":"2023-11-18T23:41:11.941319+0000","last_became_peered":"2023-11-18T23:41:11.941319+0000","last_unstale":"2023-11-18T23:41:12.925991+0000","last_undegraded":"2023-11-18T23:41:12.925991+0000","last_fullsized":"2023-11-18T23:41:12.925991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.961847+0000","last_change":"2023-11-18T23:41:10.953396+0000","last_active":"2023-11-18T23:41:11.961847+0000","last_peered":"2023-11-18T23:41:11.961847+0000","last_clean":"2023-11-18T23:41:11.961847+0000","last_became_active":"2023-11-18T23:41:10.952840+0000","last_became_peered":"2023-11-18T23:41:10.952840+0000","last_unstale":"2023-11-18T23:41:11.961847+0000","last_undegraded":"2023-11-18T23:41:11.961847+0000","last_fullsized":"2023-11-18T23:41:11.961847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924847+0000","last_change":"2023-11-18T23:41:11.938451+0000","last_active":"2023-11-18T23:41:12.924847+0000","last_peered":"2023-11-18T23:41:12.924847+0000","last_clean":"2023-11-18T23:41:12.924847+0000","last_became_active":"2023-11-18T23:41:11.938166+0000","last_became_peered":"2023-11-18T23:41:11.938166+0000","last_unstale":"2023-11-18T23:41:12.924847+0000","last_undegraded":"2023-11-18T23:41:12.924847+0000","last_fullsized":"2023-11-18T23:41:12.924847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.955647+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.955339+0000","last_became_peered":"2023-11-18T23:41:10.955339+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:33.115860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.937065+0000","last_change":"2023-11-18T23:41:11.935837+0000","last_active":"2023-11-18T23:41:11.937065+0000","last_peered":"2023-11-18T23:41:11.937065+0000","last_clean":"2023-11-18T23:41:11.937065+0000","last_became_active":"2023-11-18T23:41:11.935574+0000","last_became_peered":"2023-11-18T23:41:11.935574+0000","last_unstale":"2023-11-18T23:41:11.937065+0000","last_undegraded":"2023-11-18T23:41:11.937065+0000","last_fullsized":"2023-11-18T23:41:11.937065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:09.938120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.932114+0000","last_change":"2023-11-18T23:41:10.952633+0000","last_active":"2023-11-18T23:41:11.932114+0000","last_peered":"2023-11-18T23:41:11.932114+0000","last_clean":"2023-11-18T23:41:11.932114+0000","last_became_active":"2023-11-18T23:41:10.952172+0000","last_became_peered":"2023-11-18T23:41:10.952172+0000","last_unstale":"2023-11-18T23:41:11.932114+0000","last_undegraded":"2023-11-18T23:41:11.932114+0000","last_fullsized":"2023-11-18T23:41:11.932114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926000+0000","last_change":"2023-11-18T23:41:11.935331+0000","last_active":"2023-11-18T23:41:12.926000+0000","last_peered":"2023-11-18T23:41:12.926000+0000","last_clean":"2023-11-18T23:41:12.926000+0000","last_became_active":"2023-11-18T23:41:11.935022+0000","last_became_peered":"2023-11-18T23:41:11.935022+0000","last_unstale":"2023-11-18T23:41:12.926000+0000","last_undegraded":"2023-11-18T23:41:12.926000+0000","last_fullsized":"2023-11-18T23:41:12.926000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.932196+0000","last_change":"2023-11-18T23:41:10.942836+0000","last_active":"2023-11-18T23:41:11.932196+0000","last_peered":"2023-11-18T23:41:11.932196+0000","last_clean":"2023-11-18T23:41:11.932196+0000","last_became_active":"2023-11-18T23:41:10.942491+0000","last_became_peered":"2023-11-18T23:41:10.942491+0000","last_unstale":"2023-11-18T23:41:11.932196+0000","last_undegraded":"2023-11-18T23:41:11.932196+0000","last_fullsized":"2023-11-18T23:41:11.932196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:12.831977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926129+0000","last_change":"2023-11-18T23:41:11.937215+0000","last_active":"2023-11-18T23:41:12.926129+0000","last_peered":"2023-11-18T23:41:12.926129+0000","last_clean":"2023-11-18T23:41:12.926129+0000","last_became_active":"2023-11-18T23:41:11.936805+0000","last_became_peered":"2023-11-18T23:41:11.936805+0000","last_unstale":"2023-11-18T23:41:12.926129+0000","last_undegraded":"2023-11-18T23:41:12.926129+0000","last_fullsized":"2023-11-18T23:41:12.926129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171642+0000","last_change":"2023-11-18T23:41:10.954159+0000","last_active":"2023-11-18T23:41:13.171642+0000","last_peered":"2023-11-18T23:41:13.171642+0000","last_clean":"2023-11-18T23:41:13.171642+0000","last_became_active":"2023-11-18T23:41:10.953615+0000","last_became_peered":"2023-11-18T23:41:10.953615+0000","last_unstale":"2023-11-18T23:41:13.171642+0000","last_undegraded":"2023-11-18T23:41:13.171642+0000","last_fullsized":"2023-11-18T23:41:13.171642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.938635+0000","last_change":"2023-11-18T23:41:11.936655+0000","last_active":"2023-11-18T23:41:11.938635+0000","last_peered":"2023-11-18T23:41:11.938635+0000","last_clean":"2023-11-18T23:41:11.938635+0000","last_became_active":"2023-11-18T23:41:11.936383+0000","last_became_peered":"2023-11-18T23:41:11.936383+0000","last_unstale":"2023-11-18T23:41:11.938635+0000","last_undegraded":"2023-11-18T23:41:11.938635+0000","last_fullsized":"2023-11-18T23:41:11.938635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926177+0000","last_change":"2023-11-18T23:41:11.932101+0000","last_active":"2023-11-18T23:41:12.926177+0000","last_peered":"2023-11-18T23:41:12.926177+0000","last_clean":"2023-11-18T23:41:12.926177+0000","last_became_active":"2023-11-18T23:41:11.931783+0000","last_became_peered":"2023-11-18T23:41:11.931783+0000","last_unstale":"2023-11-18T23:41:12.926177+0000","last_undegraded":"2023-11-18T23:41:12.926177+0000","last_fullsized":"2023-11-18T23:41:12.926177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171386+0000","last_change":"2023-11-18T23:41:10.952684+0000","last_active":"2023-11-18T23:41:13.171386+0000","last_peered":"2023-11-18T23:41:13.171386+0000","last_clean":"2023-11-18T23:41:13.171386+0000","last_became_active":"2023-11-18T23:41:10.952350+0000","last_became_peered":"2023-11-18T23:41:10.952350+0000","last_unstale":"2023-11-18T23:41:13.171386+0000","last_undegraded":"2023-11-18T23:41:13.171386+0000","last_fullsized":"2023-11-18T23:41:13.171386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925917+0000","last_change":"2023-11-18T23:41:11.936793+0000","last_active":"2023-11-18T23:41:12.925917+0000","last_peered":"2023-11-18T23:41:12.925917+0000","last_clean":"2023-11-18T23:41:12.925917+0000","last_became_active":"2023-11-18T23:41:11.936505+0000","last_became_peered":"2023-11-18T23:41:11.936505+0000","last_unstale":"2023-11-18T23:41:12.925917+0000","last_undegraded":"2023-11-18T23:41:12.925917+0000","last_fullsized":"2023-11-18T23:41:12.925917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171615+0000","last_change":"2023-11-18T23:41:10.952889+0000","last_active":"2023-11-18T23:41:13.171615+0000","last_peered":"2023-11-18T23:41:13.171615+0000","last_clean":"2023-11-18T23:41:13.171615+0000","last_became_active":"2023-11-18T23:41:10.952351+0000","last_became_peered":"2023-11-18T23:41:10.952351+0000","last_unstale":"2023-11-18T23:41:13.171615+0000","last_undegraded":"2023-11-18T23:41:13.171615+0000","last_fullsized":"2023-11-18T23:41:13.171615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924965+0000","last_change":"2023-11-18T23:41:11.932536+0000","last_active":"2023-11-18T23:41:12.924965+0000","last_peered":"2023-11-18T23:41:12.924965+0000","last_clean":"2023-11-18T23:41:12.924965+0000","last_became_active":"2023-11-18T23:41:11.931747+0000","last_became_peered":"2023-11-18T23:41:11.931747+0000","last_unstale":"2023-11-18T23:41:12.924965+0000","last_undegraded":"2023-11-18T23:41:12.924965+0000","last_fullsized":"2023-11-18T23:41:12.924965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926169+0000","last_change":"2023-11-18T23:41:10.948118+0000","last_active":"2023-11-18T23:41:12.926169+0000","last_peered":"2023-11-18T23:41:12.926169+0000","last_clean":"2023-11-18T23:41:12.926169+0000","last_became_active":"2023-11-18T23:41:10.947802+0000","last_became_peered":"2023-11-18T23:41:10.947802+0000","last_unstale":"2023-11-18T23:41:12.926169+0000","last_undegraded":"2023-11-18T23:41:12.926169+0000","last_fullsized":"2023-11-18T23:41:12.926169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926158+0000","last_change":"2023-11-18T23:41:11.939056+0000","last_active":"2023-11-18T23:41:12.926158+0000","last_peered":"2023-11-18T23:41:12.926158+0000","last_clean":"2023-11-18T23:41:12.926158+0000","last_became_active":"2023-11-18T23:41:11.938752+0000","last_became_peered":"2023-11-18T23:41:11.938752+0000","last_unstale":"2023-11-18T23:41:12.926158+0000","last_undegraded":"2023-11-18T23:41:12.926158+0000","last_fullsized":"2023-11-18T23:41:12.926158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:10.954940+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:10.954216+0000","last_became_peered":"2023-11-18T23:41:10.954216+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:41:16.311 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T23:41:16.311 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-18T23:41:16.311 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-18T23:41:16.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-18T23:41:16.312 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-18T23:41:16.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.452+0000 7f6e6e79e640 1 Processor -- start 2023-11-18T23:41:16.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.452+0000 7f6e6e79e640 1 -- start start 2023-11-18T23:41:16.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6e79e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e6815d3f0 0x7f6e680d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6e79e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e680d01c0 0x7f6e680b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6e79e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e680d20d0 con 0x7f6e680cee70 2023-11-18T23:41:16.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6e79e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680d11f0 con 0x7f6e680d01c0 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6e79e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680d14c0 con 0x7f6e6815d3f0 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6df9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e680d01c0 0x7f6e680b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6df9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e680d01c0 0x7f6e680b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34828/0 (socket says 172.21.15.8:34828) 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6df9d640 1 -- 172.21.15.8:0/2867728976 learned_addr learned my addr 172.21.15.8:0/2867728976 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6d79c640 1 --2- 172.21.15.8:0/2867728976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e6815d3f0 0x7f6e680d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6df9d640 1 -- 172.21.15.8:0/2867728976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e6815d3f0 msgr2=0x7f6e680d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6df9d640 1 --2- 172.21.15.8:0/2867728976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e6815d3f0 0x7f6e680d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6df9d640 1 -- 172.21.15.8:0/2867728976 >> v1:172.21.15.116:6789/0 conn(0x7f6e680cee70 legacy=0x7f6e680cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.453+0000 7f6e6df9d640 1 -- 172.21.15.8:0/2867728976 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680d17a0 con 0x7f6e680d01c0 2023-11-18T23:41:16.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.454+0000 7f6e6df9d640 1 --2- 172.21.15.8:0/2867728976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680d01c0 0x7f6e680b2d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009e50 tx=0x7f6e6002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4360fabc9a583bb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.454+0000 7f6e5ffff640 1 -- 172.21.15.8:0/2867728976 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6002cb00 con 0x7f6e680d01c0 2023-11-18T23:41:16.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.454+0000 7f6e5ffff640 1 -- 172.21.15.8:0/2867728976 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6002cc60 con 0x7f6e680d01c0 2023-11-18T23:41:16.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.454+0000 7f6e5ffff640 1 -- 172.21.15.8:0/2867728976 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600343f0 con 0x7f6e680d01c0 2023-11-18T23:41:16.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.454+0000 7f6e6e79e640 1 -- 172.21.15.8:0/2867728976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680d01c0 msgr2=0x7f6e680b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.454+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/2867728976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680d01c0 0x7f6e680b2d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009e50 tx=0x7f6e6002bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:16.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.455+0000 7f6e6e79e640 1 -- 172.21.15.8:0/2867728976 shutdown_connections 2023-11-18T23:41:16.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.455+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/2867728976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680d01c0 0x7f6e680b2d20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.455+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/2867728976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e6815d3f0 0x7f6e680d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.455+0000 7f6e6e79e640 1 -- 172.21.15.8:0/2867728976 >> 172.21.15.8:0/2867728976 conn(0x7f6e6809c410 msgr2=0x7f6e680d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:16.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.455+0000 7f6e6e79e640 1 -- 172.21.15.8:0/2867728976 shutdown_connections 2023-11-18T23:41:16.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.455+0000 7f6e6e79e640 1 -- 172.21.15.8:0/2867728976 wait complete. 2023-11-18T23:41:16.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.456+0000 7f6e6e79e640 1 Processor -- start 2023-11-18T23:41:16.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.456+0000 7f6e6e79e640 1 -- start start 2023-11-18T23:41:16.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6e79e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680cee70 0x7f6e680aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6e79e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e680d01c0 0x7f6e680b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6e79e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6815d3f0 0x7f6e680b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6e79e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681f38b0 con 0x7f6e680cee70 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6e79e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6814a000 con 0x7f6e6815d3f0 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6e79e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681f2f80 con 0x7f6e680d01c0 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680cee70 0x7f6e680aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680cee70 0x7f6e680aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34844/0 (socket says 172.21.15.8:34844) 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 -- 172.21.15.8:0/692476489 learned_addr learned my addr 172.21.15.8:0/692476489 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6df9d640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6815d3f0 0x7f6e680b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6cf9b640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e680d01c0 0x7f6e680b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 -- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e680d01c0 msgr2=0x7f6e680b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e680d01c0 0x7f6e680b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 -- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6815d3f0 msgr2=0x7f6e680b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6815d3f0 0x7f6e680b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 -- 172.21.15.8:0/692476489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009b30 con 0x7f6e680cee70 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.457+0000 7f6e6d79c640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680cee70 0x7f6e680aff70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400e870 tx=0x7f6e6400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.458+0000 7f6e5dffb640 1 -- 172.21.15.8:0/692476489 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640094f0 con 0x7f6e680cee70 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.458+0000 7f6e5dffb640 1 -- 172.21.15.8:0/692476489 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6400c940 con 0x7f6e680cee70 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.458+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e681f3260 con 0x7f6e680cee70 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.458+0000 7f6e5dffb640 1 -- 172.21.15.8:0/692476489 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400ccf0 con 0x7f6e680cee70 2023-11-18T23:41:16.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.458+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e681f3d40 con 0x7f6e680cee70 2023-11-18T23:41:16.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.459+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e680a1080 con 0x7f6e680cee70 2023-11-18T23:41:16.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.459+0000 7f6e5dffb640 1 -- 172.21.15.8:0/692476489 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e64013470 con 0x7f6e680cee70 2023-11-18T23:41:16.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.459+0000 7f6e5dffb640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6e4c06ae70 0x7f6e4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.460+0000 7f6e5dffb640 1 -- 172.21.15.8:0/692476489 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e640895f0 con 0x7f6e680cee70 2023-11-18T23:41:16.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.460+0000 7f6e6cf9b640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6e4c06ae70 0x7f6e4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.460+0000 7f6e6cf9b640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6e4c06ae70 0x7f6e4c06d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e6814a260 tx=0x7f6e58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.464+0000 7f6e5dffb640 1 -- 172.21.15.8:0/692476489 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e64054750 con 0x7f6e680cee70 2023-11-18T23:41:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.688+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6e6804e920 con 0x7f6e680cee70 2023-11-18T23:41:16.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.691+0000 7f6e5dffb640 1 -- 172.21.15.8:0/692476489 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171039 (secure 0 0 0) 0x7f6e64057d70 con 0x7f6e680cee70 2023-11-18T23:41:16.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:16.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.693+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6e4c06ae70 msgr2=0x7f6e4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.693+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6e4c06ae70 0x7f6e4c06d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e6814a260 tx=0x7f6e58009040 comp rx=0 tx=0).stop 2023-11-18T23:41:16.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.693+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680cee70 msgr2=0x7f6e680aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.693+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680cee70 0x7f6e680aff70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400e870 tx=0x7f6e6400ed30 comp rx=0 tx=0).stop 2023-11-18T23:41:16.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 shutdown_connections 2023-11-18T23:41:16.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6e4c06ae70 0x7f6e4c06d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6815d3f0 0x7f6e680b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e680d01c0 0x7f6e680b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 --2- 172.21.15.8:0/692476489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e680cee70 0x7f6e680aff70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 >> 172.21.15.8:0/692476489 conn(0x7f6e6809c410 msgr2=0x7f6e680ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 shutdown_connections 2023-11-18T23:41:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.694+0000 7f6e6e79e640 1 -- 172.21.15.8:0/692476489 wait complete. 2023-11-18T23:41:16.705 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":4087144077},{"type":"v1","addr":"172.21.15.116:6833","nonce":4087144077}]},"active_addr":"172.21.15.116:6833/4087144077","active_change":"2023-11-18T23:40:51.232775+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":1670986911}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":3970087998}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":2225049958}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":2076375761}]}]} 2023-11-18T23:41:16.709 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-18T23:41:16.709 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-18T23:41:16.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:16.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.814+0000 7fd9f7e6f640 1 Processor -- start 2023-11-18T23:41:16.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.814+0000 7fd9f7e6f640 1 -- start start 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f7e6f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd9f00cce70 0x7fd9f0099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f7e6f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd9f00d1c50 0x7fd9f0099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f7e6f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f00d03a0 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f7e6f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f006bfa0 con 0x7fd9f00cce70 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f7e6f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f006f9d0 con 0x7fd9f00d1c50 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f5c0b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd9f00cce70 0x7fd9f0099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f540a640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd9f00d0ab0 0x7fd9f006e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48740/0 (socket says 172.21.15.8:48740) 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f5c0b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd9f00cce70 0x7fd9f0099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34852/0 (socket says 172.21.15.8:34852) 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f540a640 1 -- 172.21.15.8:0/2492584745 learned_addr learned my addr 172.21.15.8:0/2492584745 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f640c640 1 --2- 172.21.15.8:0/2492584745 >> v2:172.21.15.116:3300/0 conn(0x7fd9f00d1c50 0x7fd9f0099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f5c0b640 1 -- 172.21.15.8:0/2492584745 >> v2:172.21.15.116:3300/0 conn(0x7fd9f00d1c50 msgr2=0x7fd9f0099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:16.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f5c0b640 1 --2- 172.21.15.8:0/2492584745 >> v2:172.21.15.116:3300/0 conn(0x7fd9f00d1c50 0x7fd9f0099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f5c0b640 1 -- 172.21.15.8:0/2492584745 >> v1:172.21.15.8:6789/0 conn(0x7fd9f00d0ab0 legacy=0x7fd9f006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.815+0000 7fd9f5c0b640 1 -- 172.21.15.8:0/2492584745 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f006c190 con 0x7fd9f00cce70 2023-11-18T23:41:16.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.816+0000 7fd9f5c0b640 1 --2- 172.21.15.8:0/2492584745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00cce70 0x7fd9f0099970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00c7f20 tx=0x7fd9e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506184b3a3198f6f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.816+0000 7fd9f4c09640 1 -- 172.21.15.8:0/2492584745 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e002cc80 con 0x7fd9f00cce70 2023-11-18T23:41:16.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.816+0000 7fd9f4c09640 1 -- 172.21.15.8:0/2492584745 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e002cde0 con 0x7fd9f00cce70 2023-11-18T23:41:16.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.816+0000 7fd9f4c09640 1 -- 172.21.15.8:0/2492584745 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0034660 con 0x7fd9f00cce70 2023-11-18T23:41:16.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/2492584745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00cce70 msgr2=0x7fd9f0099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/2492584745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00cce70 0x7fd9f0099970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00c7f20 tx=0x7fd9e002bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/2492584745 shutdown_connections 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/2492584745 >> v2:172.21.15.116:3300/0 conn(0x7fd9f00d1c50 0x7fd9f0099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/2492584745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00cce70 0x7fd9f0099970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/2492584745 >> 172.21.15.8:0/2492584745 conn(0x7fd9f00d0f20 msgr2=0x7fd9f00d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/2492584745 shutdown_connections 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.817+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/2492584745 wait complete. 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.818+0000 7fd9f7e6f640 1 Processor -- start 2023-11-18T23:41:16.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.818+0000 7fd9f7e6f640 1 -- start start 2023-11-18T23:41:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f7e6f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9f00cce70 0x7fd9f01f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f7e6f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00d0ab0 0x7fd9f00c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f7e6f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f00d1c50 0x7fd9f015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f7e6f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c9300 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f7e6f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0160e40 con 0x7fd9f00d1c50 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f7e6f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c8680 con 0x7fd9f00cce70 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00d0ab0 0x7fd9f00c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00d0ab0 0x7fd9f00c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34862/0 (socket says 172.21.15.8:34862) 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 -- 172.21.15.8:0/1644275037 learned_addr learned my addr 172.21.15.8:0/1644275037 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f640c640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f00d1c50 0x7fd9f015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f5c0b640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9f00cce70 0x7fd9f01f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 -- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9f00cce70 msgr2=0x7fd9f01f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9f00cce70 0x7fd9f01f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 -- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f00d1c50 msgr2=0x7fd9f015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f00d1c50 0x7fd9f015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:16.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 -- 172.21.15.8:0/1644275037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009a70 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f640c640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f00d1c50 0x7fd9f015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9f540a640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00d0ab0 0x7fd9f00c9720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9e400c4a0 tx=0x7fd9e400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.819+0000 7fd9ee7fc640 1 -- 172.21.15.8:0/1644275037 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4005ce0 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.820+0000 7fd9ee7fc640 1 -- 172.21.15.8:0/1644275037 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e4005e40 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.820+0000 7fd9ee7fc640 1 -- 172.21.15.8:0/1644275037 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4007270 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.820+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f00c8960 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.820+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f00c8f20 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.821+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f00c9440 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.821+0000 7fd9ee7fc640 1 -- 172.21.15.8:0/1644275037 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9e4007490 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.821+0000 7fd9ee7fc640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd9dc06ae40 0x7fd9dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.821+0000 7fd9ee7fc640 1 -- 172.21.15.8:0/1644275037 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9e4088ad0 con 0x7fd9f00d0ab0 2023-11-18T23:41:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.822+0000 7fd9f5c0b640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd9dc06ae40 0x7fd9dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:16.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.822+0000 7fd9f5c0b640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd9dc06ae40 0x7fd9dc06d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0036000 tx=0x7fd9e0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:16.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:16.826+0000 7fd9ee7fc640 1 -- 172.21.15.8:0/1644275037 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9f00c9440 con 0x7fd9f00d0ab0 2023-11-18T23:41:17.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.004+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9f00c9440 con 0x7fd9f00d0ab0 2023-11-18T23:41:17.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.005+0000 7fd9ee7fc640 1 -- 172.21.15.8:0/1644275037 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fd9f00c9440 con 0x7fd9f00d0ab0 2023-11-18T23:41:17.006 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:17.007 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd9dc06ae40 msgr2=0x7fd9dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd9dc06ae40 0x7fd9dc06d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0036000 tx=0x7fd9e0030000 comp rx=0 tx=0).stop 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00d0ab0 msgr2=0x7fd9f00c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00d0ab0 0x7fd9f00c9720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9e400c4a0 tx=0x7fd9e400c960 comp rx=0 tx=0).stop 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 shutdown_connections 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd9dc06ae40 0x7fd9dc06d300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9f00d1c50 0x7fd9f015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9f00d0ab0 0x7fd9f00c9720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 --2- 172.21.15.8:0/1644275037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9f00cce70 0x7fd9f01f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 >> 172.21.15.8:0/1644275037 conn(0x7fd9f00d0f20 msgr2=0x7fd9f015d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 shutdown_connections 2023-11-18T23:41:17.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.007+0000 7fd9f7e6f640 1 -- 172.21.15.8:0/1644275037 wait complete. 2023-11-18T23:41:17.019 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-18T23:41:17.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:17.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.125+0000 7f041bc1c640 1 Processor -- start 2023-11-18T23:41:17.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.125+0000 7f041bc1c640 1 -- start start 2023-11-18T23:41:17.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041bc1c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f04140cce70 0x7f0414099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041bc1c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04140d1c50 0x7f0414099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041bc1c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04140d03a0 con 0x7f04140d0ab0 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041bc1c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041406bfa0 con 0x7f04140d1c50 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041bc1c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041406f9d0 con 0x7f04140cce70 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041a1b9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04140d1c50 0x7f0414099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f04191b7640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f04140d0ab0 0x7f041406e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48750/0 (socket says 172.21.15.8:48750) 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f04191b7640 1 -- 172.21.15.8:0/3454786370 learned_addr learned my addr 172.21.15.8:0/3454786370 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f04199b8640 1 --2- 172.21.15.8:0/3454786370 >> v2:172.21.15.116:3300/0 conn(0x7f04140cce70 0x7f0414099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041a1b9640 1 -- 172.21.15.8:0/3454786370 >> v2:172.21.15.116:3300/0 conn(0x7f04140cce70 msgr2=0x7f0414099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041a1b9640 1 --2- 172.21.15.8:0/3454786370 >> v2:172.21.15.116:3300/0 conn(0x7f04140cce70 0x7f0414099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041a1b9640 1 -- 172.21.15.8:0/3454786370 >> v1:172.21.15.8:6789/0 conn(0x7f04140d0ab0 legacy=0x7f041406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f04189b6640 1 -- 172.21.15.8:0/3454786370 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453207746 0 0) 0x7f04140d03a0 con 0x7f04140d0ab0 2023-11-18T23:41:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f041a1b9640 1 -- 172.21.15.8:0/3454786370 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041406c190 con 0x7f04140d1c50 2023-11-18T23:41:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.126+0000 7f04199b8640 1 --2- 172.21.15.8:0/3454786370 >> v2:172.21.15.116:3300/0 conn(0x7f04140cce70 0x7f0414099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.127+0000 7f041a1b9640 1 --2- 172.21.15.8:0/3454786370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f0414099eb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04140720c0 tx=0x7f040c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d685d0e5fc978105 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.127+0000 7f04189b6640 1 -- 172.21.15.8:0/3454786370 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c02cc80 con 0x7f04140d1c50 2023-11-18T23:41:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.127+0000 7f04189b6640 1 -- 172.21.15.8:0/3454786370 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c02cde0 con 0x7f04140d1c50 2023-11-18T23:41:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.127+0000 7f04189b6640 1 -- 172.21.15.8:0/3454786370 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c034660 con 0x7f04140d1c50 2023-11-18T23:41:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.127+0000 7f041bc1c640 1 -- 172.21.15.8:0/3454786370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 msgr2=0x7f0414099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.127+0000 7f041bc1c640 1 --2- 172.21.15.8:0/3454786370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f0414099eb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04140720c0 tx=0x7f040c02bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.128+0000 7f041bc1c640 1 -- 172.21.15.8:0/3454786370 shutdown_connections 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.128+0000 7f041bc1c640 1 --2- 172.21.15.8:0/3454786370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f0414099eb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.128+0000 7f041bc1c640 1 --2- 172.21.15.8:0/3454786370 >> v2:172.21.15.116:3300/0 conn(0x7f04140cce70 0x7f0414099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.128+0000 7f041bc1c640 1 -- 172.21.15.8:0/3454786370 >> 172.21.15.8:0/3454786370 conn(0x7f04140d0f20 msgr2=0x7f04140d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.128+0000 7f041bc1c640 1 -- 172.21.15.8:0/3454786370 shutdown_connections 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.128+0000 7f041bc1c640 1 -- 172.21.15.8:0/3454786370 wait complete. 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.129+0000 7f041bc1c640 1 Processor -- start 2023-11-18T23:41:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.129+0000 7f041bc1c640 1 -- start start 2023-11-18T23:41:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04140cce70 0x7f04141585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04140d0ab0 0x7f04140ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f04140ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0414158b10 con 0x7f04140d1c50 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04141599e0 con 0x7f04140cce70 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0414159cc0 con 0x7f04140d0ab0 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f04140ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f04140ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34892/0 (socket says 172.21.15.8:34892) 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 -- 172.21.15.8:0/2569331017 learned_addr learned my addr 172.21.15.8:0/2569331017 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f04199b8640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04140cce70 0x7f04141585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f04191b7640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04140d0ab0 0x7f04140ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 -- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04140d0ab0 msgr2=0x7f04140ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04140d0ab0 0x7f04140ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 -- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04140cce70 msgr2=0x7f04141585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04140cce70 0x7f04141585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 -- 172.21.15.8:0/2569331017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c009a70 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f04191b7640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04140d0ab0 0x7f04140ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041a1b9640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f04140ca890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f040c009e80 tx=0x7f040c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f040a7fc640 1 -- 172.21.15.8:0/2569331017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c040650 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f040a7fc640 1 -- 172.21.15.8:0/2569331017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0407b0 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0414159fa0 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f040a7fc640 1 -- 172.21.15.8:0/2569331017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c040b60 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.130+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041415a560 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.131+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04140c7ff0 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.132+0000 7f040a7fc640 1 -- 172.21.15.8:0/2569331017 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f040c040cc0 con 0x7f04140d1c50 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.132+0000 7f040a7fc640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f03f806ae40 0x7f03f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.132+0000 7f040a7fc640 1 -- 172.21.15.8:0/2569331017 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f040c0ac2a0 con 0x7f04140d1c50 2023-11-18T23:41:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.132+0000 7f04199b8640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f03f806ae40 0x7f03f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.133+0000 7f04199b8640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f03f806ae40 0x7f03f806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0410006fd0 tx=0x7f0410008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.137+0000 7f040a7fc640 1 -- 172.21.15.8:0/2569331017 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04140c7ff0 con 0x7f04140d1c50 2023-11-18T23:41:17.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.316+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04140c7ff0 con 0x7f04140d1c50 2023-11-18T23:41:17.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.317+0000 7f040a7fc640 1 -- 172.21.15.8:0/2569331017 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f04140c7ff0 con 0x7f04140d1c50 2023-11-18T23:41:17.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:17.319 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:17.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f03f806ae40 msgr2=0x7f03f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f03f806ae40 0x7f03f806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0410006fd0 tx=0x7f0410008040 comp rx=0 tx=0).stop 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 msgr2=0x7f04140ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f04140ca890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f040c009e80 tx=0x7f040c004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 shutdown_connections 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f03f806ae40 0x7f03f806d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04140d1c50 0x7f04140ca890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04140d0ab0 0x7f04140ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 --2- 172.21.15.8:0/2569331017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04140cce70 0x7f04141585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 >> 172.21.15.8:0/2569331017 conn(0x7f04140d0f20 msgr2=0x7f0414099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 shutdown_connections 2023-11-18T23:41:17.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.319+0000 7f041bc1c640 1 -- 172.21.15.8:0/2569331017 wait complete. 2023-11-18T23:41:17.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-18T23:41:17.333 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-18T23:41:17.333 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-18T23:41:17.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-18T23:41:17.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-18T23:41:17.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-18T23:41:17.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-18T23:41:17.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-18T23:41:17.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.517+0000 7fb12dc1a640 1 Processor -- start 2023-11-18T23:41:17.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.517+0000 7f90ae0d7640 1 Processor -- start 2023-11-18T23:41:17.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.517+0000 7f90ae0d7640 1 -- start start 2023-11-18T23:41:17.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.517+0000 7f05807b0640 1 Processor -- start 2023-11-18T23:41:17.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.517+0000 7f05807b0640 1 -- start start 2023-11-18T23:41:17.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.517+0000 7fb12dc1a640 1 -- start start 2023-11-18T23:41:17.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7fb12dc1a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb120050700 0x7fb120053440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7fb12dc1a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1200547a0 con 0x7fb1200df3f0 2023-11-18T23:41:17.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7fa0bb30f640 1 Processor -- start 2023-11-18T23:41:17.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7fb12dc1a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb120053b90 con 0x7fb12003acb0 2023-11-18T23:41:17.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7fb12dc1a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1200530f0 con 0x7fb120050700 2023-11-18T23:41:17.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7fa0bb30f640 1 -- start start 2023-11-18T23:41:17.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7f90ae0d7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f90a80721a0 0x7f90a80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7f90ae0d7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a8159690 con 0x7f90a80b2260 2023-11-18T23:41:17.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7f90ae0d7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a815cea0 con 0x7f90a81592b0 2023-11-18T23:41:17.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.518+0000 7f90ae0d7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a80716b0 con 0x7f90a80721a0 2023-11-18T23:41:17.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f90a77fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f90a81592b0 0x7f90a80b1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:34836/0 (socket says 172.21.15.8:34836) 2023-11-18T23:41:17.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f90a77fe640 1 -- 172.21.15.8:0/4260804983 learned_addr learned my addr 172.21.15.8:0/4260804983 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f05807b0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806db40 0x7f05781443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f05807b0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f057806a4d0 0x7f057806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f05807b0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f057815ead0 0x7f057815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f05807b0640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057806ae70 con 0x7f057815ead0 2023-11-18T23:41:17.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f05807b0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057806df20 con 0x7f057806a4d0 2023-11-18T23:41:17.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f05807b0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057806f740 con 0x7f057806db40 2023-11-18T23:41:17.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f4ad274e640 1 Processor -- start 2023-11-18T23:41:17.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f057dd4b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f057806a4d0 0x7f057806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f057dd4b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f057806a4d0 0x7f057806a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:47260/0 (socket says 172.21.15.8:47260) 2023-11-18T23:41:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f057e54c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806db40 0x7f05781443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f4ad274e640 1 -- start start 2023-11-18T23:41:17.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7f057dd4b640 1 -- 172.21.15.8:0/1311019541 learned_addr learned my addr 172.21.15.8:0/1311019541 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7fb12d419640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb12003acb0 0x7fb1200384c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:34830/0 (socket says 172.21.15.8:34830) 2023-11-18T23:41:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7fb12d419640 1 -- 172.21.15.8:0/209114415 learned_addr learned my addr 172.21.15.8:0/209114415 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.519+0000 7fb127fff640 1 --2- 172.21.15.8:0/209114415 >> v2:172.21.15.116:3300/0 conn(0x7fb120050700 0x7fb120053440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0bb30f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0ac0545e0 0x7fa0ac050650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7f057e54c640 1 -- 172.21.15.8:0/1311019541 >> v2:172.21.15.116:3300/0 conn(0x7f057806a4d0 msgr2=0x7f057806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7f057e54c640 1 --2- 172.21.15.8:0/1311019541 >> v2:172.21.15.116:3300/0 conn(0x7f057806a4d0 0x7f057806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7f057e54c640 1 -- 172.21.15.8:0/1311019541 >> v2:172.21.15.8:3300/0 conn(0x7f057815ead0 msgr2=0x7f057815ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7f057e54c640 1 --2- 172.21.15.8:0/1311019541 >> v2:172.21.15.8:3300/0 conn(0x7f057815ead0 0x7f057815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7f057e54c640 1 -- 172.21.15.8:0/1311019541 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780cf7e0 con 0x7f057806db40 2023-11-18T23:41:17.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f057dd4b640 1 --2- 172.21.15.8:0/1311019541 >> v2:172.21.15.116:3300/0 conn(0x7f057806a4d0 0x7f057806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:17.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f90a6ffd640 1 --2- 172.21.15.8:0/4260804983 >> v2:172.21.15.8:3300/0 conn(0x7f90a80721a0 0x7f90a80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f90a67fc640 1 -- 172.21.15.8:0/4260804983 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847274301 0 0) 0x7f90a815cea0 con 0x7f90a81592b0 2023-11-18T23:41:17.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f90a67fc640 1 -- 172.21.15.8:0/4260804983 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9090007930 con 0x7f90a81592b0 2023-11-18T23:41:17.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad274e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4acc1612b0 0x7f4acc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad274e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad274e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc0b40d0 con 0x7f4acc0ce670 2023-11-18T23:41:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad274e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc0b3070 con 0x7f4acc1612b0 2023-11-18T23:41:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad274e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0b3310 con 0x7f4acc0cade0 2023-11-18T23:41:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fb1277fe640 1 -- 172.21.15.8:0/209114415 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328469236 0 0) 0x7fb120053b90 con 0x7fb12003acb0 2023-11-18T23:41:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fb1277fe640 1 -- 172.21.15.8:0/209114415 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb118003520 con 0x7fb12003acb0 2023-11-18T23:41:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fb127fff640 1 -- 172.21.15.8:0/209114415 >> v1:172.21.15.116:6789/0 conn(0x7fb12003acb0 legacy=0x7fb1200384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fb127fff640 1 -- 172.21.15.8:0/209114415 >> v1:172.21.15.8:6789/0 conn(0x7fb1200df3f0 legacy=0x7fb12004fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fb127fff640 1 -- 172.21.15.8:0/209114415 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120053e70 con 0x7fb120050700 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0bb30f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa0ac0e4360 0x7fa0ac051040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0bb30f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac0549c0 con 0x7fa0ac051580 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0bb30f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac04f960 con 0x7fa0ac0e4360 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0bb30f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac051a00 con 0x7fa0ac0545e0 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b90ab640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0ac0545e0 0x7fa0ac050650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b90ab640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0ac0545e0 0x7fa0ac050650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:47268/0 (socket says 172.21.15.8:47268) 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b90ab640 1 -- 172.21.15.8:0/3702872241 learned_addr learned my addr 172.21.15.8:0/3702872241 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b88aa640 1 --2- 172.21.15.8:0/3702872241 >> v2:172.21.15.8:3300/0 conn(0x7fa0ac0e4360 0x7fa0ac051040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b90ab640 1 -- 172.21.15.8:0/3702872241 >> v2:172.21.15.8:3300/0 conn(0x7fa0ac0e4360 msgr2=0x7fa0ac051040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b90ab640 1 --2- 172.21.15.8:0/3702872241 >> v2:172.21.15.8:3300/0 conn(0x7fa0ac0e4360 0x7fa0ac051040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b90ab640 1 -- 172.21.15.8:0/3702872241 >> v1:172.21.15.8:6789/0 conn(0x7fa0ac051580 legacy=0x7fa0ac006250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T23:41:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.520+0000 7fa0b90ab640 1 -- 172.21.15.8:0/3702872241 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac04fb70 con 0x7fa0ac0545e0 2023-11-18T23:41:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7fdad9251640 1 Processor -- start 2023-11-18T23:41:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad0ceb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4acbfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4acc1612b0 0x7f4acc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad0ceb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc0cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:53524/0 (socket says 172.21.15.8:53524) 2023-11-18T23:41:17.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f4ad0ceb640 1 -- 172.21.15.8:0/388021517 learned_addr learned my addr 172.21.15.8:0/388021517 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7fb127fff640 1 --2- 172.21.15.8:0/209114415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb120050700 0x7fb120053440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb128064320 tx=0x7fb1280a82a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63c58336e969118 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f057e54c640 1 --2- 172.21.15.8:0/1311019541 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806db40 0x7f05781443d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05780cfaf0 tx=0x7f056802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=754b25d75c17f75a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7fdad9251640 1 -- start start 2023-11-18T23:41:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7f293b3a5640 1 Processor -- start 2023-11-18T23:41:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.521+0000 7fa0b88aa640 1 --2- 172.21.15.8:0/3702872241 >> v2:172.21.15.8:3300/0 conn(0x7fa0ac0e4360 0x7fa0ac051040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f057d54a640 1 -- 172.21.15.8:0/1311019541 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680317e0 con 0x7f057806db40 2023-11-18T23:41:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7fb1277fe640 1 -- 172.21.15.8:0/209114415 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12806c220 con 0x7fb120050700 2023-11-18T23:41:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7fb1277fe640 1 -- 172.21.15.8:0/209114415 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12806c380 con 0x7fb120050700 2023-11-18T23:41:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7fb1277fe640 1 -- 172.21.15.8:0/209114415 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12806b780 con 0x7fb120050700 2023-11-18T23:41:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f057d54a640 1 -- 172.21.15.8:0/1311019541 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568031940 con 0x7f057806db40 2023-11-18T23:41:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f90a6ffd640 1 -- 172.21.15.8:0/4260804983 >> v1:172.21.15.116:6789/0 conn(0x7f90a81592b0 legacy=0x7f90a80b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f90a67fc640 1 -- 172.21.15.8:0/4260804983 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780753340 0 0) 0x7f9090007930 con 0x7f90a81592b0 2023-11-18T23:41:17.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f90a6ffd640 1 -- 172.21.15.8:0/4260804983 >> v1:172.21.15.8:6789/0 conn(0x7f90a80b2260 legacy=0x7f90a80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f90a6ffd640 1 -- 172.21.15.8:0/4260804983 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a815d180 con 0x7f90a80721a0 2023-11-18T23:41:17.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f4acbfff640 1 -- 172.21.15.8:0/388021517 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 msgr2=0x7f4acc0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f4acbfff640 1 --2- 172.21.15.8:0/388021517 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f4acaffd640 1 -- 172.21.15.8:0/388021517 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770986848 0 0) 0x7f4ac0001110 con 0x7f4acc0ce670 2023-11-18T23:41:17.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f4acbfff640 1 -- 172.21.15.8:0/388021517 >> v1:172.21.15.116:6789/0 conn(0x7f4acc0ce670 legacy=0x7f4acc165110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f4acbfff640 1 -- 172.21.15.8:0/388021517 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0b35f0 con 0x7f4acc1612b0 2023-11-18T23:41:17.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7fa0b90ab640 1 --2- 172.21.15.8:0/3702872241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac050650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40620a0 tx=0x7fa0b40a5d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d6c2f3f5d748d48 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7fa0abfff640 1 -- 172.21.15.8:0/3702872241 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40a6b70 con 0x7fa0ac0545e0 2023-11-18T23:41:17.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7fa0abfff640 1 -- 172.21.15.8:0/3702872241 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40a6cd0 con 0x7fa0ac0545e0 2023-11-18T23:41:17.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7fa0abfff640 1 -- 172.21.15.8:0/3702872241 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40ae640 con 0x7fa0ac0545e0 2023-11-18T23:41:17.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fdad9251640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdad406a4d0 0x7fdad406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f05807b0640 1 -- 172.21.15.8:0/1311019541 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806db40 msgr2=0x7f05781443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f057d54a640 1 -- 172.21.15.8:0/1311019541 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680317e0 con 0x7f057806db40 2023-11-18T23:41:17.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.522+0000 7f293b3a5640 1 -- start start 2023-11-18T23:41:17.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f293b3a5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f292c0061f0 0x7f292c0066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f293b3a5640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f292c006be0 0x7f292c03c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f293b3a5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c0e36e0 con 0x7f292c0e3300 2023-11-18T23:41:17.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f293b3a5640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c0587c0 con 0x7f292c006be0 2023-11-18T23:41:17.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f293b3a5640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c057b40 con 0x7f292c0061f0 2023-11-18T23:41:17.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fdad9251640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad4161bb0 con 0x7fdad406eff0 2023-11-18T23:41:17.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fdad9251640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40cd880 con 0x7fdad40ced20 2023-11-18T23:41:17.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fdad9251640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad406d300 con 0x7fdad406a4d0 2023-11-18T23:41:17.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3702872241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0ac0545e0 msgr2=0x7fa0ac050650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fa0bb30f640 1 --2- 172.21.15.8:0/3702872241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac050650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40620a0 tx=0x7fa0b40a5d00 comp rx=0 tx=0).stop 2023-11-18T23:41:17.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fdad359e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdad40ced20 0x7fdad416b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:34848/0 (socket says 172.21.15.8:34848) 2023-11-18T23:41:17.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f05807b0640 1 --2- 172.21.15.8:0/1311019541 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806db40 0x7f05781443d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05780cfaf0 tx=0x7f056802b880 comp rx=0 tx=0).stop 2023-11-18T23:41:17.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f90a6ffd640 1 --2- 172.21.15.8:0/4260804983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a80721a0 0x7f90a80b39e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f909c00a7c0 tx=0x7f909c00a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfb04e03e0fc1ce server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f2939141640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f292c0e3300 0x7f292c0572f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:34864/0 (socket says 172.21.15.8:34864) 2023-11-18T23:41:17.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f2939141640 1 -- 172.21.15.8:0/349374509 learned_addr learned my addr 172.21.15.8:0/349374509 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f2938940640 1 --2- 172.21.15.8:0/349374509 >> v2:172.21.15.116:3300/0 conn(0x7f292c0061f0 0x7f292c0066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f2939942640 1 --2- 172.21.15.8:0/349374509 >> v2:172.21.15.8:3300/0 conn(0x7f292c006be0 0x7f292c03c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3702872241 shutdown_connections 2023-11-18T23:41:17.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fa0bb30f640 1 --2- 172.21.15.8:0/3702872241 >> v2:172.21.15.8:3300/0 conn(0x7fa0ac0e4360 0x7fa0ac051040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fa0bb30f640 1 --2- 172.21.15.8:0/3702872241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac050650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3702872241 >> 172.21.15.8:0/3702872241 conn(0x7fa0ac055310 msgr2=0x7fa0ac055720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fdad359e640 1 -- 172.21.15.8:0/1109969465 learned_addr learned my addr 172.21.15.8:0/1109969465 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fdad2d9d640 1 --2- 172.21.15.8:0/1109969465 >> v2:172.21.15.116:3300/0 conn(0x7fdad406a4d0 0x7fdad406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f05807b0640 1 -- 172.21.15.8:0/1311019541 shutdown_connections 2023-11-18T23:41:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f05807b0640 1 --2- 172.21.15.8:0/1311019541 >> v2:172.21.15.8:3300/0 conn(0x7f057815ead0 0x7f057815ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f05807b0640 1 --2- 172.21.15.8:0/1311019541 >> v2:172.21.15.116:3300/0 conn(0x7f057806a4d0 0x7f057806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7f05807b0640 1 --2- 172.21.15.8:0/1311019541 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806db40 0x7f05781443d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f05807b0640 1 -- 172.21.15.8:0/1311019541 >> 172.21.15.8:0/1311019541 conn(0x7f05780cfc00 msgr2=0x7f05780cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f05807b0640 1 -- 172.21.15.8:0/1311019541 shutdown_connections 2023-11-18T23:41:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f292bfff640 1 -- 172.21.15.8:0/349374509 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185440282 0 0) 0x7f292c0e36e0 con 0x7f292c0e3300 2023-11-18T23:41:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f292bfff640 1 -- 172.21.15.8:0/349374509 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2920003520 con 0x7f292c0e3300 2023-11-18T23:41:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fb12dc1a640 1 -- 172.21.15.8:0/209114415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb120050700 msgr2=0x7fb120053440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fb12dc1a640 1 --2- 172.21.15.8:0/209114415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb120050700 0x7fb120053440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb128064320 tx=0x7fb1280a82a0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fb12dc1a640 1 -- 172.21.15.8:0/209114415 shutdown_connections 2023-11-18T23:41:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fb12dc1a640 1 --2- 172.21.15.8:0/209114415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb120050700 0x7fb120053440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fb12dc1a640 1 -- 172.21.15.8:0/209114415 >> 172.21.15.8:0/209114415 conn(0x7fb120055320 msgr2=0x7fb120055730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.523+0000 7fb12dc1a640 1 -- 172.21.15.8:0/209114415 shutdown_connections 2023-11-18T23:41:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7fb12dc1a640 1 -- 172.21.15.8:0/209114415 wait complete. 2023-11-18T23:41:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f05807b0640 1 -- 172.21.15.8:0/1311019541 wait complete. 2023-11-18T23:41:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f2938940640 1 -- 172.21.15.8:0/349374509 >> v2:172.21.15.8:3300/0 conn(0x7f292c006be0 msgr2=0x7f292c03c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f90a67fc640 1 -- 172.21.15.8:0/4260804983 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098001670 con 0x7f90a80721a0 2023-11-18T23:41:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f2938940640 1 --2- 172.21.15.8:0/349374509 >> v2:172.21.15.8:3300/0 conn(0x7f292c006be0 0x7f292c03c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f90a67fc640 1 -- 172.21.15.8:0/4260804983 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c030070 con 0x7f90a80721a0 2023-11-18T23:41:17.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f90a67fc640 1 -- 172.21.15.8:0/4260804983 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c02c990 con 0x7f90a80721a0 2023-11-18T23:41:17.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f2938940640 1 -- 172.21.15.8:0/349374509 >> v1:172.21.15.116:6789/0 conn(0x7f292c0e3300 legacy=0x7f292c0572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f2938940640 1 -- 172.21.15.8:0/349374509 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c057e20 con 0x7f292c0061f0 2023-11-18T23:41:17.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3702872241 shutdown_connections 2023-11-18T23:41:17.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3702872241 wait complete. 2023-11-18T23:41:17.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7fdad2d9d640 1 -- 172.21.15.8:0/1109969465 >> v1:172.21.15.116:6789/0 conn(0x7fdad40ced20 legacy=0x7fdad416b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7f4acbfff640 1 --2- 172.21.15.8:0/388021517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4acc1612b0 0x7f4acc0cef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8357b55fd96692f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f90ae0d7640 1 -- 172.21.15.8:0/4260804983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a80721a0 msgr2=0x7f90a80b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7fdad2d9d640 1 -- 172.21.15.8:0/1109969465 >> v1:172.21.15.8:6789/0 conn(0x7fdad406eff0 legacy=0x7fdad406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.524+0000 7fdad2d9d640 1 -- 172.21.15.8:0/1109969465 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad406cd40 con 0x7fdad406a4d0 2023-11-18T23:41:17.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7fdad2d9d640 1 --2- 172.21.15.8:0/1109969465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 0x7fdad406d540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009d90 tx=0x7fdacc02be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d1c49b7e40c8a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f4acaffd640 1 -- 172.21.15.8:0/388021517 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac402cc50 con 0x7f4acc1612b0 2023-11-18T23:41:17.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f4acaffd640 1 -- 172.21.15.8:0/388021517 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac402cdb0 con 0x7f4acc1612b0 2023-11-18T23:41:17.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f2938940640 1 --2- 172.21.15.8:0/349374509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c0061f0 0x7f292c0066a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f292c03bef0 tx=0x7f292402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=588034d6301a6ae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f90ae0d7640 1 --2- 172.21.15.8:0/4260804983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a80721a0 0x7f90a80b39e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f909c00a7c0 tx=0x7f909c00a1a0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f90ae0d7640 1 -- 172.21.15.8:0/4260804983 shutdown_connections 2023-11-18T23:41:17.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f05807b0640 1 Processor -- start 2023-11-18T23:41:17.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7fb12dc1a640 1 Processor -- start 2023-11-18T23:41:17.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7fdad1d9b640 1 -- 172.21.15.8:0/1109969465 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc02cbe0 con 0x7fdad406a4d0 2023-11-18T23:41:17.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7fdad1d9b640 1 -- 172.21.15.8:0/1109969465 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc02cd40 con 0x7fdad406a4d0 2023-11-18T23:41:17.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7fdad1d9b640 1 -- 172.21.15.8:0/1109969465 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc034660 con 0x7fdad406a4d0 2023-11-18T23:41:17.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f90ae0d7640 1 --2- 172.21.15.8:0/4260804983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a80721a0 0x7f90a80b39e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f05807b0640 1 -- start start 2023-11-18T23:41:17.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f292bfff640 1 -- 172.21.15.8:0/349374509 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240317c0 con 0x7f292c0061f0 2023-11-18T23:41:17.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f292bfff640 1 -- 172.21.15.8:0/349374509 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924031920 con 0x7f292c0061f0 2023-11-18T23:41:17.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f292bfff640 1 -- 172.21.15.8:0/349374509 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240317c0 con 0x7f292c0061f0 2023-11-18T23:41:17.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.525+0000 7f90ae0d7640 1 -- 172.21.15.8:0/4260804983 >> 172.21.15.8:0/4260804983 conn(0x7f90a806a4d0 msgr2=0x7f90a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f4acaffd640 1 -- 172.21.15.8:0/388021517 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4034660 con 0x7f4acc1612b0 2023-11-18T23:41:17.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f38f9c39640 1 Processor -- start 2023-11-18T23:41:17.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f4ad274e640 1 -- 172.21.15.8:0/388021517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4acc1612b0 msgr2=0x7f4acc0cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f4ad274e640 1 --2- 172.21.15.8:0/388021517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4acc1612b0 0x7f4acc0cef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac402bea0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fa0bb30f640 1 Processor -- start 2023-11-18T23:41:17.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fa0bb30f640 1 -- start start 2023-11-18T23:41:17.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fdad9251640 1 -- 172.21.15.8:0/1109969465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 msgr2=0x7fdad406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fdad9251640 1 --2- 172.21.15.8:0/1109969465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 0x7fdad406d540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009d90 tx=0x7fdacc02be30 comp rx=0 tx=0).stop 2023-11-18T23:41:17.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f293b3a5640 1 -- 172.21.15.8:0/349374509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c0061f0 msgr2=0x7f292c0066a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f293b3a5640 1 --2- 172.21.15.8:0/349374509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c0061f0 0x7f292c0066a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f292c03bef0 tx=0x7f292402b860 comp rx=0 tx=0).stop 2023-11-18T23:41:17.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fdad9251640 1 -- 172.21.15.8:0/1109969465 shutdown_connections 2023-11-18T23:41:17.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fdad9251640 1 --2- 172.21.15.8:0/1109969465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 0x7fdad406d540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fdad9251640 1 -- 172.21.15.8:0/1109969465 >> 172.21.15.8:0/1109969465 conn(0x7fdad40cbff0 msgr2=0x7fdad40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7fb12dc1a640 1 -- start start 2023-11-18T23:41:17.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f90ae0d7640 1 -- 172.21.15.8:0/4260804983 shutdown_connections 2023-11-18T23:41:17.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f90ae0d7640 1 -- 172.21.15.8:0/4260804983 wait complete. 2023-11-18T23:41:17.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7fdad9251640 1 -- 172.21.15.8:0/1109969465 shutdown_connections 2023-11-18T23:41:17.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.526+0000 7f38f9c39640 1 -- start start 2023-11-18T23:41:17.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f293b3a5640 1 -- 172.21.15.8:0/349374509 shutdown_connections 2023-11-18T23:41:17.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f293b3a5640 1 --2- 172.21.15.8:0/349374509 >> v2:172.21.15.8:3300/0 conn(0x7f292c006be0 0x7f292c03c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f293b3a5640 1 --2- 172.21.15.8:0/349374509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c0061f0 0x7f292c0066a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f293b3a5640 1 -- 172.21.15.8:0/349374509 >> 172.21.15.8:0/349374509 conn(0x7f292c058ef0 msgr2=0x7f292c059300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f05807b0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806a4d0 0x7f05780b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f05807b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f057806db40 0x7f05780c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f05807b0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f057815ead0 0x7f05780c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f05807b0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780c9b90 con 0x7f057815ead0 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f05807b0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780b2d80 con 0x7f057806db40 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f05807b0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05780b3060 con 0x7f057806a4d0 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f057ed4d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f057815ead0 0x7f05780c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f057e54c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806a4d0 0x7f05780b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f057e54c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806a4d0 0x7f05780b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:53540/0 (socket says 172.21.15.8:53540) 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f057e54c640 1 -- 172.21.15.8:0/1891593101 learned_addr learned my addr 172.21.15.8:0/1891593101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f057dd4b640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f057806db40 0x7f05780c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f4ad274e640 1 -- 172.21.15.8:0/388021517 shutdown_connections 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f4ad274e640 1 --2- 172.21.15.8:0/388021517 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f4ad274e640 1 --2- 172.21.15.8:0/388021517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4acc1612b0 0x7f4acc0cef60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f4ad274e640 1 -- 172.21.15.8:0/388021517 >> 172.21.15.8:0/388021517 conn(0x7f4acc0b0ca0 msgr2=0x7f4acc0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f4ad274e640 1 -- 172.21.15.8:0/388021517 shutdown_connections 2023-11-18T23:41:17.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f4ad274e640 1 -- 172.21.15.8:0/388021517 wait complete. 2023-11-18T23:41:17.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f38f9c39640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f4071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7f38f9c39640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f4070520 con 0x7f38f40700c0 2023-11-18T23:41:17.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f38f9c39640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f409cde0 con 0x7f38f40cca20 2023-11-18T23:41:17.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f38f9c39640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f406e3a0 con 0x7f38f40cf640 2023-11-18T23:41:17.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12dc1a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb12003acb0 0x7fb120049800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f057ed4d640 1 -- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806a4d0 msgr2=0x7f05780b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12dc1a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb120050700 0x7fb1200d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f057ed4d640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f057806a4d0 0x7f05780b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12dc1a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200df3f0 0x7fb12004a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f90ae0d7640 1 Processor -- start 2023-11-18T23:41:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12dc1a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120049d40 con 0x7fb1200df3f0 2023-11-18T23:41:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12dc1a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12004b1b0 con 0x7fb12003acb0 2023-11-18T23:41:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12dc1a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb120048d20 con 0x7fb120050700 2023-11-18T23:41:17.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0bb30f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0ac051580 0x7fa0ac0d65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0bb30f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f057ed4d640 1 -- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f057806db40 msgr2=0x7f05780c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f057ed4d640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f057806db40 0x7f05780c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f057ed4d640 1 -- 172.21.15.8:0/1891593101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574009460 con 0x7f057815ead0 2023-11-18T23:41:17.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f057ed4d640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f057815ead0 0x7f05780c2850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f057000be20 tx=0x7f057000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f38f8c37640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f4071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f38f8c37640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f4071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:53550/0 (socket says 172.21.15.8:53550) 2023-11-18T23:41:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f38f8c37640 1 -- 172.21.15.8:0/1171043723 learned_addr learned my addr 172.21.15.8:0/1171043723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12d419640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200df3f0 0x7fb12004a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0bb30f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac0d5100 0x7fa0ac0d6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0bb30f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0dbe50 con 0x7fa0ac0545e0 2023-11-18T23:41:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0bb30f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0dbb00 con 0x7fa0ac051580 2023-11-18T23:41:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0bb30f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0d8f70 con 0x7fa0ac0d5100 2023-11-18T23:41:17.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12d419640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200df3f0 0x7fb12004a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34948/0 (socket says 172.21.15.8:34948) 2023-11-18T23:41:17.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12d419640 1 -- 172.21.15.8:0/260388817 learned_addr learned my addr 172.21.15.8:0/260388817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb127fff640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb120050700 0x7fb1200d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f293b3a5640 1 -- 172.21.15.8:0/349374509 shutdown_connections 2023-11-18T23:41:17.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0b88aa640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0b88aa640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac0d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34942/0 (socket says 172.21.15.8:34942) 2023-11-18T23:41:17.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fa0b88aa640 1 -- 172.21.15.8:0/3046447086 learned_addr learned my addr 172.21.15.8:0/3046447086 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000ce70 con 0x7f057815ead0 2023-11-18T23:41:17.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f90ae0d7640 1 -- start start 2023-11-18T23:41:17.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0568009400 con 0x7f057815ead0 2023-11-18T23:41:17.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7fb12cc18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb12003acb0 0x7fb120049800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05780b3620 con 0x7f057815ead0 2023-11-18T23:41:17.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570014440 con 0x7f057815ead0 2023-11-18T23:41:17.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700147f0 con 0x7f057815ead0 2023-11-18T23:41:17.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f4ad274e640 1 Processor -- start 2023-11-18T23:41:17.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fb12d419640 1 -- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb120050700 msgr2=0x7fb1200d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fb12d419640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb120050700 0x7fb1200d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fb12d419640 1 -- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb12003acb0 msgr2=0x7fb120049800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fb12d419640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb12003acb0 0x7fb120049800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fb12d419640 1 -- 172.21.15.8:0/260388817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12804f730 con 0x7fb1200df3f0 2023-11-18T23:41:17.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fa0b98ac640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac0d5100 0x7fa0ac0d6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f4ad274e640 1 -- start start 2023-11-18T23:41:17.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fa0b88aa640 1 -- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac0d5100 msgr2=0x7fa0ac0d6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fa0b88aa640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac0d5100 0x7fa0ac0d6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fa0b88aa640 1 -- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0ac051580 msgr2=0x7fa0ac0d65c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-18T23:41:17.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fa0b88aa640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0ac051580 0x7fa0ac0d65c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fa0b88aa640 1 -- 172.21.15.8:0/3046447086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b404f730 con 0x7fa0ac0545e0 2023-11-18T23:41:17.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f90ae0d7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90a80721a0 0x7f90a809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7fa0b88aa640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac0d4bc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c7f0 tx=0x7fa0b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90ae0d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a80b2260 0x7f90a82000c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.527+0000 7fdad9251640 1 -- 172.21.15.8:0/1109969465 wait complete. 2023-11-18T23:41:17.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7fdad9251640 1 Processor -- start 2023-11-18T23:41:17.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90a77fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90a80721a0 0x7f90a809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90a77fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90a80721a0 0x7f90a809c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:53566/0 (socket says 172.21.15.8:53566) 2023-11-18T23:41:17.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90a6ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a80b2260 0x7f90a82000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90a6ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a80b2260 0x7f90a82000c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:47318/0 (socket says 172.21.15.8:47318) 2023-11-18T23:41:17.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90a77fe640 1 -- 172.21.15.8:0/2029534177 learned_addr learned my addr 172.21.15.8:0/2029534177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90ae0d7640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81592b0 0x7f90a80cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.528+0000 7f293b3a5640 1 -- 172.21.15.8:0/349374509 wait complete. 2023-11-18T23:41:17.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f293b3a5640 1 Processor -- start 2023-11-18T23:41:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90a7fff640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81592b0 0x7f90a80cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8201770 con 0x7f90a81592b0 2023-11-18T23:41:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8200b80 con 0x7f90a80b2260 2023-11-18T23:41:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8200e60 con 0x7f90a80721a0 2023-11-18T23:41:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f38f8c37640 1 -- 172.21.15.8:0/1171043723 >> v1:172.21.15.116:6789/0 conn(0x7f38f40cca20 legacy=0x7f38f40ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f38f8c37640 1 -- 172.21.15.8:0/1171043723 >> v1:172.21.15.8:6789/0 conn(0x7f38f40700c0 legacy=0x7f38f4159340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T23:41:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.529+0000 7f38f8c37640 1 -- 172.21.15.8:0/1171043723 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f406e680 con 0x7f38f40cf640 2023-11-18T23:41:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f90a7fff640 1 -- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90a80721a0 msgr2=0x7f90a809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f90a7fff640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90a80721a0 0x7f90a809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f90a7fff640 1 -- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a80b2260 msgr2=0x7f90a82000c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f90a7fff640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a80b2260 0x7f90a82000c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f38f8c37640 1 --2- 172.21.15.8:0/1171043723 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f4071d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009820 tx=0x7f38e802b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfc9bf712d4b3d3a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f90a7fff640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c00a4a0 con 0x7f90a81592b0 2023-11-18T23:41:17.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7fdad9251640 1 -- start start 2023-11-18T23:41:17.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fdad9251640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 0x7fdad40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fdad9251640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdad406eff0 0x7fdad415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f293b3a5640 1 -- start start 2023-11-18T23:41:17.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.530+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0560000fc0 con 0x7f057815ead0 2023-11-18T23:41:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4ad274e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4ad274e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4acc0ce670 0x7f4acc09bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4ad274e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4acc1612b0 0x7f4acc09c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4ad274e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc1f8240 con 0x7f4acc1612b0 2023-11-18T23:41:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fdad9251640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdad40ced20 0x7fdad415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4ad274e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc151340 con 0x7f4acc0ce670 2023-11-18T23:41:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4ad274e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc1f7350 con 0x7f4acc0cade0 2023-11-18T23:41:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f38f37fe640 1 -- 172.21.15.8:0/1171043723 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8031520 con 0x7f38f40cf640 2023-11-18T23:41:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f38f37fe640 1 -- 172.21.15.8:0/1171043723 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8031680 con 0x7f38f40cf640 2023-11-18T23:41:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f38f37fe640 1 -- 172.21.15.8:0/1171043723 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8031a10 con 0x7f38f40cf640 2023-11-18T23:41:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fdad9251640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40b33c0 con 0x7fdad406eff0 2023-11-18T23:41:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4acbfff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fdad2d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 0x7fdad40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fdad9251640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40b3660 con 0x7fdad406a4d0 2023-11-18T23:41:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4acbfff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:53580/0 (socket says 172.21.15.8:53580) 2023-11-18T23:41:17.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fdad9251640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40b3940 con 0x7fdad40ced20 2023-11-18T23:41:17.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4acbfff640 1 -- 172.21.15.8:0/1295006901 learned_addr learned my addr 172.21.15.8:0/1295006901 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f293b3a5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0061f0 0x7f292c0526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7fb12d419640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200df3f0 0x7fb12004a7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c430 tx=0x7fb11400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f90a7fff640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81592b0 0x7f90a80cca40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c730 tx=0x7f90a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.531+0000 7f4acb7fe640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4acc0ce670 0x7f4acc09bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140074e0 con 0x7fb1200df3f0 2023-11-18T23:41:17.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f293b3a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c006be0 0x7f292c1885d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb120049000 con 0x7fb1200df3f0 2023-11-18T23:41:17.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1200d0fd0 con 0x7fb1200df3f0 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0061f0 0x7f292c0526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f293b3a5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f292c0e3300 0x7f292c0e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0061f0 0x7f292c0526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34970/0 (socket says 172.21.15.8:34970) 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 -- 172.21.15.8:0/3616515394 learned_addr learned my addr 172.21.15.8:0/3616515394 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f293b3a5640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c04cbd0 con 0x7f292c0061f0 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c052c10 con 0x7f292c006be0 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c052e40 con 0x7f292c0e3300 2023-11-18T23:41:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2938940640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c006be0 0x7f292c1885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939942640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f292c0e3300 0x7f292c0e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb114007640 con 0x7fb1200df3f0 2023-11-18T23:41:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114004a00 con 0x7fb1200df3f0 2023-11-18T23:41:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fdad359e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdad40ced20 0x7fdad415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fdad259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdad406eff0 0x7fdad415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fdad259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdad406eff0 0x7fdad415a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34962/0 (socket says 172.21.15.8:34962) 2023-11-18T23:41:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7fdad259c640 1 -- 172.21.15.8:0/4040730457 learned_addr learned my addr 172.21.15.8:0/4040730457 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0006d50 con 0x7f90a81592b0 2023-11-18T23:41:17.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0003970 con 0x7f90a81592b0 2023-11-18T23:41:17.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0003d60 con 0x7f90a81592b0 2023-11-18T23:41:17.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a8201400 con 0x7f90a81592b0 2023-11-18T23:41:17.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 -- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f292c0e3300 msgr2=0x7f292c0e5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a809c600 con 0x7f90a81592b0 2023-11-18T23:41:17.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f292c0e3300 0x7f292c0e5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 -- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c006be0 msgr2=0x7f292c1885d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f292c006be0 0x7f292c1885d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f2939141640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924009400 con 0x7f292c0061f0 2023-11-18T23:41:17.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f38f9c39640 1 -- 172.21.15.8:0/1171043723 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 msgr2=0x7f38f4071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f38f9c39640 1 --2- 172.21.15.8:0/1171043723 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f4071d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009820 tx=0x7f38e802b7c0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f2939141640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0061f0 0x7f292c0526d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f293000c440 tx=0x7f293000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb120054430 con 0x7fb1200df3f0 2023-11-18T23:41:17.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f4acbfff640 1 -- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4acc0ce670 msgr2=0x7f4acc09bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f4acbfff640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4acc0ce670 0x7f4acc09bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f4acbfff640 1 -- 172.21.15.8:0/1295006901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4acc1612b0 msgr2=0x7f4acc09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f4acbfff640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4acc1612b0 0x7f4acc09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f4acbfff640 1 -- 172.21.15.8:0/1295006901 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009a70 con 0x7f4acc0cade0 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.532+0000 7f4acbfff640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc150e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403e610 con 0x7f4acc0cade0 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc1f75c0 con 0x7f4acc0cade0 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc1f7b80 con 0x7f4acc0cade0 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac403e790 con 0x7f4acc0cade0 2023-11-18T23:41:17.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403eb40 con 0x7f4acc0cade0 2023-11-18T23:41:17.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0570014950 con 0x7f057815ead0 2023-11-18T23:41:17.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0007820 con 0x7fa0ac0545e0 2023-11-18T23:41:17.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fdad359e640 1 -- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 msgr2=0x7fdad40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fdad359e640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad406a4d0 0x7fdad40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fdad359e640 1 -- 172.21.15.8:0/4040730457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdad406eff0 msgr2=0x7fdad415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fdad359e640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdad406eff0 0x7fdad415a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fdad359e640 1 -- 172.21.15.8:0/4040730457 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009a70 con 0x7fdad40ced20 2023-11-18T23:41:17.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fdad359e640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdad40ced20 0x7fdad415ac20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c1b0 tx=0x7fdabc00c670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac0d6b00 con 0x7fa0ac0545e0 2023-11-18T23:41:17.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.533+0000 7f38f9c39640 1 -- 172.21.15.8:0/1171043723 shutdown_connections 2023-11-18T23:41:17.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f38f9c39640 1 --2- 172.21.15.8:0/1171043723 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f4071d30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f38f9c39640 1 -- 172.21.15.8:0/1171043723 >> 172.21.15.8:0/1171043723 conn(0x7f38f40ceb20 msgr2=0x7f38f40cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac0d9510 con 0x7fa0ac0545e0 2023-11-18T23:41:17.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f056effd640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f055c06af10 0x7f055c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f057008a230 con 0x7f057815ead0 2023-11-18T23:41:17.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f056effd640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:6800/555757690,v1:172.21.15.8:6801/555757690] conn(0x7f055c073130 0x7f055c075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 --> [v2:172.21.15.8:6800/555757690,v1:172.21.15.8:6801/555757690] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f055c075c00 con 0x7f055c073130 2023-11-18T23:41:17.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f057008a5e0 con 0x7f057815ead0 2023-11-18T23:41:17.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9088000fc0 con 0x7f90a81592b0 2023-11-18T23:41:17.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4aac000fc0 con 0x7f4acc0cade0 2023-11-18T23:41:17.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc005ce0 con 0x7fdad40ced20 2023-11-18T23:41:17.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc005e40 con 0x7fdad40ced20 2023-11-18T23:41:17.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0072d0 con 0x7fdad40ced20 2023-11-18T23:41:17.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad40b3c20 con 0x7fdad40ced20 2023-11-18T23:41:17.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40b41e0 con 0x7fdad40ced20 2023-11-18T23:41:17.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7f057e54c640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f055c06af10 0x7f055c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b0007980 con 0x7fa0ac0545e0 2023-11-18T23:41:17.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0007cf0 con 0x7fa0ac0545e0 2023-11-18T23:41:17.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.534+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb114004b60 con 0x7fb1200df3f0 2023-11-18T23:41:17.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7f38f9c39640 1 -- 172.21.15.8:0/1171043723 shutdown_connections 2023-11-18T23:41:17.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7f38f9c39640 1 -- 172.21.15.8:0/1171043723 wait complete. 2023-11-18T23:41:17.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0ac050b90 con 0x7fa0ac0545e0 2023-11-18T23:41:17.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7f057e54c640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f055c06af10 0x7f055c06d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05780c6a80 tx=0x7f0568008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7fb1257fa640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb10c06ae40 0x7fb10c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7f057dd4b640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:6800/555757690,v1:172.21.15.8:6801/555757690] conn(0x7f055c073130 0x7f055c075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb114089c30 con 0x7fb1200df3f0 2023-11-18T23:41:17.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7fb12cc18640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb10c06ae40 0x7fb10c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7fb1257fa640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6808/2118747924,v1:172.21.15.116:6809/2118747924] conn(0x7fb10c072fe0 0x7fb10c075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.535+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 --> [v2:172.21.15.116:6808/2118747924,v1:172.21.15.116:6809/2118747924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb10c075ab0 con 0x7fb10c072fe0 2023-11-18T23:41:17.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.536+0000 7f057dd4b640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:6800/555757690,v1:172.21.15.8:6801/555757690] conn(0x7f055c073130 0x7f055c075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.536+0000 7fb127fff640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6808/2118747924,v1:172.21.15.116:6809/2118747924] conn(0x7fb10c072fe0 0x7fb10c075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.536+0000 7fb12cc18640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb10c06ae40 0x7fb10c06d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb120048940 tx=0x7fb11c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== osd.0 v2:172.21.15.8:6800/555757690 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f055c075c00 con 0x7f055c073130 2023-11-18T23:41:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdad40aecb0 con 0x7fdad40ced20 2023-11-18T23:41:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.536+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ac403b050 con 0x7f4acc0cade0 2023-11-18T23:41:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f4ac8ff9640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4ab806af10 0x7f4ab806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ac40ab8b0 con 0x7f4acc0cade0 2023-11-18T23:41:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.536+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2930005ce0 con 0x7f292c0061f0 2023-11-18T23:41:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.536+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c188b10 con 0x7f292c0061f0 2023-11-18T23:41:17.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c0e3a00 con 0x7f292c0061f0 2023-11-18T23:41:17.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2930005e40 con 0x7f292c0061f0 2023-11-18T23:41:17.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2930007270 con 0x7f292c0061f0 2023-11-18T23:41:17.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f38f9c39640 1 Processor -- start 2023-11-18T23:41:17.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f38f9c39640 1 -- start start 2023-11-18T23:41:17.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7fb127fff640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6808/2118747924,v1:172.21.15.116:6809/2118747924] conn(0x7fb10c072fe0 0x7fb10c075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdabc007430 con 0x7fdad40ced20 2023-11-18T23:41:17.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f90a00052e0 con 0x7f90a81592b0 2023-11-18T23:41:17.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f908ffff640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f909406ae90 0x7f909406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90a0089e80 con 0x7f90a81592b0 2023-11-18T23:41:17.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fdac37fe640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdab406af10 0x7fdab406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdabc088a20 con 0x7fdad40ced20 2023-11-18T23:41:17.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f292c0583e0 con 0x7f292c0061f0 2023-11-18T23:41:17.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0b00113f0 con 0x7fa0ac0545e0 2023-11-18T23:41:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f908ffff640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:6808/3891742519,v1:172.21.15.8:6809/3891742519] conn(0x7f90940730b0 0x7f90940754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.8:6808/3891742519,v1:172.21.15.8:6809/3891742519] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9094075b80 con 0x7f90940730b0 2023-11-18T23:41:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90a008a2d0 con 0x7f90a81592b0 2023-11-18T23:41:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fdac37fe640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.8:6810/1322099792,v1:172.21.15.8:6812/1322099792] conn(0x7fdab40730b0 0x7fdab40754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 --> [v2:172.21.15.8:6810/1322099792,v1:172.21.15.8:6812/1322099792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdab4075b80 con 0x7fdab40730b0 2023-11-18T23:41:17.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f4ac8ff9640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.8:6824/993268355,v1:172.21.15.8:6825/993268355] conn(0x7f4ab8073130 0x7f4ab8075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdabc053ab0 con 0x7fdad40ced20 2023-11-18T23:41:17.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 --> [v2:172.21.15.8:6824/993268355,v1:172.21.15.8:6825/993268355] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ab8075c00 con 0x7f4ab8073130 2023-11-18T23:41:17.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ac40abc60 con 0x7f4acc0cade0 2023-11-18T23:41:17.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fdad259c640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.8:6810/1322099792,v1:172.21.15.8:6812/1322099792] conn(0x7fdab40730b0 0x7fdab40754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.537+0000 7f4acb7fe640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4ab806af10 0x7f4ab806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f4ad0ceb640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.8:6824/993268355,v1:172.21.15.8:6825/993268355] conn(0x7f4ab8073130 0x7f4ab8075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7fdad2d9d640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdab406af10 0x7fdab406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f4ad0ceb640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.8:6824/993268355,v1:172.21.15.8:6825/993268355] conn(0x7f4ab8073130 0x7f4ab8075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f38f9c39640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f40700c0 0x7f38f413f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fdad259c640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.8:6810/1322099792,v1:172.21.15.8:6812/1322099792] conn(0x7fdab40730b0 0x7fdab40754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f38f9c39640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40cca20 0x7f38f40ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f38f9c39640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f409b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f90a6ffd640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:6808/3891742519,v1:172.21.15.8:6809/3891742519] conn(0x7f90940730b0 0x7f90940754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.538+0000 7f90a77fe640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f909406ae90 0x7f909406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f90a6ffd640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:6808/3891742519,v1:172.21.15.8:6809/3891742519] conn(0x7f90940730b0 0x7f90940754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb114058810 con 0x7fb1200df3f0 2023-11-18T23:41:17.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== osd.6 v2:172.21.15.116:6808/2118747924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb10c075ab0 con 0x7fb10c072fe0 2023-11-18T23:41:17.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f38f8c37640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f40700c0 0x7f38f413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f38f8c37640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f40700c0 0x7f38f413f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:47364/0 (socket says 172.21.15.8:47364) 2023-11-18T23:41:17.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f90a77fe640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f909406ae90 0x7f909406d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9098001c10 tx=0x7f9098001ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f38f9c39640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f409c770 con 0x7f38f40cca20 2023-11-18T23:41:17.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fdad2d9d640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdab406af10 0x7fdab406d3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdacc036000 tx=0x7fdacc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fa0a9ffb640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa09806af10 0x7fa09806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0b0089e20 con 0x7fa0ac0545e0 2023-11-18T23:41:17.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fa0b90ab640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa09806af10 0x7fa09806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fa0a9ffb640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6810/422496807,v1:172.21.15.116:6812/422496807] conn(0x7fa098073130 0x7fa098075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 --> [v2:172.21.15.116:6810/422496807,v1:172.21.15.116:6812/422496807] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa098075c00 con 0x7fa098073130 2023-11-18T23:41:17.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b008a1d0 con 0x7fa0ac0545e0 2023-11-18T23:41:17.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7fa0b98ac640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6810/422496807,v1:172.21.15.116:6812/422496807] conn(0x7fa098073130 0x7fa098075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f4acb7fe640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4ab806af10 0x7f4ab806d3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4acc151610 tx=0x7f4ac0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.539+0000 7f38f8c37640 1 -- 172.21.15.8:0/2337008336 learned_addr learned my addr 172.21.15.8:0/2337008336 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f3fff640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40cca20 0x7f38f40ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f9438640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f409b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f409c490 con 0x7f38f40700c0 2023-11-18T23:41:17.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f415b900 con 0x7f38f40cf640 2023-11-18T23:41:17.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== osd.1 v2:172.21.15.8:6810/1322099792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdab4075b80 con 0x7fdab40730b0 2023-11-18T23:41:17.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== osd.3 v2:172.21.15.8:6824/993268355 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4ab8075c00 con 0x7f4ab8073130 2023-11-18T23:41:17.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7fa0b90ab640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa09806af10 0x7fa09806d3d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0076b0 tx=0x7fa0b40aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== osd.2 v2:172.21.15.8:6808/3891742519 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9094075b80 con 0x7f90940730b0 2023-11-18T23:41:17.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7fa0b98ac640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6810/422496807,v1:172.21.15.116:6812/422496807] conn(0x7fa098073130 0x7fa098075550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f8c37640 1 -- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 msgr2=0x7f38f409b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f8c37640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38f40cf640 0x7f38f409b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f8c37640 1 -- 172.21.15.8:0/2337008336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40cca20 msgr2=0x7f38f40ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f8c37640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38f40cca20 0x7f38f40ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.540+0000 7f38f8c37640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80094d0 con 0x7f38f40700c0 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7f38f8c37640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f40700c0 0x7f38f413f410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f38e802b800 tx=0x7f38e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e803fb80 con 0x7f38f40700c0 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8043070 con 0x7f38f40700c0 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f415bbe0 con 0x7f38f40700c0 2023-11-18T23:41:17.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.541+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f413f950 con 0x7f38f40700c0 2023-11-18T23:41:17.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2930007490 con 0x7f292c0061f0 2023-11-18T23:41:17.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7f2929ffb640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f291806ae40 0x7f291806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2930089040 con 0x7f292c0061f0 2023-11-18T23:41:17.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7f2929ffb640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6800/2991510677,v1:172.21.15.116:6801/2991510677] conn(0x7f2918072fe0 0x7f2918075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.116:6800/2991510677,v1:172.21.15.116:6801/2991510677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2918075ab0 con 0x7f2918072fe0 2023-11-18T23:41:17.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2930089490 con 0x7f292c0061f0 2023-11-18T23:41:17.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80336c0 con 0x7f38f40700c0 2023-11-18T23:41:17.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.542+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== osd.7 v2:172.21.15.116:6810/422496807 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa098075c00 con 0x7fa098073130 2023-11-18T23:41:17.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.543+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38f406c850 con 0x7f38f40700c0 2023-11-18T23:41:17.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.543+0000 7f2938940640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f291806ae40 0x7f291806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.544+0000 7f2939942640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6800/2991510677,v1:172.21.15.116:6801/2991510677] conn(0x7f2918072fe0 0x7f2918075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.544+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38e8069d50 con 0x7f38f40700c0 2023-11-18T23:41:17.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f38f17fa640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e006af10 0x7f38e006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f2939942640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6800/2991510677,v1:172.21.15.116:6801/2991510677] conn(0x7f2918072fe0 0x7f2918075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38e80af3b0 con 0x7f38f40700c0 2023-11-18T23:41:17.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f38f17fa640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6824/1164600341,v1:172.21.15.116:6825/1164600341] conn(0x7f38e0072fc0 0x7f38e00753e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f2938940640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f291806ae40 0x7f291806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2924036000 tx=0x7f2924008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f38f3fff640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e006af10 0x7f38e006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:6824/1164600341,v1:172.21.15.116:6825/1164600341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38e0075a90 con 0x7f38e0072fc0 2023-11-18T23:41:17.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38e80af760 con 0x7f38f40700c0 2023-11-18T23:41:17.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.545+0000 7f38f9438640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6824/1164600341,v1:172.21.15.116:6825/1164600341] conn(0x7f38e0072fc0 0x7f38e00753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.546+0000 7f38f9438640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6824/1164600341,v1:172.21.15.116:6825/1164600341] conn(0x7f38e0072fc0 0x7f38e00753e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.546+0000 7f38f3fff640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e006af10 0x7f38e006d3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38f40b4fe0 tx=0x7f38e40090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.546+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== osd.4 v2:172.21.15.116:6800/2991510677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2918075ab0 con 0x7f2918072fe0 2023-11-18T23:41:17.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.550+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== osd.5 v2:172.21.15.116:6824/1164600341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f38e0075a90 con 0x7f38e0072fc0 2023-11-18T23:41:17.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.565+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 --> [v2:172.21.15.8:6800/555757690,v1:172.21.15.8:6801/555757690] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0560002ce0 con 0x7f055c073130 2023-11-18T23:41:17.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.565+0000 7f056effd640 1 -- 172.21.15.8:0/1891593101 <== osd.0 v2:172.21.15.8:6800/555757690 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0560002ce0 con 0x7f055c073130 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.566+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:6800/555757690,v1:172.21.15.8:6801/555757690] conn(0x7f055c073130 msgr2=0x7f055c075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.566+0000 7f05807b0640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:6800/555757690,v1:172.21.15.8:6801/555757690] conn(0x7f055c073130 0x7f055c075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.566+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f055c06af10 msgr2=0x7f055c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.566+0000 7f05807b0640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f055c06af10 0x7f055c06d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05780c6a80 tx=0x7f0568008030 comp rx=0 tx=0).stop 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.566+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f057815ead0 msgr2=0x7f05780c2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.566+0000 7f05807b0640 1 --2- 172.21.15.8:0/1891593101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f057815ead0 0x7f05780c2850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f057000be20 tx=0x7f057000bf10 comp rx=0 tx=0).stop 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.566+0000 7f057ed4d640 1 -- 172.21.15.8:0/1891593101 reap_dead start 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.567+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 shutdown_connections 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.567+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 >> 172.21.15.8:0/1891593101 conn(0x7f05780cfc00 msgr2=0x7f057815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.568+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 shutdown_connections 2023-11-18T23:41:17.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.568+0000 7f05807b0640 1 -- 172.21.15.8:0/1891593101 wait complete. 2023-11-18T23:41:17.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.571+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 --> [v2:172.21.15.116:6808/2118747924,v1:172.21.15.116:6809/2118747924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb120048e90 con 0x7fb10c072fe0 2023-11-18T23:41:17.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.572+0000 7fb1257fa640 1 -- 172.21.15.8:0/260388817 <== osd.6 v2:172.21.15.116:6808/2118747924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb120048e90 con 0x7fb10c072fe0 2023-11-18T23:41:17.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.573+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 --> [v2:172.21.15.8:6810/1322099792,v1:172.21.15.8:6812/1322099792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdad406db20 con 0x7fdab40730b0 2023-11-18T23:41:17.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.573+0000 7fdac37fe640 1 -- 172.21.15.8:0/4040730457 <== osd.1 v2:172.21.15.8:6810/1322099792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdac4001360 con 0x7fdab40730b0 2023-11-18T23:41:17.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.573+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6808/2118747924,v1:172.21.15.116:6809/2118747924] conn(0x7fb10c072fe0 msgr2=0x7fb10c075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.573+0000 7fb12dc1a640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6808/2118747924,v1:172.21.15.116:6809/2118747924] conn(0x7fb10c072fe0 0x7fb10c075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.573+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb10c06ae40 msgr2=0x7fb10c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.573+0000 7fb12dc1a640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb10c06ae40 0x7fb10c06d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb120048940 tx=0x7fb11c009060 comp rx=0 tx=0).stop 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200df3f0 msgr2=0x7fb12004a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fb12dc1a640 1 --2- 172.21.15.8:0/260388817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1200df3f0 0x7fb12004a7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c430 tx=0x7fb11400c8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fb12d419640 1 -- 172.21.15.8:0/260388817 reap_dead start 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 shutdown_connections 2023-11-18T23:41:17.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 >> 172.21.15.8:0/260388817 conn(0x7fb120055320 msgr2=0x7fb120006a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 >> [v2:172.21.15.8:6810/1322099792,v1:172.21.15.8:6812/1322099792] conn(0x7fdab40730b0 msgr2=0x7fdab40754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fdad9251640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.8:6810/1322099792,v1:172.21.15.8:6812/1322099792] conn(0x7fdab40730b0 0x7fdab40754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdab406af10 msgr2=0x7fdab406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fdad9251640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdab406af10 0x7fdab406d3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdacc036000 tx=0x7fdacc030000 comp rx=0 tx=0).stop 2023-11-18T23:41:17.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdad40ced20 msgr2=0x7fdad415ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fdad9251640 1 --2- 172.21.15.8:0/4040730457 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdad40ced20 0x7fdad415ac20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c1b0 tx=0x7fdabc00c670 comp rx=0 tx=0).stop 2023-11-18T23:41:17.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 shutdown_connections 2023-11-18T23:41:17.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fb12dc1a640 1 -- 172.21.15.8:0/260388817 wait complete. 2023-11-18T23:41:17.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.574+0000 7fdad359e640 1 -- 172.21.15.8:0/4040730457 reap_dead start 2023-11-18T23:41:17.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.575+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 --> [v2:172.21.15.116:6800/2991510677,v1:172.21.15.116:6801/2991510677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f292c058be0 con 0x7f2918072fe0 2023-11-18T23:41:17.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.575+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 --> [v2:172.21.15.8:6824/993268355,v1:172.21.15.8:6825/993268355] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4aac002cb0 con 0x7f4ab8073130 2023-11-18T23:41:17.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.575+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 shutdown_connections 2023-11-18T23:41:17.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.575+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 >> 172.21.15.8:0/4040730457 conn(0x7fdad40cbff0 msgr2=0x7fdad4162420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.575+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 shutdown_connections 2023-11-18T23:41:17.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.575+0000 7fdad9251640 1 -- 172.21.15.8:0/4040730457 wait complete. 2023-11-18T23:41:17.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.575+0000 7f2929ffb640 1 -- 172.21.15.8:0/3616515394 <== osd.4 v2:172.21.15.116:6800/2991510677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2918075ab0 con 0x7f2918072fe0 2023-11-18T23:41:17.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f4ac8ff9640 1 -- 172.21.15.8:0/1295006901 <== osd.3 v2:172.21.15.8:6824/993268355 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4aac002cb0 con 0x7f4ab8073130 2023-11-18T23:41:17.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6800/2991510677,v1:172.21.15.116:6801/2991510677] conn(0x7f2918072fe0 msgr2=0x7f2918075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6800/2991510677,v1:172.21.15.116:6801/2991510677] conn(0x7f2918072fe0 0x7f2918075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f291806ae40 msgr2=0x7f291806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f291806ae40 0x7f291806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2924036000 tx=0x7f2924008030 comp rx=0 tx=0).stop 2023-11-18T23:41:17.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0061f0 msgr2=0x7f292c0526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 --2- 172.21.15.8:0/3616515394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0061f0 0x7f292c0526d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f293000c440 tx=0x7f293000c900 comp rx=0 tx=0).stop 2023-11-18T23:41:17.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f2939942640 1 -- 172.21.15.8:0/3616515394 reap_dead start 2023-11-18T23:41:17.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 shutdown_connections 2023-11-18T23:41:17.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 >> 172.21.15.8:0/3616515394 conn(0x7f292c058ef0 msgr2=0x7f292c039f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 --> [v2:172.21.15.116:6810/422496807,v1:172.21.15.116:6812/422496807] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0ac050130 con 0x7fa098073130 2023-11-18T23:41:17.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 shutdown_connections 2023-11-18T23:41:17.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 --> [v2:172.21.15.8:6808/3891742519,v1:172.21.15.8:6809/3891742519] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9088002ce0 con 0x7f90940730b0 2023-11-18T23:41:17.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.576+0000 7f293b3a5640 1 -- 172.21.15.8:0/3616515394 wait complete. 2023-11-18T23:41:17.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 >> [v2:172.21.15.8:6824/993268355,v1:172.21.15.8:6825/993268355] conn(0x7f4ab8073130 msgr2=0x7f4ab8075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.8:6824/993268355,v1:172.21.15.8:6825/993268355] conn(0x7f4ab8073130 0x7f4ab8075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f908ffff640 1 -- 172.21.15.8:0/2029534177 <== osd.2 v2:172.21.15.8:6808/3891742519 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9088002ce0 con 0x7f90940730b0 2023-11-18T23:41:17.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4ab806af10 msgr2=0x7f4ab806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4ab806af10 0x7f4ab806d3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4acc151610 tx=0x7f4ac0009040 comp rx=0 tx=0).stop 2023-11-18T23:41:17.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 msgr2=0x7f4acc150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 --2- 172.21.15.8:0/1295006901 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4acc0cade0 0x7f4acc150e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac4004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad0ceb640 1 -- 172.21.15.8:0/1295006901 reap_dead start 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 shutdown_connections 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 >> 172.21.15.8:0/1295006901 conn(0x7f4acc0b0ca0 msgr2=0x7f4acc06c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.577+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 shutdown_connections 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:6808/3891742519,v1:172.21.15.8:6809/3891742519] conn(0x7f90940730b0 msgr2=0x7f90940754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:6808/3891742519,v1:172.21.15.8:6809/3891742519] conn(0x7f90940730b0 0x7f90940754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f4ad274e640 1 -- 172.21.15.8:0/1295006901 wait complete. 2023-11-18T23:41:17.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7fa0a9ffb640 1 -- 172.21.15.8:0/3046447086 <== osd.7 v2:172.21.15.116:6810/422496807 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0a40094a0 con 0x7fa098073130 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f909406ae90 msgr2=0x7f909406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f909406ae90 0x7f909406d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9098001c10 tx=0x7f9098001ba0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81592b0 msgr2=0x7f90a80cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 --2- 172.21.15.8:0/2029534177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81592b0 0x7f90a80cca40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c730 tx=0x7f90a000cbf0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90a7fff640 1 -- 172.21.15.8:0/2029534177 reap_dead start 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 shutdown_connections 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 >> 172.21.15.8:0/2029534177 conn(0x7f90a806a4d0 msgr2=0x7f90a806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 shutdown_connections 2023-11-18T23:41:17.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7f90ae0d7640 1 -- 172.21.15.8:0/2029534177 wait complete. 2023-11-18T23:41:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.578+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6810/422496807,v1:172.21.15.116:6812/422496807] conn(0x7fa098073130 msgr2=0x7fa098075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6810/422496807,v1:172.21.15.116:6812/422496807] conn(0x7fa098073130 0x7fa098075550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa09806af10 msgr2=0x7fa09806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa09806af10 0x7fa09806d3d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0076b0 tx=0x7fa0b40aa000 comp rx=0 tx=0).stop 2023-11-18T23:41:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0ac0545e0 msgr2=0x7fa0ac0d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 --2- 172.21.15.8:0/3046447086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0ac0545e0 0x7fa0ac0d4bc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c7f0 tx=0x7fa0b000ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0b98ac640 1 -- 172.21.15.8:0/3046447086 reap_dead start 2023-11-18T23:41:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 shutdown_connections 2023-11-18T23:41:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 >> 172.21.15.8:0/3046447086 conn(0x7fa0ac055310 msgr2=0x7fa0ac0dfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 shutdown_connections 2023-11-18T23:41:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.579+0000 7fa0bb30f640 1 -- 172.21.15.8:0/3046447086 wait complete. 2023-11-18T23:41:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.580+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 --> [v2:172.21.15.116:6824/1164600341,v1:172.21.15.116:6825/1164600341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38f415c100 con 0x7f38e0072fc0 2023-11-18T23:41:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.581+0000 7f38f17fa640 1 -- 172.21.15.8:0/2337008336 <== osd.5 v2:172.21.15.116:6824/1164600341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f38f415c100 con 0x7f38e0072fc0 2023-11-18T23:41:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.582+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6824/1164600341,v1:172.21.15.116:6825/1164600341] conn(0x7f38e0072fc0 msgr2=0x7f38e00753e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.582+0000 7f38f9c39640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6824/1164600341,v1:172.21.15.116:6825/1164600341] conn(0x7f38e0072fc0 0x7f38e00753e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.582+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e006af10 msgr2=0x7f38e006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.582+0000 7f38f9c39640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e006af10 0x7f38e006d3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38f40b4fe0 tx=0x7f38e40090e0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.582+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f40700c0 msgr2=0x7f38f413f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.582+0000 7f38f9c39640 1 --2- 172.21.15.8:0/2337008336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f40700c0 0x7f38f413f410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f38e802b800 tx=0x7f38e80046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.582+0000 7f38f9438640 1 -- 172.21.15.8:0/2337008336 reap_dead start 2023-11-18T23:41:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.583+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 shutdown_connections 2023-11-18T23:41:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.583+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 >> 172.21.15.8:0/2337008336 conn(0x7f38f40ceb20 msgr2=0x7f38f41502b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.583+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 shutdown_connections 2023-11-18T23:41:17.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.583+0000 7f38f9c39640 1 -- 172.21.15.8:0/2337008336 wait complete. 2023-11-18T23:41:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:17.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T23:41:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:17.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T23:41:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:17.638 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T23:41:17.639 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:17.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T23:41:17.640 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-11-18T23:41:17.640 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T23:41:17.641 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-11-18T23:41:17.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T23:41:17.642 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:17.642 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T23:41:17.643 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-11-18T23:41:17.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T23:41:17.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.859+0000 7fad4ecaf640 1 Processor -- start 2023-11-18T23:41:17.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.859+0000 7fad4ecaf640 1 -- start start 2023-11-18T23:41:17.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.858+0000 7f20e3440640 1 Processor -- start 2023-11-18T23:41:17.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.858+0000 7f20e3440640 1 -- start start 2023-11-18T23:41:17.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.859+0000 7f20e3440640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f20dc15bd10 0x7f20dc165a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.859+0000 7f20e3440640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0cf6a0 con 0x7f20dc06abe0 2023-11-18T23:41:17.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.859+0000 7f20e3440640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0cd950 con 0x7f20dc06eb90 2023-11-18T23:41:17.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.859+0000 7f20e3440640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc166030 con 0x7f20dc15bd10 2023-11-18T23:41:17.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.860+0000 7f20e243e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f20dc15bd10 0x7f20dc165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.860+0000 7f20e243e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f20dc15bd10 0x7f20dc165a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53496/0 (socket says 172.21.15.8:53496) 2023-11-18T23:41:17.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.860+0000 7f20e243e640 1 -- 172.21.15.8:0/1825943982 learned_addr learned my addr 172.21.15.8:0/1825943982 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.860+0000 7f20e243e640 1 -- 172.21.15.8:0/1825943982 >> v1:172.21.15.116:6789/0 conn(0x7f20dc06eb90 legacy=0x7f20dc06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.860+0000 7f20e243e640 1 -- 172.21.15.8:0/1825943982 >> v1:172.21.15.8:6789/0 conn(0x7f20dc06abe0 legacy=0x7f20dc0c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.860+0000 7f20e243e640 1 -- 172.21.15.8:0/1825943982 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0cdc30 con 0x7f20dc15bd10 2023-11-18T23:41:17.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.860+0000 7fad4ecaf640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fad48159010 0x7fad480ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7faf614a2640 1 Processor -- start 2023-11-18T23:41:17.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f76348b4640 1 Processor -- start 2023-11-18T23:41:17.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7fad4ecaf640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4815d070 con 0x7fad4806c9f0 2023-11-18T23:41:17.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f0872b2c640 1 Processor -- start 2023-11-18T23:41:17.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f76348b4640 1 -- start start 2023-11-18T23:41:17.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f94d535e640 1 Processor -- start 2023-11-18T23:41:17.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f0872b2c640 1 -- start start 2023-11-18T23:41:17.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7fad4ecaf640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4815d350 con 0x7fad481593f0 2023-11-18T23:41:17.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f20e243e640 1 --2- 172.21.15.8:0/1825943982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc15bd10 0x7f20dc165a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009870 tx=0x7f20d802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e682451d4bb395 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7fad4ecaf640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4815d630 con 0x7fad48159010 2023-11-18T23:41:17.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f94d535e640 1 -- start start 2023-11-18T23:41:17.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7fad4d24c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fad4806c9f0 0x7fad4806cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47686/0 (socket says 172.21.15.8:47686) 2023-11-18T23:41:17.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7fad4d24c640 1 -- 172.21.15.8:0/3951130786 learned_addr learned my addr 172.21.15.8:0/3951130786 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7fad47fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fad481593f0 0x7fad48070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:44752/0 (socket says 172.21.15.8:44752) 2023-11-18T23:41:17.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7fad4ca4b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fad48159010 0x7fad480ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.861+0000 7f20e143c640 1 -- 172.21.15.8:0/1825943982 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8031870 con 0x7f20dc15bd10 2023-11-18T23:41:17.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7f20e143c640 1 -- 172.21.15.8:0/1825943982 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d80319d0 con 0x7f20dc15bd10 2023-11-18T23:41:17.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135616376 0 0) 0x7fad4815d350 con 0x7fad481593f0 2023-11-18T23:41:17.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad30003520 con 0x7fad481593f0 2023-11-18T23:41:17.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7f20e143c640 1 -- 172.21.15.8:0/1825943982 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8031d60 con 0x7f20dc15bd10 2023-11-18T23:41:17.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206421366 0 0) 0x7fad4815d070 con 0x7fad4806c9f0 2023-11-18T23:41:17.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4815d350 con 0x7fad4806c9f0 2023-11-18T23:41:17.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7faf614a2640 1 -- start start 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3007178378 0 0) 0x7fad30003520 con 0x7fad481593f0 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 >> v2:172.21.15.8:3300/0 conn(0x7fad48159010 msgr2=0x7fad480ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 --2- 172.21.15.8:0/3951130786 >> v2:172.21.15.8:3300/0 conn(0x7fad48159010 0x7fad480ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 >> v1:172.21.15.8:6789/0 conn(0x7fad4806c9f0 legacy=0x7fad4806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4815d910 con 0x7fad481593f0 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fad38001670 con 0x7fad481593f0 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 >> v1:172.21.15.116:6789/0 conn(0x7fad481593f0 legacy=0x7fad48070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad30003b50 0x7fad30003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.862+0000 7fad477fe640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad300047c0 0x7fad30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad477fe640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad300051d0 0x7fad3000ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f0872b2c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f086c0cfc10 0x7f086c0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40001460 con 0x7fad300051d0 2023-11-18T23:41:17.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815d630 con 0x7fad300047c0 2023-11-18T23:41:17.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad4d24c640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad300051d0 0x7fad3000ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3000c200 con 0x7fad30003b50 2023-11-18T23:41:17.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f20e3440640 1 -- 172.21.15.8:0/1825943982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc15bd10 msgr2=0x7f20dc165a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f20e3440640 1 --2- 172.21.15.8:0/1825943982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc15bd10 0x7f20dc165a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009870 tx=0x7f20d802b910 comp rx=0 tx=0).stop 2023-11-18T23:41:17.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad4ca4b640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad30003b50 0x7fad30003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f0872b2c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0d3e70 con 0x7f086c0b1f50 2023-11-18T23:41:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f086bfff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f086c0cf4f0 0x7f086c0d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:44760/0 (socket says 172.21.15.8:44760) 2023-11-18T23:41:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f086bfff640 1 -- 172.21.15.8:0/3750899458 learned_addr learned my addr 172.21.15.8:0/3750899458 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f0872b2c640 1 -- 172.21.15.8:0/3750899458 --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0cf0f0 con 0x7f086c0cf4f0 2023-11-18T23:41:17.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f0872b2c640 1 -- 172.21.15.8:0/3750899458 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0ce7c0 con 0x7f086c0cfc10 2023-11-18T23:41:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f20e3440640 1 -- 172.21.15.8:0/1825943982 shutdown_connections 2023-11-18T23:41:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f20e3440640 1 --2- 172.21.15.8:0/1825943982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc15bd10 0x7f20dc165a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f20e3440640 1 -- 172.21.15.8:0/1825943982 >> 172.21.15.8:0/1825943982 conn(0x7f20dc0b1750 msgr2=0x7f20dc0b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f76348b4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76301592b0 0x7f76300b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7faf614a2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faf5c160980 0x7faf5c0d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7faf614a2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0d05d0 con 0x7faf5c0b1f10 2023-11-18T23:41:17.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7faf614a2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0d0870 con 0x7faf5c0d0110 2023-11-18T23:41:17.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7faf614a2640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0cf1d0 con 0x7faf5c160980 2023-11-18T23:41:17.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad47fff640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad300047c0 0x7fad30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f762e59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76301592b0 0x7f76300b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad4d24c640 1 -- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad30003b50 msgr2=0x7fad30003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad4d24c640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad30003b50 0x7fad30003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad4d24c640 1 -- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad300047c0 msgr2=0x7fad30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad4d24c640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad300047c0 0x7fad30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7fad4d24c640 1 -- 172.21.15.8:0/3951130786 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30003520 con 0x7fad300051d0 2023-11-18T23:41:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f20e3440640 1 -- 172.21.15.8:0/1825943982 shutdown_connections 2023-11-18T23:41:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f94d535e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f94d0160980 0x7f94d00d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f36334ec640 1 Processor -- start 2023-11-18T23:41:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125660059 0 0) 0x7f086c0cf0f0 con 0x7f086c0cf4f0 2023-11-18T23:41:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854003520 con 0x7f086c0cf4f0 2023-11-18T23:41:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7faf5a7fc640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faf5c0b1f10 0x7faf5c0cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47694/0 (socket says 172.21.15.8:47694) 2023-11-18T23:41:17.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7faf5a7fc640 1 -- 172.21.15.8:0/1940764619 learned_addr learned my addr 172.21.15.8:0/1940764619 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7faf5affd640 1 --2- 172.21.15.8:0/1940764619 >> v2:172.21.15.116:3300/0 conn(0x7faf5c160980 0x7faf5c0d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94d535e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94d00d0110 0x7f94d00b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f762e59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76301592b0 0x7f76300b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48408/0 (socket says 172.21.15.8:48408) 2023-11-18T23:41:17.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94d535e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d00d05d0 con 0x7f94d00b1f10 2023-11-18T23:41:17.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f76348b4640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7630159690 con 0x7f76300b2260 2023-11-18T23:41:17.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f08708c8640 1 --2- 172.21.15.8:0/3750899458 >> v2:172.21.15.116:3300/0 conn(0x7f086c0cfc10 0x7f086c0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f76348b4640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763015cea0 con 0x7f76300721a0 2023-11-18T23:41:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332654063 0 0) 0x7f0854003520 con 0x7f086c0cf4f0 2023-11-18T23:41:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 >> v2:172.21.15.116:3300/0 conn(0x7f086c0cfc10 msgr2=0x7f086c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 --2- 172.21.15.8:0/3750899458 >> v2:172.21.15.116:3300/0 conn(0x7f086c0cfc10 0x7f086c0d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 >> v1:172.21.15.8:6789/0 conn(0x7f086c0b1f50 legacy=0x7f086c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f762ed9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f76300b2260 0x7f76300cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47704/0 (socket says 172.21.15.8:47704) 2023-11-18T23:41:17.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0ceaa0 con 0x7f086c0cf4f0 2023-11-18T23:41:17.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f762ed9d640 1 -- 172.21.15.8:0/954388736 learned_addr learned my addr 172.21.15.8:0/954388736 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f76348b4640 1 -- 172.21.15.8:0/954388736 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300716b0 con 0x7f76301592b0 2023-11-18T23:41:17.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94d535e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00cf1d0 con 0x7f94d0160980 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f0860001670 con 0x7f086c0cf4f0 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 >> v1:172.21.15.116:6789/0 conn(0x7f086c0cf4f0 legacy=0x7f086c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0854003970 0x7f0854003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f0854004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08540052a0 0x7f085400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0ce7c0 con 0x7f08540052a0 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c1a0 con 0x7f08540047c0 2023-11-18T23:41:17.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c360 con 0x7f0854003970 2023-11-18T23:41:17.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94d535e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00d0870 con 0x7f94d00d0110 2023-11-18T23:41:17.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94cf7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94d00d0110 0x7f94d00b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94cf7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94d00d0110 0x7f94d00b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53534/0 (socket says 172.21.15.8:53534) 2023-11-18T23:41:17.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94cf7fe640 1 -- 172.21.15.8:0/3575700847 learned_addr learned my addr 172.21.15.8:0/3575700847 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f36334ec640 1 -- start start 2023-11-18T23:41:17.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f20e3440640 1 -- 172.21.15.8:0/1825943982 wait complete. 2023-11-18T23:41:17.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7fad4d24c640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad300051d0 0x7fad3000ba00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c670 tx=0x7fad300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6559774593e6bacb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7fad4d24c640 1 -- 172.21.15.8:0/3951130786 reap_dead start 2023-11-18T23:41:17.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400072d0 con 0x7fad300051d0 2023-11-18T23:41:17.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4002f070 con 0x7fad300051d0 2023-11-18T23:41:17.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7fad477fe640 1 -- 172.21.15.8:0/3951130786 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40007690 con 0x7fad300051d0 2023-11-18T23:41:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f08708c8640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0854003970 0x7f0854003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f086bfff640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f0854004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f086bfff640 1 -- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0854003970 msgr2=0x7f0854003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f086bfff640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0854003970 0x7f0854003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.863+0000 7f15f07f5640 1 Processor -- start 2023-11-18T23:41:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f15f07f5640 1 -- start start 2023-11-18T23:41:17.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94cf7fe640 1 -- 172.21.15.8:0/3575700847 >> v2:172.21.15.8:3300/0 conn(0x7f94d0160980 msgr2=0x7f94d00d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94cf7fe640 1 --2- 172.21.15.8:0/3575700847 >> v2:172.21.15.8:3300/0 conn(0x7f94d0160980 0x7f94d00d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94cf7fe640 1 -- 172.21.15.8:0/3575700847 >> v1:172.21.15.8:6789/0 conn(0x7f94d00b1f10 legacy=0x7f94d00cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f94cf7fe640 1 -- 172.21.15.8:0/3575700847 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00ce6f0 con 0x7f94d00d0110 2023-11-18T23:41:17.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f086bfff640 1 -- 172.21.15.8:0/3750899458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08540052a0 msgr2=0x7f085400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f086bfff640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08540052a0 0x7f085400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f086bfff640 1 -- 172.21.15.8:0/3750899458 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0ceaa0 con 0x7f08540047c0 2023-11-18T23:41:17.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f08710c9640 1 -- 172.21.15.8:0/3750899458 reap_dead start 2023-11-18T23:41:17.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783849118 0 0) 0x7f7630159690 con 0x7f76300b2260 2023-11-18T23:41:17.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7618003520 con 0x7f76300b2260 2023-11-18T23:41:17.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669896955 0 0) 0x7f763015cea0 con 0x7f76300721a0 2023-11-18T23:41:17.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7630159690 con 0x7f76300721a0 2023-11-18T23:41:17.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027141346 0 0) 0x7f7630159690 con 0x7f76300721a0 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 >> v2:172.21.15.8:3300/0 conn(0x7f76301592b0 msgr2=0x7f76300b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 --2- 172.21.15.8:0/954388736 >> v2:172.21.15.8:3300/0 conn(0x7f76301592b0 0x7f76300b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 >> v1:172.21.15.8:6789/0 conn(0x7f76300b2260 legacy=0x7f76300cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763015d180 con 0x7f76300721a0 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f7620001670 con 0x7f76300721a0 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 >> v1:172.21.15.116:6789/0 conn(0x7f76300721a0 legacy=0x7f76300b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7618004b60 0x7f7618004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618003760 0x7f7618003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7618004240 0x7f761800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624001230 con 0x7f7618003760 2023-11-18T23:41:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76300716b0 con 0x7f7618004240 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761800c1f0 con 0x7f7618004b60 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762e59c640 1 --2- 172.21.15.8:0/954388736 >> v2:172.21.15.8:3300/0 conn(0x7f76301592b0 0x7f76300b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762ed9d640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7618004240 0x7f761800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762dd9b640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618003760 0x7f7618003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7faf59ffb640 1 -- 172.21.15.8:0/1940764619 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055011751 0 0) 0x7faf5c0d0870 con 0x7faf5c0d0110 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.864+0000 7faf59ffb640 1 -- 172.21.15.8:0/1940764619 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf44003520 con 0x7faf5c0d0110 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7faf5affd640 1 -- 172.21.15.8:0/1940764619 >> v1:172.21.15.116:6789/0 conn(0x7faf5c0d0110 legacy=0x7faf5c0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7faf5affd640 1 -- 172.21.15.8:0/1940764619 >> v1:172.21.15.8:6789/0 conn(0x7faf5c0b1f10 legacy=0x7faf5c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7faf5affd640 1 -- 172.21.15.8:0/1940764619 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0ce6f0 con 0x7faf5c160980 2023-11-18T23:41:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762ed9d640 1 -- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7618004b60 msgr2=0x7f7618004f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-18T23:41:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f36334ec640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f36334ec640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f362c0b41d0 0x7f362c0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f36334ec640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c0b2d30 con 0x7f362c160780 2023-11-18T23:41:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f36334ec640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c0d0b30 con 0x7f362c0b41d0 2023-11-18T23:41:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f36334ec640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0d0df0 con 0x7f362c0d0040 2023-11-18T23:41:17.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762ed9d640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7618004b60 0x7f7618004f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f3632ceb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f362c0b41d0 0x7f362c0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f3632ceb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f362c0b41d0 0x7f362c0cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53552/0 (socket says 172.21.15.8:53552) 2023-11-18T23:41:17.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f3632ceb640 1 -- 172.21.15.8:0/2515133093 learned_addr learned my addr 172.21.15.8:0/2515133093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762ed9d640 1 -- 172.21.15.8:0/954388736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618003760 msgr2=0x7f7618003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762ed9d640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618003760 0x7f7618003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f762ed9d640 1 -- 172.21.15.8:0/954388736 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630159690 con 0x7f7618004240 2023-11-18T23:41:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.865+0000 7f20e3440640 1 Processor -- start 2023-11-18T23:41:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f20e3440640 1 -- start start 2023-11-18T23:41:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f3631ce9640 1 --2- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f94cf7fe640 1 --2- 172.21.15.8:0/3575700847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d00b2890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d008d6f0 tx=0x7f94c802bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc200e7ac8b0721 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f15f07f5640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f15e0053c10 0x7f15e0007630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f15f07f5640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e00e79a0 con 0x7f15e0058990 2023-11-18T23:41:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f15ee591640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f15e00e75c0 0x7f15e0053500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:44774/0 (socket says 172.21.15.8:44774) 2023-11-18T23:41:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f15ee591640 1 -- 172.21.15.8:0/3794704886 learned_addr learned my addr 172.21.15.8:0/3794704886 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f086bfff640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f0854004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f086000c260 tx=0x7f08540057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adf686016fd84091 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.866+0000 7f15f07f5640 1 -- 172.21.15.8:0/3794704886 --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e0006590 con 0x7f15e00e75c0 2023-11-18T23:41:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f15edd90640 1 --2- 172.21.15.8:0/3794704886 >> v2:172.21.15.8:3300/0 conn(0x7f15e0053c10 0x7f15e0007630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f15f07f5640 1 -- 172.21.15.8:0/3794704886 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e0007b70 con 0x7f15e0053c10 2023-11-18T23:41:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f94cdffb640 1 -- 172.21.15.8:0/3575700847 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c802c960 con 0x7f94d00d0110 2023-11-18T23:41:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f94cdffb640 1 -- 172.21.15.8:0/3575700847 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c802cac0 con 0x7f94d00d0110 2023-11-18T23:41:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f94cdffb640 1 -- 172.21.15.8:0/3575700847 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c802c960 con 0x7f94d00d0110 2023-11-18T23:41:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7fad4ecaf640 1 -- 172.21.15.8:0/3951130786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad300051d0 msgr2=0x7fad3000ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7faf5affd640 1 --2- 172.21.15.8:0/1940764619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c160980 0x7faf5c0d3ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf54009d90 tx=0x7faf5402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21733ad6a26b6b1d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad300051d0 0x7fad3000ba00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c670 tx=0x7fad300057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086002caf0 con 0x7f08540047c0 2023-11-18T23:41:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086002cc50 con 0x7f08540047c0 2023-11-18T23:41:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7fad4ecaf640 1 -- 172.21.15.8:0/3951130786 shutdown_connections 2023-11-18T23:41:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/3951130786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad300051d0 0x7fad3000ba00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f762ed9d640 1 -- 172.21.15.8:0/954388736 reap_dead start 2023-11-18T23:41:17.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f086b7fe640 1 -- 172.21.15.8:0/3750899458 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600058d0 con 0x7f08540047c0 2023-11-18T23:41:17.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7fad4ecaf640 1 -- 172.21.15.8:0/3951130786 >> 172.21.15.8:0/3951130786 conn(0x7fad4806a4d0 msgr2=0x7fad4806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f3632ceb640 1 -- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 msgr2=0x7f362c0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:17.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f3632ceb640 1 --2- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c0cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f36314e8640 1 -- 172.21.15.8:0/2515133093 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772568235 0 0) 0x7f362c0b2d30 con 0x7f362c160780 2023-11-18T23:41:17.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f3632ceb640 1 -- 172.21.15.8:0/2515133093 >> v1:172.21.15.116:6789/0 conn(0x7f362c160780 legacy=0x7f362c0cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f3632ceb640 1 -- 172.21.15.8:0/2515133093 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0b2400 con 0x7f362c0b41d0 2023-11-18T23:41:17.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e3440640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc06abe0 0x7f20dc1572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e3440640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20dc06eb90 0x7f20dc0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e3440640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20dc15bd10 0x7f20dc0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e243e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc06abe0 0x7f20dc1572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e243e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc06abe0 0x7f20dc1572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53556/0 (socket says 172.21.15.8:53556) 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e243e640 1 -- 172.21.15.8:0/634710319 learned_addr learned my addr 172.21.15.8:0/634710319 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e2c3f640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20dc15bd10 0x7f20dc0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e3440640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc1577e0 con 0x7f20dc15bd10 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e3440640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0c7160 con 0x7f20dc06abe0 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e3440640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0c7440 con 0x7f20dc06eb90 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f20e1c3d640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20dc06eb90 0x7f20dc0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7fad4ecaf640 1 -- 172.21.15.8:0/3951130786 shutdown_connections 2023-11-18T23:41:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7faf59ffb640 1 -- 172.21.15.8:0/1940764619 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5402cc00 con 0x7faf5c160980 2023-11-18T23:41:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7fad4ecaf640 1 -- 172.21.15.8:0/3951130786 wait complete. 2023-11-18T23:41:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f15ed58f640 1 -- 172.21.15.8:0/3794704886 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433612682 0 0) 0x7f15e0006590 con 0x7f15e00e75c0 2023-11-18T23:41:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.867+0000 7f15ed58f640 1 -- 172.21.15.8:0/3794704886 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d4003520 con 0x7f15e00e75c0 2023-11-18T23:41:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7faf59ffb640 1 -- 172.21.15.8:0/1940764619 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5402cd60 con 0x7faf5c160980 2023-11-18T23:41:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7faf59ffb640 1 -- 172.21.15.8:0/1940764619 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54034660 con 0x7faf5c160980 2023-11-18T23:41:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f15ed58f640 1 -- 172.21.15.8:0/3794704886 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416111261 0 0) 0x7f15e00e79a0 con 0x7f15e0058990 2023-11-18T23:41:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f15edd90640 1 -- 172.21.15.8:0/3794704886 >> v1:172.21.15.116:6789/0 conn(0x7f15e00e75c0 legacy=0x7f15e0053500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f15edd90640 1 -- 172.21.15.8:0/3794704886 >> v1:172.21.15.8:6789/0 conn(0x7f15e0058990 legacy=0x7f15e003bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f15edd90640 1 -- 172.21.15.8:0/3794704886 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0006870 con 0x7f15e0053c10 2023-11-18T23:41:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f20e1c3d640 1 -- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc06abe0 msgr2=0x7f20dc1572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f20e1c3d640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc06abe0 0x7f20dc1572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f20e1c3d640 1 -- 172.21.15.8:0/634710319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20dc15bd10 msgr2=0x7f20dc0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f20e1c3d640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20dc15bd10 0x7f20dc0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f20e1c3d640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80094d0 con 0x7f20dc06eb90 2023-11-18T23:41:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f0872b2c640 1 -- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 msgr2=0x7f0854004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f0872b2c640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f0854004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f086000c260 tx=0x7f08540057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f20e2c3f640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20dc15bd10 0x7f20dc0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:17.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f20e1c3d640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20dc06eb90 0x7f20dc0c89c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20d400bd20 tx=0x7f20d400be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f0872b2c640 1 -- 172.21.15.8:0/3750899458 shutdown_connections 2023-11-18T23:41:17.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f0872b2c640 1 --2- 172.21.15.8:0/3750899458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f0854004c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f0872b2c640 1 -- 172.21.15.8:0/3750899458 >> 172.21.15.8:0/3750899458 conn(0x7f086c0d2f90 msgr2=0x7f086c0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f762ed9d640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7618004240 0x7f761800b980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f762400c0e0 tx=0x7f76180057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b7faf26099b01d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624004aa0 con 0x7f7618004240 2023-11-18T23:41:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7624004c00 con 0x7f7618004240 2023-11-18T23:41:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f762d59a640 1 -- 172.21.15.8:0/954388736 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240070d0 con 0x7f7618004240 2023-11-18T23:41:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f0872b2c640 1 -- 172.21.15.8:0/3750899458 shutdown_connections 2023-11-18T23:41:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f0872b2c640 1 -- 172.21.15.8:0/3750899458 wait complete. 2023-11-18T23:41:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.868+0000 7f3632ceb640 1 --2- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c0b41d0 0x7f362c0cdfb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3624009e50 tx=0x7f362402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=916b9dbc1ad52d0d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 -- 172.21.15.8:0/3575700847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 msgr2=0x7f94d00b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 --2- 172.21.15.8:0/3575700847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d00b2890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d008d6f0 tx=0x7f94c802bdc0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 -- 172.21.15.8:0/3575700847 shutdown_connections 2023-11-18T23:41:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 --2- 172.21.15.8:0/3575700847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d00b2890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7faf614a2640 1 -- 172.21.15.8:0/1940764619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c160980 msgr2=0x7faf5c0d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7faf614a2640 1 --2- 172.21.15.8:0/1940764619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c160980 0x7faf5c0d3ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf54009d90 tx=0x7faf5402be50 comp rx=0 tx=0).stop 2023-11-18T23:41:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 --2- 172.21.15.8:0/3575700847 >> v2:172.21.15.8:3300/0 conn(0x7f94d0160980 0x7f94d00d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f20d2ffd640 1 -- 172.21.15.8:0/634710319 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400ce70 con 0x7f20dc06eb90 2023-11-18T23:41:17.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f20d2ffd640 1 -- 172.21.15.8:0/634710319 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4014440 con 0x7f20dc06eb90 2023-11-18T23:41:17.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f20d2ffd640 1 -- 172.21.15.8:0/634710319 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4014870 con 0x7f20dc06eb90 2023-11-18T23:41:17.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f20e3440640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc0c7720 con 0x7f20dc06eb90 2023-11-18T23:41:17.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f20e3440640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc1f7460 con 0x7f20dc06eb90 2023-11-18T23:41:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 -- 172.21.15.8:0/3575700847 >> 172.21.15.8:0/3575700847 conn(0x7f94d00d2ff0 msgr2=0x7f94d00d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 -- 172.21.15.8:0/3575700847 shutdown_connections 2023-11-18T23:41:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f94d535e640 1 -- 172.21.15.8:0/3575700847 wait complete. 2023-11-18T23:41:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f36314e8640 1 -- 172.21.15.8:0/2515133093 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362402ca80 con 0x7f362c0b41d0 2023-11-18T23:41:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f36314e8640 1 -- 172.21.15.8:0/2515133093 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362402cbe0 con 0x7f362c0b41d0 2023-11-18T23:41:17.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f36314e8640 1 -- 172.21.15.8:0/2515133093 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240343f0 con 0x7f362c0b41d0 2023-11-18T23:41:17.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f76348b4640 1 -- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7618004240 msgr2=0x7f761800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.869+0000 7f76348b4640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7618004240 0x7f761800b980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f762400c0e0 tx=0x7f76180057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7faf614a2640 1 -- 172.21.15.8:0/1940764619 shutdown_connections 2023-11-18T23:41:17.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7faf614a2640 1 --2- 172.21.15.8:0/1940764619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c160980 0x7faf5c0d3ae0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7faf614a2640 1 -- 172.21.15.8:0/1940764619 >> 172.21.15.8:0/1940764619 conn(0x7faf5c0d2ff0 msgr2=0x7faf5c0d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f15edd90640 1 --2- 172.21.15.8:0/3794704886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e0007630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15e8069ca0 tx=0x7f15e80a5b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72828959e6067fb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7faf614a2640 1 -- 172.21.15.8:0/1940764619 shutdown_connections 2023-11-18T23:41:17.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f76348b4640 1 -- 172.21.15.8:0/954388736 shutdown_connections 2023-11-18T23:41:17.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f76348b4640 1 --2- 172.21.15.8:0/954388736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7618004240 0x7f761800b980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f76348b4640 1 -- 172.21.15.8:0/954388736 >> 172.21.15.8:0/954388736 conn(0x7f763006a4d0 msgr2=0x7f763006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7fad4ecaf640 1 Processor -- start 2023-11-18T23:41:17.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f76348b4640 1 -- 172.21.15.8:0/954388736 shutdown_connections 2023-11-18T23:41:17.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f15ed58f640 1 -- 172.21.15.8:0/3794704886 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40015f0 con 0x7f15e0053c10 2023-11-18T23:41:17.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7fad4ecaf640 1 -- start start 2023-11-18T23:41:17.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f36334ec640 1 -- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c0b41d0 msgr2=0x7f362c0cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f36334ec640 1 --2- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c0b41d0 0x7f362c0cdfb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3624009e50 tx=0x7f362402bee0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7faf614a2640 1 -- 172.21.15.8:0/1940764619 wait complete. 2023-11-18T23:41:17.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f0872b2c640 1 Processor -- start 2023-11-18T23:41:17.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f0872b2c640 1 -- start start 2023-11-18T23:41:17.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f36334ec640 1 -- 172.21.15.8:0/2515133093 shutdown_connections 2023-11-18T23:41:17.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f36334ec640 1 --2- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c0b41d0 0x7f362c0cdfb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f36334ec640 1 --2- 172.21.15.8:0/2515133093 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f36334ec640 1 -- 172.21.15.8:0/2515133093 >> 172.21.15.8:0/2515133093 conn(0x7f362c09c300 msgr2=0x7f362c0d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.870+0000 7f76348b4640 1 -- 172.21.15.8:0/954388736 wait complete. 2023-11-18T23:41:17.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f94d535e640 1 Processor -- start 2023-11-18T23:41:17.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f94d535e640 1 -- start start 2023-11-18T23:41:17.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7fad4ecaf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad300051d0 0x7fad48156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f20d2ffd640 1 -- 172.21.15.8:0/634710319 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f20d401d3b0 con 0x7f20dc06eb90 2023-11-18T23:41:17.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f20e3440640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc15f1d0 con 0x7f20dc06eb90 2023-11-18T23:41:17.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7fad4ecaf640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad481f2d00 0x7fad4813fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f36334ec640 1 -- 172.21.15.8:0/2515133093 shutdown_connections 2023-11-18T23:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f36334ec640 1 -- 172.21.15.8:0/2515133093 wait complete. 2023-11-18T23:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f76348b4640 1 Processor -- start 2023-11-18T23:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f15ed58f640 1 -- 172.21.15.8:0/3794704886 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e80a77a0 con 0x7f15e0053c10 2023-11-18T23:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.871+0000 7f15ed58f640 1 -- 172.21.15.8:0/3794704886 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80a7b50 con 0x7f15e0053c10 2023-11-18T23:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f20d2ffd640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f20c006af10 0x7f20c006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f20d2ffd640 1 -- 172.21.15.8:0/634710319 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20d4089780 con 0x7f20dc06eb90 2023-11-18T23:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f20e243e640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f20c006af10 0x7f20c006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f0872b2c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f086c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7fad4ecaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad480b20c0 0x7fad480b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7fad4ecaf640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48157ad0 con 0x7fad481f2d00 2023-11-18T23:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7fad4ecaf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48140920 con 0x7fad480b20c0 2023-11-18T23:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7fad4ecaf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad480b2ab0 con 0x7fad300051d0 2023-11-18T23:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7f76348b4640 1 -- start start 2023-11-18T23:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7fad4ca4b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad300051d0 0x7fad48156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7fad4ca4b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad300051d0 0x7fad48156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55246/0 (socket says 172.21.15.8:55246) 2023-11-18T23:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7fad4ca4b640 1 -- 172.21.15.8:0/2401286009 learned_addr learned my addr 172.21.15.8:0/2401286009 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f15f07f5640 1 -- 172.21.15.8:0/3794704886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 msgr2=0x7f15e0007630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f15f07f5640 1 --2- 172.21.15.8:0/3794704886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e0007630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15e8069ca0 tx=0x7f15e80a5b20 comp rx=0 tx=0).stop 2023-11-18T23:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f94d535e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00b1f10 0x7f94d00b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f0872b2c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086c15e900 0x7f086c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f0872b2c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f086c15f6c0 0x7f086c15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f0872b2c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c160080 con 0x7f086c15f6c0 2023-11-18T23:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f0872b2c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0cb4c0 con 0x7f08540047c0 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f0872b2c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0ca8b0 con 0x7f086c15e900 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f08708c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f086c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f08710c9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f086c15f6c0 0x7f086c15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f08710c9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f086c15f6c0 0x7f086c15fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48468/0 (socket says 172.21.15.8:48468) 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f08710c9640 1 -- 172.21.15.8:0/416672489 learned_addr learned my addr 172.21.15.8:0/416672489 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7faf614a2640 1 Processor -- start 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.872+0000 7faf614a2640 1 -- start start 2023-11-18T23:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf614a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c0b1f10 0x7faf5c0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf614a2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf5c0d0110 0x7faf5c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf614a2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c160980 0x7faf5c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f94d535e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d01f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf614a2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c15ab40 con 0x7faf5c160980 2023-11-18T23:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf614a2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0c80a0 con 0x7faf5c0b1f10 2023-11-18T23:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf614a2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0c7490 con 0x7faf5c0d0110 2023-11-18T23:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c160980 0x7faf5c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f20e243e640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f20c006af10 0x7f20c006d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20d80090b0 tx=0x7f20d803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c160980 0x7faf5c0c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48488/0 (socket says 172.21.15.8:48488) 2023-11-18T23:41:17.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf5b7fe640 1 -- 172.21.15.8:0/2004910997 learned_addr learned my addr 172.21.15.8:0/2004910997 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf5affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c0b1f10 0x7faf5c0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7faf5a7fc640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf5c0d0110 0x7faf5c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7fad4d24c640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad480b20c0 0x7fad480b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7fad47fff640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad481f2d00 0x7fad4813fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f086bfff640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086c15e900 0x7f086c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f08710c9640 1 -- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086c15e900 msgr2=0x7f086c0ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f08710c9640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086c15e900 0x7f086c0ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f08710c9640 1 -- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 msgr2=0x7f086c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f08710c9640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f086c15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f08710c9640 1 -- 172.21.15.8:0/416672489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0cab90 con 0x7f086c15f6c0 2023-11-18T23:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f08708c8640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f086c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7fad4ca4b640 1 -- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad480b20c0 msgr2=0x7fad480b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7fad4ca4b640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad480b20c0 0x7fad480b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7fad4ca4b640 1 -- 172.21.15.8:0/2401286009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad481f2d00 msgr2=0x7fad4813fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7fad4ca4b640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad481f2d00 0x7fad4813fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7fad4ca4b640 1 -- 172.21.15.8:0/2401286009 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48157230 con 0x7fad300051d0 2023-11-18T23:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f94d535e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94d0160980 0x7f94d0157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.873+0000 7f94ceffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00b1f10 0x7f94d00b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94d535e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00b1bc0 con 0x7f94d00b1f10 2023-11-18T23:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ceffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00b1f10 0x7f94d00b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48474/0 (socket says 172.21.15.8:48474) 2023-11-18T23:41:17.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f15f07f5640 1 -- 172.21.15.8:0/3794704886 shutdown_connections 2023-11-18T23:41:17.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ceffd640 1 -- 172.21.15.8:0/627525048 learned_addr learned my addr 172.21.15.8:0/627525048 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94d535e640 1 -- 172.21.15.8:0/627525048 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d01f3470 con 0x7f94d00d0110 2023-11-18T23:41:17.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94d535e640 1 -- 172.21.15.8:0/627525048 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d01f36f0 con 0x7f94d0160980 2023-11-18T23:41:17.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7faf5affd640 1 -- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf5c0d0110 msgr2=0x7faf5c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7faf5affd640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf5c0d0110 0x7faf5c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7faf5affd640 1 -- 172.21.15.8:0/2004910997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c160980 msgr2=0x7faf5c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7faf5affd640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c160980 0x7faf5c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7faf5affd640 1 -- 172.21.15.8:0/2004910997 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009a70 con 0x7faf5c0b1f10 2023-11-18T23:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f76348b4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618004240 0x7f76300add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f15f07f5640 1 --2- 172.21.15.8:0/3794704886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e0007630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f08710c9640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f086c15f6c0 0x7f086c15fb40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f086c0cf8d0 tx=0x7f086400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f15f07f5640 1 -- 172.21.15.8:0/3794704886 >> 172.21.15.8:0/3794704886 conn(0x7f15e0058eb0 msgr2=0x7f15e00592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:17.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7faf5affd640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c0b1f10 0x7faf5c0cae70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf54033000 tx=0x7faf54004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f76348b4640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76301531b0 0x7f7630152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f76348b4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7630157860 0x7f7630157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f762e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618004240 0x7f76300add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f762e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618004240 0x7f76300add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48494/0 (socket says 172.21.15.8:48494) 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f762e59c640 1 -- 172.21.15.8:0/1307785728 learned_addr learned my addr 172.21.15.8:0/1307785728 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f762dd9b640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76301531b0 0x7f7630152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630153ab0 con 0x7f7618004240 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f15f07f5640 1 -- 172.21.15.8:0/3794704886 shutdown_connections 2023-11-18T23:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f15f07f5640 1 -- 172.21.15.8:0/3794704886 wait complete. 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94cf7fe640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94d0160980 0x7f94d0157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ceffd640 1 -- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94d0160980 msgr2=0x7f94d0157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ceffd640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94d0160980 0x7f94d0157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ceffd640 1 -- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 msgr2=0x7f94d01f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ce7fc640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d01f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ceffd640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d01f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ceffd640 1 -- 172.21.15.8:0/627525048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8009b30 con 0x7f94d00b1f10 2023-11-18T23:41:17.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.874+0000 7f94ce7fc640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d01f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:17.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f762ed9d640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7630157860 0x7f7630157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f08697fa640 1 -- 172.21.15.8:0/416672489 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640070d0 con 0x7f086c15f6c0 2023-11-18T23:41:17.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630158220 con 0x7f7630157860 2023-11-18T23:41:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763015bd70 con 0x7f76301531b0 2023-11-18T23:41:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f08697fa640 1 -- 172.21.15.8:0/416672489 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0864007230 con 0x7f086c15f6c0 2023-11-18T23:41:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7faf437fe640 1 -- 172.21.15.8:0/2004910997 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5403e610 con 0x7faf5c0b1f10 2023-11-18T23:41:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c0c7770 con 0x7faf5c0b1f10 2023-11-18T23:41:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c0c7d30 con 0x7faf5c0b1f10 2023-11-18T23:41:17.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7faf437fe640 1 -- 172.21.15.8:0/2004910997 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5403e770 con 0x7faf5c0b1f10 2023-11-18T23:41:17.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7faf437fe640 1 -- 172.21.15.8:0/2004910997 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5403eb20 con 0x7faf5c0b1f10 2023-11-18T23:41:17.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f36334ec640 1 Processor -- start 2023-11-18T23:41:17.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7fad4ca4b640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad300051d0 0x7fad48156b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad3c003a30 tx=0x7fad3c003ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f94ceffd640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00b1f10 0x7f94d00b1680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f94c0013b90 tx=0x7f94c0013c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f94b77fe640 1 -- 172.21.15.8:0/627525048 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0014d90 con 0x7f94d00b1f10 2023-11-18T23:41:17.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f94b77fe640 1 -- 172.21.15.8:0/627525048 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c00110d0 con 0x7f94d00b1f10 2023-11-18T23:41:17.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f94b77fe640 1 -- 172.21.15.8:0/627525048 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0011480 con 0x7f94d00b1f10 2023-11-18T23:41:17.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f36334ec640 1 -- start start 2023-11-18T23:41:17.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f08697fa640 1 -- 172.21.15.8:0/416672489 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640070d0 con 0x7f086c15f6c0 2023-11-18T23:41:17.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f94d535e640 1 -- 172.21.15.8:0/627525048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d01f39d0 con 0x7f94d00b1f10 2023-11-18T23:41:17.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.875+0000 7f94d535e640 1 -- 172.21.15.8:0/627525048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d01f6710 con 0x7f94d00b1f10 2023-11-18T23:41:17.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c0cae70 con 0x7f086c15f6c0 2023-11-18T23:41:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762dd9b640 1 -- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7630157860 msgr2=0x7f7630157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762dd9b640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7630157860 0x7f7630157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762dd9b640 1 -- 172.21.15.8:0/1307785728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618004240 msgr2=0x7f76300add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762dd9b640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618004240 0x7f76300add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762dd9b640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76300ada70 con 0x7f76301531b0 2023-11-18T23:41:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762e59c640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618004240 0x7f76300add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:17.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762ed9d640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7630157860 0x7f7630157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:17.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0ca5a0 con 0x7f086c15f6c0 2023-11-18T23:41:17.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c005250 con 0x7faf5c0b1f10 2023-11-18T23:41:17.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.876+0000 7f762dd9b640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76301531b0 0x7f7630152b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f762000f810 tx=0x7f762000fcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f15f07f5640 1 Processor -- start 2023-11-18T23:41:17.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f94d535e640 1 -- 172.21.15.8:0/627525048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d01f6570 con 0x7f94d00b1f10 2023-11-18T23:41:17.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f15f07f5640 1 -- start start 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f36334ec640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f362c0b41d0 0x7f362c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f36334ec640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f36334ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c160780 0x7f362c0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f36334ec640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c09f830 con 0x7f362c0b41d0 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f36334ec640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c09ef00 con 0x7f362c160780 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f36334ec640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c09f1e0 con 0x7f362c0d0040 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3631ce9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3631ce9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c14bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55284/0 (socket says 172.21.15.8:55284) 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3631ce9640 1 -- 172.21.15.8:0/1263675654 learned_addr learned my addr 172.21.15.8:0/1263675654 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3632ceb640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c160780 0x7f362c0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7faf437fe640 1 -- 172.21.15.8:0/2004910997 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf5403b050 con 0x7faf5c0b1f10 2023-11-18T23:41:17.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f36324ea640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f362c0b41d0 0x7f362c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3631ce9640 1 -- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c160780 msgr2=0x7f362c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3631ce9640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c160780 0x7f362c0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3631ce9640 1 -- 172.21.15.8:0/1263675654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f362c0b41d0 msgr2=0x7f362c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.877+0000 7f3631ce9640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f362c0b41d0 0x7f362c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f3631ce9640 1 -- 172.21.15.8:0/1263675654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624009b30 con 0x7f362c0d0040 2023-11-18T23:41:17.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c067940 con 0x7f086c15f6c0 2023-11-18T23:41:17.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7faf437fe640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faf4806aea0 0x7faf4806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f3631ce9640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c14bc00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f362800e9b0 tx=0x7f362800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7faf437fe640 1 -- 172.21.15.8:0/2004910997 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf540abb10 con 0x7faf5c0b1f10 2023-11-18T23:41:17.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f3622ffd640 1 -- 172.21.15.8:0/1263675654 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628009670 con 0x7f362c0d0040 2023-11-18T23:41:17.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f3622ffd640 1 -- 172.21.15.8:0/1263675654 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362800c9a0 con 0x7f362c0d0040 2023-11-18T23:41:17.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7faf5a7fc640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faf4806aea0 0x7faf4806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f3622ffd640 1 -- 172.21.15.8:0/1263675654 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800cd50 con 0x7f362c0d0040 2023-11-18T23:41:17.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c09f4c0 con 0x7f362c0d0040 2023-11-18T23:41:17.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c14c140 con 0x7f362c0d0040 2023-11-18T23:41:17.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f94b77fe640 1 -- 172.21.15.8:0/627525048 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94c000f850 con 0x7f94d00b1f10 2023-11-18T23:41:17.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7f15f07f5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e00e23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7f08697fa640 1 -- 172.21.15.8:0/416672489 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08640073a0 con 0x7f086c15f6c0 2023-11-18T23:41:17.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7f94b77fe640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f94bc06ae40 0x7f94bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7f94b77fe640 1 -- 172.21.15.8:0/627525048 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94c0091270 con 0x7f94d00b1f10 2023-11-18T23:41:17.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7faf5a7fc640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faf4806aea0 0x7faf4806d360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0c9b20 tx=0x7faf50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7f20d2ffd640 1 -- 172.21.15.8:0/634710319 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f20d4058360 con 0x7f20dc06eb90 2023-11-18T23:41:17.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7fad457fa640 1 -- 172.21.15.8:0/2401286009 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c016040 con 0x7fad300051d0 2023-11-18T23:41:17.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7fad457fa640 1 -- 172.21.15.8:0/2401286009 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c014c30 con 0x7fad300051d0 2023-11-18T23:41:17.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad48157510 con 0x7fad300051d0 2023-11-18T23:41:17.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7fad457fa640 1 -- 172.21.15.8:0/2401286009 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c016040 con 0x7fad300051d0 2023-11-18T23:41:17.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad481f3180 con 0x7fad300051d0 2023-11-18T23:41:17.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f761effd640 1 -- 172.21.15.8:0/1307785728 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000d6b0 con 0x7f76301531b0 2023-11-18T23:41:17.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f761effd640 1 -- 172.21.15.8:0/1307785728 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762000d810 con 0x7f76301531b0 2023-11-18T23:41:17.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f761effd640 1 -- 172.21.15.8:0/1307785728 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000dbc0 con 0x7f76301531b0 2023-11-18T23:41:17.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763015b8e0 con 0x7f76301531b0 2023-11-18T23:41:17.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.878+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76300ad790 con 0x7f76301531b0 2023-11-18T23:41:17.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c09f650 con 0x7f362c0d0040 2023-11-18T23:41:17.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.879+0000 7f15ee591640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e00e23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15f07f5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15e0058990 0x7f15e004e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15f07f5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15e00e75c0 0x7f15e00e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15f07f5640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e004d3c0 con 0x7f15e0053c10 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15edd90640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15e0058990 0x7f15e004e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15ee591640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e00e23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48506/0 (socket says 172.21.15.8:48506) 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15ee591640 1 -- 172.21.15.8:0/1388439753 learned_addr learned my addr 172.21.15.8:0/1388439753 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e004f870 con 0x7f15e00e75c0 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00e1ca0 con 0x7f15e0058990 2023-11-18T23:41:17.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f94ce7fc640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f94bc06ae40 0x7f94bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f15eed92640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15e00e75c0 0x7f15e00e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f08697fa640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f085806aea0 0x7f085806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.880+0000 7f08697fa640 1 -- 172.21.15.8:0/416672489 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08640885c0 con 0x7f086c15f6c0 2023-11-18T23:41:17.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763015ba70 con 0x7f76301531b0 2023-11-18T23:41:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f15ee591640 1 -- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15e0058990 msgr2=0x7f15e004e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f15ee591640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15e0058990 0x7f15e004e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f15ee591640 1 -- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15e00e75c0 msgr2=0x7f15e00e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f15ee591640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15e00e75c0 0x7f15e00e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:17.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f15ee591640 1 -- 172.21.15.8:0/1388439753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e804f730 con 0x7f15e0053c10 2023-11-18T23:41:17.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f94ce7fc640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f94bc06ae40 0x7f94bc06d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d00b3de0 tx=0x7f94c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f761effd640 1 -- 172.21.15.8:0/1307785728 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f762000dd20 con 0x7f76301531b0 2023-11-18T23:41:17.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48072ae0 con 0x7fad300051d0 2023-11-18T23:41:17.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f15ee591640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e00e23b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15e400c780 tx=0x7f15e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.881+0000 7f08708c8640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f085806aea0 0x7f085806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f3622ffd640 1 -- 172.21.15.8:0/1263675654 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3628005990 con 0x7f362c0d0040 2023-11-18T23:41:17.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f761effd640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f761006ae90 0x7f761006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f761effd640 1 -- 172.21.15.8:0/1307785728 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7620089630 con 0x7f76301531b0 2023-11-18T23:41:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7fad457fa640 1 -- 172.21.15.8:0/2401286009 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad3c01b480 con 0x7fad300051d0 2023-11-18T23:41:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f08708c8640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f085806aea0 0x7f085806d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f086c063e60 tx=0x7f085c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7fad457fa640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fad3406aed0 0x7fad3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f3622ffd640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f361006ae90 0x7f361006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f762e59c640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f761006ae90 0x7f761006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f3622ffd640 1 -- 172.21.15.8:0/1263675654 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3628089810 con 0x7f362c0d0040 2023-11-18T23:41:17.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7f36324ea640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f361006ae90 0x7f361006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7fad47fff640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fad3406aed0 0x7fad3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.882+0000 7fad457fa640 1 -- 172.21.15.8:0/2401286009 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad3c05be30 con 0x7fad300051d0 2023-11-18T23:41:17.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.883+0000 7f36324ea640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f361006ae90 0x7f361006d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f361c000f60 tx=0x7f361c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.883+0000 7fad47fff640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fad3406aed0 0x7fad3406d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad38001050 tx=0x7fad38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.883+0000 7f762e59c640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f761006ae90 0x7f761006d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7628007f80 tx=0x7f76280074d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:17.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.883+0000 7faf437fe640 1 -- 172.21.15.8:0/2004910997 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf54076da0 con 0x7faf5c0b1f10 2023-11-18T23:41:17.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.886+0000 7f94b77fe640 1 -- 172.21.15.8:0/627525048 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94d01f6570 con 0x7f94d00b1f10 2023-11-18T23:41:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.886+0000 7f3622ffd640 1 -- 172.21.15.8:0/1263675654 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3628054950 con 0x7f362c0d0040 2023-11-18T23:41:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.890+0000 7f761effd640 1 -- 172.21.15.8:0/1307785728 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7620054740 con 0x7f76301531b0 2023-11-18T23:41:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.894+0000 7fad457fa640 1 -- 172.21.15.8:0/2401286009 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad3c058900 con 0x7fad300051d0 2023-11-18T23:41:17.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.895+0000 7f15deffd640 1 -- 172.21.15.8:0/1388439753 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40074e0 con 0x7f15e0053c10 2023-11-18T23:41:17.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.895+0000 7f15deffd640 1 -- 172.21.15.8:0/1388439753 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400ce90 con 0x7f15e0053c10 2023-11-18T23:41:17.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.895+0000 7f15deffd640 1 -- 172.21.15.8:0/1388439753 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40049e0 con 0x7f15e0053c10 2023-11-18T23:41:17.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.896+0000 7f08697fa640 1 -- 172.21.15.8:0/416672489 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08640536a0 con 0x7f086c15f6c0 2023-11-18T23:41:17.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.896+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e004d610 con 0x7f15e0053c10 2023-11-18T23:41:17.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.897+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e004dbd0 con 0x7f15e0053c10 2023-11-18T23:41:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.899+0000 7f15deffd640 1 -- 172.21.15.8:0/1388439753 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15e4004b40 con 0x7f15e0053c10 2023-11-18T23:41:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.901+0000 7f15deffd640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f15cc06af10 0x7f15cc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.901+0000 7f15deffd640 1 -- 172.21.15.8:0/1388439753 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15e4088dd0 con 0x7f15e0053c10 2023-11-18T23:41:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.901+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e00056d0 con 0x7f15e0053c10 2023-11-18T23:41:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.902+0000 7f15edd90640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f15cc06af10 0x7f15cc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.911+0000 7f15deffd640 1 -- 172.21.15.8:0/1388439753 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15e4018020 con 0x7f15e0053c10 2023-11-18T23:41:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:17.930+0000 7f15edd90640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f15cc06af10 0x7f15cc06d3d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15e0008640 tx=0x7f15e806d030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.290+0000 7f94d535e640 1 -- 172.21.15.8:0/627525048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f94d01f6570 con 0x7f94d00b1f10 2023-11-18T23:41:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.291+0000 7f94b77fe640 1 -- 172.21.15.8:0/627525048 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94d01f6570 con 0x7f94d00b1f10 2023-11-18T23:41:18.292 INFO:teuthology.orchestra.run.smithi008.stdout:55834574852 2023-11-18T23:41:18.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.293+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf3c0057d0 con 0x7faf5c0b1f10 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 -- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f94bc06ae40 msgr2=0x7f94bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f94bc06ae40 0x7f94bc06d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d00b3de0 tx=0x7f94c4008040 comp rx=0 tx=0).stop 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 -- 172.21.15.8:0/627525048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00b1f10 msgr2=0x7f94d00b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00b1f10 0x7f94d00b1680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f94c0013b90 tx=0x7f94c0013c80 comp rx=0 tx=0).stop 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 -- 172.21.15.8:0/627525048 shutdown_connections 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f94bc06ae40 0x7f94bc06d300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94d0160980 0x7f94d0157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d00d0110 0x7f94d01f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 --2- 172.21.15.8:0/627525048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94d00b1f10 0x7f94d00b1680 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.294+0000 7f94b57fa640 1 -- 172.21.15.8:0/627525048 >> 172.21.15.8:0/627525048 conn(0x7f94d00d2ff0 msgr2=0x7f94d00b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.295+0000 7f94b57fa640 1 -- 172.21.15.8:0/627525048 shutdown_connections 2023-11-18T23:41:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.295+0000 7faf437fe640 1 -- 172.21.15.8:0/2004910997 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf54039090 con 0x7faf5c0b1f10 2023-11-18T23:41:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.295+0000 7f94b57fa640 1 -- 172.21.15.8:0/627525048 wait complete. 2023-11-18T23:41:18.298 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-11-18T23:41:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.296+0000 7f20e3440640 1 -- 172.21.15.8:0/634710319 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f20dc1f7680 con 0x7f20dc06eb90 2023-11-18T23:41:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.297+0000 7f20d2ffd640 1 -- 172.21.15.8:0/634710319 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20d4057ef0 con 0x7f20dc06eb90 2023-11-18T23:41:18.299 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-11-18T23:41:18.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.298+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faf4806aea0 msgr2=0x7faf4806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faf4806aea0 0x7faf4806d360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0c9b20 tx=0x7faf50009040 comp rx=0 tx=0).stop 2023-11-18T23:41:18.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c0b1f10 msgr2=0x7faf5c0cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c0b1f10 0x7faf5c0cae70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf54033000 tx=0x7faf54004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 shutdown_connections 2023-11-18T23:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faf4806aea0 0x7faf4806d360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf5c160980 0x7faf5c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf5c0d0110 0x7faf5c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 --2- 172.21.15.8:0/2004910997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf5c0b1f10 0x7faf5c0cae70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.299+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 >> 172.21.15.8:0/2004910997 conn(0x7faf5c0d2ff0 msgr2=0x7faf5c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.300+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 shutdown_connections 2023-11-18T23:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.300+0000 7faf614a2640 1 -- 172.21.15.8:0/2004910997 wait complete. 2023-11-18T23:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.300+0000 7f20d0ff9640 1 -- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f20c006af10 msgr2=0x7f20c006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.300+0000 7f20d0ff9640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f20c006af10 0x7f20c006d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20d80090b0 tx=0x7f20d803c040 comp rx=0 tx=0).stop 2023-11-18T23:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.300+0000 7f20d0ff9640 1 -- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20dc06eb90 msgr2=0x7f20dc0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20dc06eb90 0x7f20dc0c89c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20d400bd20 tx=0x7f20d400be10 comp rx=0 tx=0).stop 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 -- 172.21.15.8:0/634710319 shutdown_connections 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f20c006af10 0x7f20c006d3d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20dc15bd10 0x7f20dc0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20dc06eb90 0x7f20dc0c89c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 --2- 172.21.15.8:0/634710319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20dc06abe0 0x7f20dc1572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 -- 172.21.15.8:0/634710319 >> 172.21.15.8:0/634710319 conn(0x7f20dc0b1750 msgr2=0x7f20dc0ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 -- 172.21.15.8:0/634710319 shutdown_connections 2023-11-18T23:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.301+0000 7f20d0ff9640 1 -- 172.21.15.8:0/634710319 wait complete. 2023-11-18T23:41:18.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.303+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f362c09f9a0 con 0x7f362c0d0040 2023-11-18T23:41:18.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.303+0000 7f3622ffd640 1 -- 172.21.15.8:0/1263675654 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3628021020 con 0x7f362c0d0040 2023-11-18T23:41:18.304 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:18.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f361006ae90 msgr2=0x7f361006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f361006ae90 0x7f361006d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f361c000f60 tx=0x7f361c009040 comp rx=0 tx=0).stop 2023-11-18T23:41:18.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 msgr2=0x7f362c14bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c14bc00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f362800e9b0 tx=0x7f362800ee70 comp rx=0 tx=0).stop 2023-11-18T23:41:18.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f086c04e840 con 0x7f086c15f6c0 2023-11-18T23:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 shutdown_connections 2023-11-18T23:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f361006ae90 0x7f361006d350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f362c160780 0x7f362c0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f362c0d0040 0x7f362c14bc00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 --2- 172.21.15.8:0/1263675654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f362c0b41d0 0x7f362c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.307+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 >> 172.21.15.8:0/1263675654 conn(0x7f362c09c300 msgr2=0x7f362c0b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.308+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 shutdown_connections 2023-11-18T23:41:18.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.308+0000 7f08697fa640 1 -- 172.21.15.8:0/416672489 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0864017020 con 0x7f086c15f6c0 2023-11-18T23:41:18.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.308+0000 7f36334ec640 1 -- 172.21.15.8:0/1263675654 wait complete. 2023-11-18T23:41:18.311 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.311+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f085806aea0 msgr2=0x7f085806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f085806aea0 0x7f085806d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f086c063e60 tx=0x7f085c008040 comp rx=0 tx=0).stop 2023-11-18T23:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f086c15f6c0 msgr2=0x7f086c15fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f086c15f6c0 0x7f086c15fb40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f086c0cf8d0 tx=0x7f086400c960 comp rx=0 tx=0).stop 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 shutdown_connections 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f085806aea0 0x7f085806d360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f086c15f6c0 0x7f086c15fb40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086c15e900 0x7f086c0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 --2- 172.21.15.8:0/416672489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08540047c0 0x7f086c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 >> 172.21.15.8:0/416672489 conn(0x7f086c0d2f90 msgr2=0x7f086c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 shutdown_connections 2023-11-18T23:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.312+0000 7f0872b2c640 1 -- 172.21.15.8:0/416672489 wait complete. 2023-11-18T23:41:18.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-11-18T23:41:18.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.315+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fad48068690 con 0x7fad300051d0 2023-11-18T23:41:18.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.316+0000 7fad457fa640 1 -- 172.21.15.8:0/2401286009 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad3c020030 con 0x7fad300051d0 2023-11-18T23:41:18.317 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-11-18T23:41:18.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.316+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f763004e840 con 0x7f76301531b0 2023-11-18T23:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.316+0000 7f761effd640 1 -- 172.21.15.8:0/1307785728 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7620057d60 con 0x7f76301531b0 2023-11-18T23:41:18.318 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-11-18T23:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fad3406aed0 msgr2=0x7fad3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fad3406aed0 0x7fad3406d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad38001050 tx=0x7fad38009040 comp rx=0 tx=0).stop 2023-11-18T23:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad300051d0 msgr2=0x7fad48156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad300051d0 0x7fad48156b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad3c003a30 tx=0x7fad3c003ef0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 shutdown_connections 2023-11-18T23:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fad3406aed0 0x7fad3406d390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad480b20c0 0x7fad480b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f761006ae90 msgr2=0x7f761006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7f76348b4640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f761006ae90 0x7f761006d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7628007f80 tx=0x7f76280074d0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76301531b0 msgr2=0x7f7630152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.319+0000 7f76348b4640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76301531b0 0x7f7630152b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f762000f810 tx=0x7f762000fcd0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-18T23:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad481f2d00 0x7fad4813fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7fad4ecaf640 1 --2- 172.21.15.8:0/2401286009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad300051d0 0x7fad48156b30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 >> 172.21.15.8:0/2401286009 conn(0x7fad4806a4d0 msgr2=0x7fad480702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 shutdown_connections 2023-11-18T23:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f761006ae90 0x7f761006d350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7630157860 0x7f7630157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76301531b0 0x7f7630152b50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 --2- 172.21.15.8:0/1307785728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7618004240 0x7f76300add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 >> 172.21.15.8:0/1307785728 conn(0x7f763006a4d0 msgr2=0x7f76300cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 shutdown_connections 2023-11-18T23:41:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 shutdown_connections 2023-11-18T23:41:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7f76348b4640 1 -- 172.21.15.8:0/1307785728 wait complete. 2023-11-18T23:41:18.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.320+0000 7fad4ecaf640 1 -- 172.21.15.8:0/2401286009 wait complete. 2023-11-18T23:41:18.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-18T23:41:18.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.321+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f15e000e0c0 con 0x7f15e0053c10 2023-11-18T23:41:18.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.321+0000 7f15deffd640 1 -- 172.21.15.8:0/1388439753 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15e4053f10 con 0x7f15e0053c10 2023-11-18T23:41:18.326 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-11-18T23:41:18.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f15cc06af10 msgr2=0x7f15cc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f15cc06af10 0x7f15cc06d3d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15e0008640 tx=0x7f15e806d030 comp rx=0 tx=0).stop 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 msgr2=0x7f15e00e23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e00e23b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15e400c780 tx=0x7f15e400cc40 comp rx=0 tx=0).stop 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 shutdown_connections 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f15cc06af10 0x7f15cc06d3d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15e00e75c0 0x7f15e00e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15e0058990 0x7f15e004e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 --2- 172.21.15.8:0/1388439753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15e0053c10 0x7f15e00e23b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 >> 172.21.15.8:0/1388439753 conn(0x7f15e0058eb0 msgr2=0x7f15e00e3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 shutdown_connections 2023-11-18T23:41:18.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:18.324+0000 7f15f07f5640 1 -- 172.21.15.8:0/1388439753 wait complete. 2023-11-18T23:41:18.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-11-18T23:41:18.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-18T23:41:18.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-18T23:41:18.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-18T23:41:18.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-11-18T23:41:19.316 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T23:41:19.323 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T23:41:19.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T23:41:19.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T23:41:19.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T23:41:19.339 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T23:41:19.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T23:41:19.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T23:41:19.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.496+0000 7f4ab51b3640 1 Processor -- start 2023-11-18T23:41:19.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.496+0000 7f4ab51b3640 1 -- start start 2023-11-18T23:41:19.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.497+0000 7f4ab51b3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa8101000 0x7f4aa803a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.497+0000 7f4ab51b3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4aa80065c0 0x7f4aa8053000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.497+0000 7f4ab51b3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa803aa30 con 0x7f4aa8100c20 2023-11-18T23:41:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.497+0000 7f4ab51b3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa8034190 con 0x7f4aa80065c0 2023-11-18T23:41:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.497+0000 7f4ab51b3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8037b10 con 0x7f4aa8101000 2023-11-18T23:41:19.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.498+0000 7f4ab49b2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4aa80065c0 0x7f4aa8053000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.498+0000 7f4ab49b2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4aa80065c0 0x7f4aa8053000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48514/0 (socket says 172.21.15.8:48514) 2023-11-18T23:41:19.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.498+0000 7f4ab49b2640 1 -- 172.21.15.8:0/1184679526 learned_addr learned my addr 172.21.15.8:0/1184679526 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.498+0000 7f4ab49b2640 1 -- 172.21.15.8:0/1184679526 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa8101000 msgr2=0x7f4aa803a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.498+0000 7f4ab49b2640 1 --2- 172.21.15.8:0/1184679526 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa8101000 0x7f4aa803a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.498+0000 7f4ab49b2640 1 -- 172.21.15.8:0/1184679526 >> v1:172.21.15.8:6789/0 conn(0x7f4aa8100c20 legacy=0x7f4aa8005eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T23:41:19.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.498+0000 7f4ab49b2640 1 -- 172.21.15.8:0/1184679526 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8006ff0 con 0x7f4aa80065c0 2023-11-18T23:41:19.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.499+0000 7f4ab49b2640 1 --2- 172.21.15.8:0/1184679526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa80065c0 0x7f4aa8053000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0079e60 tx=0x7f4ab009dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bacbcdde4cbf45 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.500+0000 7f4aaeffd640 1 -- 172.21.15.8:0/1184679526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab009f930 con 0x7f4aa80065c0 2023-11-18T23:41:19.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.500+0000 7f4aaeffd640 1 -- 172.21.15.8:0/1184679526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab009fa90 con 0x7f4aa80065c0 2023-11-18T23:41:19.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 -- 172.21.15.8:0/1184679526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa80065c0 msgr2=0x7f4aa8053000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 --2- 172.21.15.8:0/1184679526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa80065c0 0x7f4aa8053000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0079e60 tx=0x7f4ab009dab0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 -- 172.21.15.8:0/1184679526 shutdown_connections 2023-11-18T23:41:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 --2- 172.21.15.8:0/1184679526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa80065c0 0x7f4aa8053000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 --2- 172.21.15.8:0/1184679526 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa8101000 0x7f4aa803a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 -- 172.21.15.8:0/1184679526 >> 172.21.15.8:0/1184679526 conn(0x7f4aa8009f80 msgr2=0x7f4aa800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 -- 172.21.15.8:0/1184679526 shutdown_connections 2023-11-18T23:41:19.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.501+0000 7f4ab51b3640 1 -- 172.21.15.8:0/1184679526 wait complete. 2023-11-18T23:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.503+0000 7f4ab51b3640 1 Processor -- start 2023-11-18T23:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.504+0000 7f4ab51b3640 1 -- start start 2023-11-18T23:41:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.505+0000 7f4ab51b3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa80065c0 0x7f4aa80366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.505+0000 7f4ab51b3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa8100c20 0x7f4aa80efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.505+0000 7f4aaf7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa8100c20 0x7f4aa80efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.505+0000 7f4aaf7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa8100c20 0x7f4aa80efc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48526/0 (socket says 172.21.15.8:48526) 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.505+0000 7f4aaffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa80065c0 0x7f4aa80366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.505+0000 7f4aaf7fe640 1 -- 172.21.15.8:0/302024994 learned_addr learned my addr 172.21.15.8:0/302024994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.505+0000 7f4ab51b3640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4aa8101000 0x7f4aa804cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4ab51b3640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8035630 con 0x7f4aa8100c20 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4ab51b3640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8035910 con 0x7f4aa8101000 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4ab51b3640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8035bf0 con 0x7f4aa80065c0 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4ab49b2640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4aa8101000 0x7f4aa804cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4aaf7fe640 1 -- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa80065c0 msgr2=0x7f4aa80366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4aaf7fe640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa80065c0 0x7f4aa80366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4aaf7fe640 1 -- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4aa8101000 msgr2=0x7f4aa804cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4aaf7fe640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4aa8101000 0x7f4aa804cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.506+0000 7f4aaf7fe640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab004f730 con 0x7f4aa8100c20 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.507+0000 7f4aaf7fe640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa8100c20 0x7f4aa80efc80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400b780 tx=0x7f4aa400bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.507+0000 7f4aaffff640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa80065c0 0x7f4aa80366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.507+0000 7f4aacff9640 1 -- 172.21.15.8:0/302024994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400c720 con 0x7f4aa8100c20 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.507+0000 7f4aacff9640 1 -- 172.21.15.8:0/302024994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400c8a0 con 0x7f4aa8100c20 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.507+0000 7f4aacff9640 1 -- 172.21.15.8:0/302024994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400cc50 con 0x7f4aa8100c20 2023-11-18T23:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.508+0000 7f4ab51b3640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa8035ed0 con 0x7f4aa8100c20 2023-11-18T23:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.508+0000 7f4ab51b3640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa80f01c0 con 0x7f4aa8100c20 2023-11-18T23:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.511+0000 7f4aacff9640 1 -- 172.21.15.8:0/302024994 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4aa4014440 con 0x7f4aa8100c20 2023-11-18T23:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.512+0000 7f4aacff9640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4a9406af40 0x7f4a9406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.514+0000 7f4aacff9640 1 -- 172.21.15.8:0/302024994 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4aa4088c50 con 0x7f4aa8100c20 2023-11-18T23:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.514+0000 7f4aaffff640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4a9406af40 0x7f4a9406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.514+0000 7f4aaffff640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4a9406af40 0x7f4a9406d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8053f60 tx=0x7f4a9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.515+0000 7f4ab51b3640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa80363f0 con 0x7f4aa8100c20 2023-11-18T23:41:19.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.524+0000 7f4aacff9640 1 -- 172.21.15.8:0/302024994 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4aa4088e60 con 0x7f4aa8100c20 2023-11-18T23:41:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.549+0000 7f44bb47c640 1 Processor -- start 2023-11-18T23:41:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.549+0000 7f44bb47c640 1 -- start start 2023-11-18T23:41:19.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.549+0000 7f9901e5d640 1 Processor -- start 2023-11-18T23:41:19.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.549+0000 7f9901e5d640 1 -- start start 2023-11-18T23:41:19.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.550+0000 7f44bb47c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44ac0eacc0 0x7f44ac04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.550+0000 7f44bb47c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac04ff90 0x7f44ac037b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.550+0000 7f44bb47c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac0542f0 con 0x7f44ac0380d0 2023-11-18T23:41:19.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.550+0000 7f44bb47c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac0536e0 con 0x7f44ac0eacc0 2023-11-18T23:41:19.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.550+0000 7f44bb47c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0539c0 con 0x7f44ac04ff90 2023-11-18T23:41:19.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.550+0000 7f9901e5d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98fc0b36b0 0x7f98fc06be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f44ba47a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44ac0eacc0 0x7f44ac04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f44bac7b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f44ac0380d0 0x7f44ac038560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47740/0 (socket says 172.21.15.8:47740) 2023-11-18T23:41:19.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f44ba47a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44ac0eacc0 0x7f44ac04fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48530/0 (socket says 172.21.15.8:48530) 2023-11-18T23:41:19.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f44ba47a640 1 -- 172.21.15.8:0/963080816 learned_addr learned my addr 172.21.15.8:0/963080816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f44b9c79640 1 --2- 172.21.15.8:0/963080816 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac04ff90 0x7f44ac037b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.550+0000 7f9901e5d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f98fc165190 0x7f98fc0b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f9901e5d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc0721b0 con 0x7f98fc0b1b50 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f9901e5d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc0700c0 con 0x7f98fc165190 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f9901e5d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0b3fd0 con 0x7f98fc0b36b0 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f98fbfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f98fc0b1b50 0x7f98fc070550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47744/0 (socket says 172.21.15.8:47744) 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f98fbfff640 1 -- 172.21.15.8:0/1373564382 learned_addr learned my addr 172.21.15.8:0/1373564382 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f1826a67640 1 Processor -- start 2023-11-18T23:41:19.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f1826a67640 1 -- start start 2023-11-18T23:41:19.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f44b9478640 1 -- 172.21.15.8:0/963080816 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500714231 0 0) 0x7f44ac0542f0 con 0x7f44ac0380d0 2023-11-18T23:41:19.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.551+0000 7f44b9478640 1 -- 172.21.15.8:0/963080816 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a0003520 con 0x7f44ac0380d0 2023-11-18T23:41:19.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f44ba47a640 1 -- 172.21.15.8:0/963080816 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac04ff90 msgr2=0x7f44ac037b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f44ba47a640 1 --2- 172.21.15.8:0/963080816 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac04ff90 0x7f44ac037b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f44ba47a640 1 -- 172.21.15.8:0/963080816 >> v1:172.21.15.8:6789/0 conn(0x7f44ac0380d0 legacy=0x7f44ac038560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848843064 0 0) 0x7f98fc0721b0 con 0x7f98fc0b1b50 2023-11-18T23:41:19.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f44ba47a640 1 -- 172.21.15.8:0/963080816 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac053ca0 con 0x7f44ac0eacc0 2023-11-18T23:41:19.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f44b9c79640 1 --2- 172.21.15.8:0/963080816 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac04ff90 0x7f44ac037b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:19.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e4003520 con 0x7f98fc0b1b50 2023-11-18T23:41:19.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f19a04bb640 1 Processor -- start 2023-11-18T23:41:19.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f19a04bb640 1 -- start start 2023-11-18T23:41:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3349096648 0 0) 0x7f98e4003520 con 0x7f98fc0b1b50 2023-11-18T23:41:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98fc0b36b0 msgr2=0x7f98fc06be40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-18T23:41:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f98fa7fc640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98fc0b36b0 0x7f98fc06be40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 >> v2:172.21.15.8:3300/0 conn(0x7f98fc165190 msgr2=0x7f98fc0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f1826a67640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180df1e0 0x7f1818038040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.552+0000 7f98faffd640 1 --2- 172.21.15.8:0/1373564382 >> v2:172.21.15.8:3300/0 conn(0x7f98fc165190 0x7f98fc0b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f44ba47a640 1 --2- 172.21.15.8:0/963080816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac0eacc0 0x7f44ac04fa50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44b40620a0 tx=0x7f44b40a5d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23a1e306242a197 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f1825264640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1818053c30 0x7f181804fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47748/0 (socket says 172.21.15.8:47748) 2023-11-18T23:41:19.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f98fa7fc640 1 --2- 172.21.15.8:0/1373564382 >> v2:172.21.15.8:3300/0 conn(0x7f98fc165190 0x7f98fc0b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f1825264640 1 -- 172.21.15.8:0/1783588195 learned_addr learned my addr 172.21.15.8:0/1783588195 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:19.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1818054480 con 0x7f1818053c30 2023-11-18T23:41:19.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18180541a0 con 0x7f1818050160 2023-11-18T23:41:19.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f44b9478640 1 -- 172.21.15.8:0/963080816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a6c00 con 0x7f44ac0eacc0 2023-11-18T23:41:19.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1818005f40 con 0x7f18180df1e0 2023-11-18T23:41:19.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f44b9478640 1 -- 172.21.15.8:0/963080816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40a6d60 con 0x7f44ac0eacc0 2023-11-18T23:41:19.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f44b9478640 1 -- 172.21.15.8:0/963080816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40ae640 con 0x7f44ac0eacc0 2023-11-18T23:41:19.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f19a04bb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f199806c9a0 0x7f199806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f19a04bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19980ccd10 0x7f19980cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc165670 con 0x7f98fc0b1b50 2023-11-18T23:41:19.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.553+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f98f40019f0 con 0x7f98fc0b1b50 2023-11-18T23:41:19.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 >> v1:172.21.15.8:6789/0 conn(0x7f98fc0b1b50 legacy=0x7f98fc070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fa7fc640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98e4003970 0x7f98e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fa7fc640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98e40047c0 0x7f98e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f1825a65640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180df1e0 0x7f1818038040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fb7fe640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98e4003970 0x7f98e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fa7fc640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98fc0b36b0 0x7f98e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f19a04bb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19980b34f0 con 0x7f19981591a0 2023-11-18T23:41:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f19a04bb640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199806d370 con 0x7f199806c9a0 2023-11-18T23:41:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f19a04bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980b37d0 con 0x7f19980ccd10 2023-11-18T23:41:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0700c0 con 0x7f98e40047c0 2023-11-18T23:41:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0b3fd0 con 0x7f98e4003970 2023-11-18T23:41:19.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4005560 con 0x7f98fc0b36b0 2023-11-18T23:41:19.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f934e6f8640 1 Processor -- start 2023-11-18T23:41:19.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f934e6f8640 1 -- start start 2023-11-18T23:41:19.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f199ea58640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19980ccd10 0x7f19980cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f199ea58640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19980ccd10 0x7f19980cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55352/0 (socket says 172.21.15.8:55352) 2023-11-18T23:41:19.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f199ea58640 1 -- 172.21.15.8:0/3736312105 learned_addr learned my addr 172.21.15.8:0/3736312105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f44bb47c640 1 -- 172.21.15.8:0/963080816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac0eacc0 msgr2=0x7f44ac04fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f44bb47c640 1 --2- 172.21.15.8:0/963080816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac0eacc0 0x7f44ac04fa50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44b40620a0 tx=0x7f44b40a5d90 comp rx=0 tx=0).stop 2023-11-18T23:41:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f199da56640 1 --2- 172.21.15.8:0/3736312105 >> v2:172.21.15.116:3300/0 conn(0x7f199806c9a0 0x7f199806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f44bb47c640 1 -- 172.21.15.8:0/963080816 shutdown_connections 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f44bb47c640 1 --2- 172.21.15.8:0/963080816 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac04ff90 0x7f44ac037b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f44bb47c640 1 --2- 172.21.15.8:0/963080816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac0eacc0 0x7f44ac04fa50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f44bb47c640 1 -- 172.21.15.8:0/963080816 >> 172.21.15.8:0/963080816 conn(0x7f44ac009f70 msgr2=0x7f44ac00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f44bb47c640 1 -- 172.21.15.8:0/963080816 shutdown_connections 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f44bb47c640 1 -- 172.21.15.8:0/963080816 wait complete. 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f199ea58640 1 -- 172.21.15.8:0/3736312105 >> v2:172.21.15.116:3300/0 conn(0x7f199806c9a0 msgr2=0x7f199806ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f199ea58640 1 --2- 172.21.15.8:0/3736312105 >> v2:172.21.15.116:3300/0 conn(0x7f199806c9a0 0x7f199806ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f199ea58640 1 -- 172.21.15.8:0/3736312105 >> v1:172.21.15.116:6789/0 conn(0x7f19981591a0 legacy=0x7f1998070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f199ea58640 1 -- 172.21.15.8:0/3736312105 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19980b3ab0 con 0x7f19980ccd10 2023-11-18T23:41:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f4689472640 1 Processor -- start 2023-11-18T23:41:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f934e6f8640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93480b3910 0x7f934806e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045097941 0 0) 0x7f1818054480 con 0x7f1818053c30 2023-11-18T23:41:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f180c003520 con 0x7f1818053c30 2023-11-18T23:41:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924875541 0 0) 0x7f18180541a0 con 0x7f1818050160 2023-11-18T23:41:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1818054480 con 0x7f1818050160 2023-11-18T23:41:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f199da56640 1 --2- 172.21.15.8:0/3736312105 >> v2:172.21.15.116:3300/0 conn(0x7f199806c9a0 0x7f199806ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f934e6f8640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f934816a0b0 0x7f934806d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f934e6f8640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93480cd110 con 0x7f93480700c0 2023-11-18T23:41:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1052674788 0 0) 0x7f180c003520 con 0x7f1818053c30 2023-11-18T23:41:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180df1e0 msgr2=0x7f1818038040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f199ea58640 1 --2- 172.21.15.8:0/3736312105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19980ccd10 0x7f19980cd160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f199000d370 tx=0x7f199002e2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37af3ea4c5e4694 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180df1e0 0x7f1818038040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.554+0000 7f98faffd640 1 --2- 172.21.15.8:0/1373564382 >> v2:172.21.15.8:3300/0 conn(0x7f98fc165190 0x7f98fc0b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f98faffd640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98e40047c0 0x7f98e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f98fbfff640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98fc0b36b0 0x7f98e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f98faffd640 1 -- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98fc0b36b0 msgr2=0x7f98e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 >> v1:172.21.15.116:6789/0 conn(0x7f1818050160 legacy=0x7f1818006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f98faffd640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98fc0b36b0 0x7f98e400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f98faffd640 1 -- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98e4003970 msgr2=0x7f98e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f98faffd640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98e4003970 0x7f98e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f98faffd640 1 -- 172.21.15.8:0/1373564382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4003520 con 0x7f98e40047c0 2023-11-18T23:41:19.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818006220 con 0x7f1818053c30 2023-11-18T23:41:19.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f4689472640 1 -- start start 2023-11-18T23:41:19.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f182004ed60 con 0x7f1818053c30 2023-11-18T23:41:19.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f934e6f8640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93480b2e70 con 0x7f93480b3910 2023-11-18T23:41:19.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f199d255640 1 -- 172.21.15.8:0/3736312105 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990038600 con 0x7f19980ccd10 2023-11-18T23:41:19.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f44bb47c640 1 Processor -- start 2023-11-18T23:41:19.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f44bb47c640 1 -- start start 2023-11-18T23:41:19.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f199d255640 1 -- 172.21.15.8:0/3736312105 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990032070 con 0x7f19980ccd10 2023-11-18T23:41:19.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f199d255640 1 -- 172.21.15.8:0/3736312105 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990038960 con 0x7f19980ccd10 2023-11-18T23:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 >> v1:172.21.15.8:6789/0 conn(0x7f1818053c30 legacy=0x7f181804fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f180c003b30 0x7f180c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f180c0047c0 0x7f180c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c005180 0x7f180c00ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1818005f40 con 0x7f180c005180 2023-11-18T23:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4689472640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f467c004a00 0x7f467c0e2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4689472640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c03a870 0x7f467c006300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4689472640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c006840 con 0x7f467c053300 2023-11-18T23:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4689472640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c006ac0 con 0x7f467c004a00 2023-11-18T23:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4689472640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c006da0 con 0x7f467c03a870 2023-11-18T23:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f98faffd640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98e40047c0 0x7f98e4004c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00aa70 tx=0x7f98e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c019d2473e14730f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1825264640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f180c0047c0 0x7f180c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c00bf40 con 0x7f180c0047c0 2023-11-18T23:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c00c100 con 0x7f180c003b30 2023-11-18T23:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4688c71640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f467c053300 0x7f467c053730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47758/0 (socket says 172.21.15.8:47758) 2023-11-18T23:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4688c71640 1 -- 172.21.15.8:0/209071195 learned_addr learned my addr 172.21.15.8:0/209071195 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f4683fff640 1 --2- 172.21.15.8:0/209071195 >> v2:172.21.15.116:3300/0 conn(0x7f467c004a00 0x7f467c0e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7fe990ba0640 1 Processor -- start 2023-11-18T23:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7fe990ba0640 1 -- start start 2023-11-18T23:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f46837fe640 1 --2- 172.21.15.8:0/209071195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c03a870 0x7f467c006300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.555+0000 7f934e6f8640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934806e5b0 con 0x7f934816a0b0 2023-11-18T23:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934def7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f934816a0b0 0x7f934806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934cef5640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93480b3910 0x7f934806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934def7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f934816a0b0 0x7f934806d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55366/0 (socket says 172.21.15.8:55366) 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934def7640 1 -- 172.21.15.8:0/1950031115 learned_addr learned my addr 172.21.15.8:0/1950031115 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934cef5640 1 --2- 172.21.15.8:0/1950031115 >> v2:172.21.15.8:3300/0 conn(0x7f93480b3910 0x7f934806e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48568/0 (socket says 172.21.15.8:48568) 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934cef5640 1 -- 172.21.15.8:0/1950031115 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f934816a0b0 msgr2=0x7f934806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934cef5640 1 --2- 172.21.15.8:0/1950031115 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f934816a0b0 0x7f934806d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934cef5640 1 -- 172.21.15.8:0/1950031115 >> v1:172.21.15.8:6789/0 conn(0x7f93480700c0 legacy=0x7f93480718d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.556+0000 7f934def7640 1 --2- 172.21.15.8:0/1950031115 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f934816a0b0 0x7f934806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.557+0000 7f934cef5640 1 -- 172.21.15.8:0/1950031115 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480ce5b0 con 0x7f93480b3910 2023-11-18T23:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec004220 con 0x7f98e40047c0 2023-11-18T23:41:19.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec004380 con 0x7f98e40047c0 2023-11-18T23:41:19.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f98fa7fc640 1 -- 172.21.15.8:0/1373564382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec003830 con 0x7f98e40047c0 2023-11-18T23:41:19.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f46837fe640 1 -- 172.21.15.8:0/209071195 >> v2:172.21.15.116:3300/0 conn(0x7f467c004a00 msgr2=0x7f467c0e2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f46837fe640 1 --2- 172.21.15.8:0/209071195 >> v2:172.21.15.116:3300/0 conn(0x7f467c004a00 0x7f467c0e2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f46837fe640 1 -- 172.21.15.8:0/209071195 >> v1:172.21.15.8:6789/0 conn(0x7f467c053300 legacy=0x7f467c053730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f4682ffd640 1 -- 172.21.15.8:0/209071195 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817422230 0 0) 0x7f467c006840 con 0x7f467c053300 2023-11-18T23:41:19.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f1825a65640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f180c003b30 0x7f180c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f46837fe640 1 -- 172.21.15.8:0/209071195 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c007080 con 0x7f467c03a870 2023-11-18T23:41:19.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f934cef5640 1 --2- 172.21.15.8:0/1950031115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480b3910 0x7f934806e070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93380097a0 tx=0x7f933802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98cbec628518466 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f933ffff640 1 -- 172.21.15.8:0/1950031115 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338031830 con 0x7f93480b3910 2023-11-18T23:41:19.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f933ffff640 1 -- 172.21.15.8:0/1950031115 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338031990 con 0x7f93480b3910 2023-11-18T23:41:19.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.558+0000 7f933ffff640 1 -- 172.21.15.8:0/1950031115 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338031d20 con 0x7f93480b3910 2023-11-18T23:41:19.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f1826266640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c005180 0x7f180c00ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f1825264640 1 -- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f180c003b30 msgr2=0x7f180c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe990ba0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe98c0cea80 0x7fe98c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe990ba0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0702a0 0x7fe98c070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe990ba0640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c0b2d30 con 0x7fe98c0b2000 2023-11-18T23:41:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe990ba0640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c070c90 con 0x7fe98c0cea80 2023-11-18T23:41:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe990ba0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0b38b0 con 0x7fe98c0702a0 2023-11-18T23:41:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f46837fe640 1 --2- 172.21.15.8:0/209071195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c03a870 0x7f467c006300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46700097a0 tx=0x7f467002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c13c12ab98ee7ec6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f1825264640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f180c003b30 0x7f180c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe98b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe98c0cea80 0x7fe98c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe98b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe98c0cea80 0x7fe98c156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48590/0 (socket says 172.21.15.8:48590) 2023-11-18T23:41:19.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3028498626 learned_addr learned my addr 172.21.15.8:0/3028498626 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f1825264640 1 -- 172.21.15.8:0/1783588195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c005180 msgr2=0x7f180c00ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f4682ffd640 1 -- 172.21.15.8:0/209071195 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670030800 con 0x7f467c03a870 2023-11-18T23:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7fe98affd640 1 --2- 172.21.15.8:0/3028498626 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0702a0 0x7fe98c070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f4682ffd640 1 -- 172.21.15.8:0/209071195 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4670030960 con 0x7f467c03a870 2023-11-18T23:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f4682ffd640 1 -- 172.21.15.8:0/209071195 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670030800 con 0x7f467c03a870 2023-11-18T23:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f9901e5d640 1 -- 172.21.15.8:0/1373564382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98e40047c0 msgr2=0x7f98e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f9901e5d640 1 --2- 172.21.15.8:0/1373564382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98e40047c0 0x7f98e4004c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00aa70 tx=0x7f98e40057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f98fbfff640 1 -- 172.21.15.8:0/1373564382 reap_dead start 2023-11-18T23:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f9901e5d640 1 -- 172.21.15.8:0/1373564382 shutdown_connections 2023-11-18T23:41:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f9901e5d640 1 -- 172.21.15.8:0/1373564382 >> 172.21.15.8:0/1373564382 conn(0x7f98fc06a4d0 msgr2=0x7f98fc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3028498626 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0702a0 msgr2=0x7fe98c070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7fe98b7fe640 1 --2- 172.21.15.8:0/3028498626 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0702a0 0x7fe98c070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3028498626 >> v1:172.21.15.8:6789/0 conn(0x7fe98c0b2000 legacy=0x7fe98c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3028498626 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c0b3010 con 0x7fe98c0cea80 2023-11-18T23:41:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44bb47c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ac0380d0 0x7f44ac046f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44bb47c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac04ff90 0x7f44ac0e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f19a04bb640 1 -- 172.21.15.8:0/3736312105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19980ccd10 msgr2=0x7f19980cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f9901e5d640 1 -- 172.21.15.8:0/1373564382 shutdown_connections 2023-11-18T23:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f1825264640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c005180 0x7f180c00ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f1825264640 1 -- 172.21.15.8:0/1783588195 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c003520 con 0x7f180c0047c0 2023-11-18T23:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f1826266640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c005180 0x7f180c00ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f934e6f8640 1 -- 172.21.15.8:0/1950031115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480b3910 msgr2=0x7f934806e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1950031115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480b3910 0x7f934806e070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93380097a0 tx=0x7f933802b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f934e6f8640 1 -- 172.21.15.8:0/1950031115 shutdown_connections 2023-11-18T23:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1950031115 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f934816a0b0 0x7f934806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1950031115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480b3910 0x7f934806e070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.559+0000 7f934e6f8640 1 -- 172.21.15.8:0/1950031115 >> 172.21.15.8:0/1950031115 conn(0x7f93480ceb20 msgr2=0x7f93480cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f934e6f8640 1 -- 172.21.15.8:0/1950031115 shutdown_connections 2023-11-18T23:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f934e6f8640 1 -- 172.21.15.8:0/1950031115 wait complete. 2023-11-18T23:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f9901e5d640 1 -- 172.21.15.8:0/1373564382 wait complete. 2023-11-18T23:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 -- 172.21.15.8:0/209071195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c03a870 msgr2=0x7f467c006300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 --2- 172.21.15.8:0/209071195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c03a870 0x7f467c006300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46700097a0 tx=0x7f467002b940 comp rx=0 tx=0).stop 2023-11-18T23:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 -- 172.21.15.8:0/209071195 shutdown_connections 2023-11-18T23:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 --2- 172.21.15.8:0/209071195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c03a870 0x7f467c006300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 --2- 172.21.15.8:0/209071195 >> v2:172.21.15.116:3300/0 conn(0x7f467c004a00 0x7f467c0e2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 -- 172.21.15.8:0/209071195 >> 172.21.15.8:0/209071195 conn(0x7f467c054ee0 msgr2=0x7f467c0552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f1825264640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f180c0047c0 0x7f180c004c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f182002cee0 tx=0x7f180c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f03595b5db1d3124 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44ba47a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ac0380d0 0x7f44ac046f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 -- 172.21.15.8:0/209071195 shutdown_connections 2023-11-18T23:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44ba47a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ac0380d0 0x7f44ac046f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53664/0 (socket says 172.21.15.8:53664) 2023-11-18T23:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f4689472640 1 -- 172.21.15.8:0/209071195 wait complete. 2023-11-18T23:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200a6e90 con 0x7f180c0047c0 2023-11-18T23:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18200ae440 con 0x7f180c0047c0 2023-11-18T23:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f1824a63640 1 -- 172.21.15.8:0/1783588195 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200ae7f0 con 0x7f180c0047c0 2023-11-18T23:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44bb47c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac0eacc0 0x7f44ac043fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44bb47c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac043640 con 0x7f44ac04ff90 2023-11-18T23:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44bb47c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac043920 con 0x7f44ac0380d0 2023-11-18T23:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44bb47c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac046720 con 0x7f44ac0eacc0 2023-11-18T23:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.560+0000 7f44ba47a640 1 -- 172.21.15.8:0/4261248067 learned_addr learned my addr 172.21.15.8:0/4261248067 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7fe98b7fe640 1 --2- 172.21.15.8:0/3028498626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0cea80 0x7fe98c156c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009870 tx=0x7fe97c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbf71c5468f52bb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3736312105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19980ccd10 0x7f19980cd160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f199000d370 tx=0x7f199002e2c0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7fe98a7fc640 1 -- 172.21.15.8:0/3028498626 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c031640 con 0x7fe98c0cea80 2023-11-18T23:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7fe98a7fc640 1 -- 172.21.15.8:0/3028498626 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c0317a0 con 0x7fe98c0cea80 2023-11-18T23:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7fe98a7fc640 1 -- 172.21.15.8:0/3028498626 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c031b30 con 0x7fe98c0cea80 2023-11-18T23:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f19a04bb640 1 -- 172.21.15.8:0/3736312105 shutdown_connections 2023-11-18T23:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3736312105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19980ccd10 0x7f19980cd160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3736312105 >> v2:172.21.15.116:3300/0 conn(0x7f199806c9a0 0x7f199806ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f19a04bb640 1 -- 172.21.15.8:0/3736312105 >> 172.21.15.8:0/3736312105 conn(0x7f199806a8f0 msgr2=0x7f199806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f19a04bb640 1 -- 172.21.15.8:0/3736312105 shutdown_connections 2023-11-18T23:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f19a04bb640 1 -- 172.21.15.8:0/3736312105 wait complete. 2023-11-18T23:41:19.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f180c0047c0 msgr2=0x7f180c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f1826a67640 1 --2- 172.21.15.8:0/1783588195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f180c0047c0 0x7f180c004c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f182002cee0 tx=0x7f180c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f1826266640 1 -- 172.21.15.8:0/1783588195 reap_dead start 2023-11-18T23:41:19.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f44b9c79640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac04ff90 0x7f44ac0e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f9901e5d640 1 Processor -- start 2023-11-18T23:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f44b9c79640 1 -- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac0eacc0 msgr2=0x7f44ac043fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-18T23:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f44b9c79640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac0eacc0 0x7f44ac043fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f44b9c79640 1 -- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ac0380d0 msgr2=0x7f44ac046f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f44b9c79640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ac0380d0 0x7f44ac046f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f44b9c79640 1 -- 172.21.15.8:0/4261248067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009400 con 0x7f44ac04ff90 2023-11-18T23:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7fe990ba0640 1 -- 172.21.15.8:0/3028498626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0cea80 msgr2=0x7fe98c156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3028498626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0cea80 0x7fe98c156c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009870 tx=0x7fe97c02b8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f4689472640 1 Processor -- start 2023-11-18T23:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f934e6f8640 1 Processor -- start 2023-11-18T23:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.561+0000 7f934e6f8640 1 -- start start 2023-11-18T23:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f9901e5d640 1 -- start start 2023-11-18T23:41:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.562+0000 7f4689472640 1 -- start start 2023-11-18T23:41:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f44b9c79640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac04ff90 0x7f44ac0e6810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f44b000e900 tx=0x7f44b000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7fe990ba0640 1 -- 172.21.15.8:0/3028498626 shutdown_connections 2023-11-18T23:41:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3028498626 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0702a0 0x7fe98c070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3028498626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0cea80 0x7fe98c156c30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7fe990ba0640 1 -- 172.21.15.8:0/3028498626 >> 172.21.15.8:0/3028498626 conn(0x7fe98c06a6b0 msgr2=0x7fe98c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934e6f8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480700c0 0x7f9348089840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934e6f8640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93480b3910 0x7f93480aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934e6f8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f934816a0b0 0x7f93480af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934e6f8640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934815dca0 con 0x7f93480700c0 2023-11-18T23:41:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934e6f8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934815d060 con 0x7f934816a0b0 2023-11-18T23:41:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934e6f8640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934815d300 con 0x7f93480b3910 2023-11-18T23:41:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 shutdown_connections 2023-11-18T23:41:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 >> 172.21.15.8:0/1783588195 conn(0x7f1818009f70 msgr2=0x7f181800a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f44aaffd640 1 -- 172.21.15.8:0/4261248067 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000ca00 con 0x7f44ac04ff90 2023-11-18T23:41:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 shutdown_connections 2023-11-18T23:41:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7fe990ba0640 1 -- 172.21.15.8:0/3028498626 shutdown_connections 2023-11-18T23:41:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934cef5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93480b3910 0x7f93480aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f44aaffd640 1 -- 172.21.15.8:0/4261248067 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000cb60 con 0x7f44ac04ff90 2023-11-18T23:41:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934cef5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93480b3910 0x7f93480aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55402/0 (socket says 172.21.15.8:55402) 2023-11-18T23:41:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934cef5640 1 -- 172.21.15.8:0/1349170234 learned_addr learned my addr 172.21.15.8:0/1349170234 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934def7640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f934816a0b0 0x7f93480af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f934d6f6640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480700c0 0x7f9348089840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f44aaffd640 1 -- 172.21.15.8:0/4261248067 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0013470 con 0x7f44ac04ff90 2023-11-18T23:41:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7fe990ba0640 1 -- 172.21.15.8:0/3028498626 wait complete. 2023-11-18T23:41:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f19a04bb640 1 Processor -- start 2023-11-18T23:41:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.563+0000 7f19a04bb640 1 -- start start 2023-11-18T23:41:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f1826a67640 1 -- 172.21.15.8:0/1783588195 wait complete. 2023-11-18T23:41:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f934cef5640 1 -- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f934816a0b0 msgr2=0x7f93480af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f934cef5640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f934816a0b0 0x7f93480af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f934cef5640 1 -- 172.21.15.8:0/1349170234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480700c0 msgr2=0x7f9348089840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f934cef5640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480700c0 0x7f9348089840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f934cef5640 1 -- 172.21.15.8:0/1349170234 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338009400 con 0x7f93480b3910 2023-11-18T23:41:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4689472640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c004a00 0x7f467c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4689472640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f467c03a870 0x7f467c0dcb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f9901e5d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98e40047c0 0x7f98fc14b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4683fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c004a00 0x7f467c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4683fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c004a00 0x7f467c0cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55408/0 (socket says 172.21.15.8:55408) 2023-11-18T23:41:19.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4683fff640 1 -- 172.21.15.8:0/2466309761 learned_addr learned my addr 172.21.15.8:0/2466309761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f934cef5640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93480b3910 0x7f93480aed60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93380098c0 tx=0x7f93380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f46837fe640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f467c03a870 0x7f467c0dcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4689472640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467c053300 0x7f467c04dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f9901e5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98fc1fb820 0x7f98fc099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f933dffb640 1 -- 172.21.15.8:0/1349170234 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93380317d0 con 0x7f93480b3910 2023-11-18T23:41:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f933dffb640 1 -- 172.21.15.8:0/1349170234 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933803ba70 con 0x7f93480b3910 2023-11-18T23:41:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f933dffb640 1 -- 172.21.15.8:0/1349170234 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933803be20 con 0x7f93480b3910 2023-11-18T23:41:19.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f9901e5d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc1fac80 0x7f98fc1fb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f98fb7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98e40047c0 0x7f98fc14b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f98fb7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98e40047c0 0x7f98fc14b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55416/0 (socket says 172.21.15.8:55416) 2023-11-18T23:41:19.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4688c71640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467c053300 0x7f467c04dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f4689472640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c189de0 con 0x7f467c053300 2023-11-18T23:41:19.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f98fb7fe640 1 -- 172.21.15.8:0/3947627256 learned_addr learned my addr 172.21.15.8:0/3947627256 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f98fbfff640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc1fac80 0x7f98fc1fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f98faffd640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98fc1fb820 0x7f98fc099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f4689472640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0cc930 con 0x7f467c03a870 2023-11-18T23:41:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1fb640 con 0x7f98fc1fac80 2023-11-18T23:41:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f19a04bb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199806c9a0 0x7f1998156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc09c010 con 0x7f98fc1fb820 2023-11-18T23:41:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f19a04bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19980ccd10 0x7f19980b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f19a04bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19981591a0 0x7f19980b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f19a04bb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19981f3ba0 con 0x7f199806c9a0 2023-11-18T23:41:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f19a04bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19980af8a0 con 0x7f19980ccd10 2023-11-18T23:41:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f19a04bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19981574e0 con 0x7f19981591a0 2023-11-18T23:41:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc09c2d0 con 0x7f98e40047c0 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b404f730 con 0x7f44ac04ff90 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac044510 con 0x7f44ac04ff90 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f44ba47a640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ac0380d0 0x7f44ac046f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f199e257640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199806c9a0 0x7f1998156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f199e257640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199806c9a0 0x7f1998156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48630/0 (socket says 172.21.15.8:48630) 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f199e257640 1 -- 172.21.15.8:0/3024767610 learned_addr learned my addr 172.21.15.8:0/3024767610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f199da56640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19980ccd10 0x7f19980b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f199da56640 1 -- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19981591a0 msgr2=0x7f19980b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f199da56640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19981591a0 0x7f19980b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f199da56640 1 -- 172.21.15.8:0/3024767610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199806c9a0 msgr2=0x7f1998156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f199da56640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199806c9a0 0x7f1998156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f199da56640 1 -- 172.21.15.8:0/3024767610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199000d050 con 0x7f19980ccd10 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f199e257640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199806c9a0 0x7f1998156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7fe990ba0640 1 Processor -- start 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f98fb7fe640 1 -- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98fc1fb820 msgr2=0x7f98fc099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f98fb7fe640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98fc1fb820 0x7f98fc099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f98fb7fe640 1 -- 172.21.15.8:0/3947627256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc1fac80 msgr2=0x7f98fc1fb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f98fb7fe640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc1fac80 0x7f98fc1fb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f98fb7fe640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc09c5b0 con 0x7f98e40047c0 2023-11-18T23:41:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f98fbfff640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc1fac80 0x7f98fc1fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f1826a67640 1 Processor -- start 2023-11-18T23:41:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f4689472640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c1891a0 con 0x7f467c004a00 2023-11-18T23:41:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.564+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934815d5e0 con 0x7f93480b3910 2023-11-18T23:41:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.565+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9348089d80 con 0x7f93480b3910 2023-11-18T23:41:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f1826a67640 1 -- start start 2023-11-18T23:41:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f98fb7fe640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98e40047c0 0x7f98fc14b730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98f000e870 tx=0x7f98f000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f199da56640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19980ccd10 0x7f19980b0c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f198800c7f0 tx=0x7f198800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7fe990ba0640 1 -- start start 2023-11-18T23:41:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f98e3fff640 1 -- 172.21.15.8:0/3947627256 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000ee60 con 0x7f98e40047c0 2023-11-18T23:41:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f4683fff640 1 -- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f467c03a870 msgr2=0x7f467c0dcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f4683fff640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f467c03a870 0x7f467c0dcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f4683fff640 1 -- 172.21.15.8:0/2466309761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467c053300 msgr2=0x7f467c04dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f4683fff640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467c053300 0x7f467c04dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f4683fff640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670009400 con 0x7f467c004a00 2023-11-18T23:41:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f198effd640 1 -- 172.21.15.8:0/3024767610 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988004220 con 0x7f19980ccd10 2023-11-18T23:41:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f198effd640 1 -- 172.21.15.8:0/3024767610 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988004380 con 0x7f19980ccd10 2023-11-18T23:41:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.566+0000 7f198effd640 1 -- 172.21.15.8:0/3024767610 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988003830 con 0x7f19980ccd10 2023-11-18T23:41:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc09c890 con 0x7f98e40047c0 2023-11-18T23:41:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc099eb0 con 0x7f98e40047c0 2023-11-18T23:41:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f1826a67640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c0047c0 0x7f181804a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac046c40 con 0x7f44ac04ff90 2023-11-18T23:41:19.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826a67640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180d4010 0x7f181817d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe990ba0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe98c0702a0 0x7fe98c1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe990ba0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0b2000 0x7fe98c165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe990ba0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0cea80 0x7fe98c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe990ba0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c167010 con 0x7fe98c0b2000 2023-11-18T23:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe990ba0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c166a50 con 0x7fe98c0702a0 2023-11-18T23:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe990ba0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c166d30 con 0x7fe98c0cea80 2023-11-18T23:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1825a65640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c0047c0 0x7f181804a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1825a65640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c0047c0 0x7f181804a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48632/0 (socket says 172.21.15.8:48632) 2023-11-18T23:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19980b1700 con 0x7f19980ccd10 2023-11-18T23:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19981f3200 con 0x7f19980ccd10 2023-11-18T23:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe98b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe98c0702a0 0x7fe98c1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe98b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe98c0702a0 0x7fe98c1488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53702/0 (socket says 172.21.15.8:53702) 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3242468834 learned_addr learned my addr 172.21.15.8:0/3242468834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe98bfff640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0cea80 0x7fe98c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7fe98affd640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0b2000 0x7fe98c165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826a67640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18180cf750 0x7f18180cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826a67640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18180d7ef0 con 0x7f180c0047c0 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826a67640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181804eaa0 con 0x7f18180cf750 2023-11-18T23:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826a67640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1818049bc0 con 0x7f18180d4010 2023-11-18T23:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826266640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18180cf750 0x7f18180cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826266640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18180cf750 0x7f18180cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53708/0 (socket says 172.21.15.8:53708) 2023-11-18T23:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1826266640 1 -- 172.21.15.8:0/3032575312 learned_addr learned my addr 172.21.15.8:0/3032575312 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f4683fff640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c004a00 0x7f467c0cc3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f468404fab0 tx=0x7f4684067f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f46837fe640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f467c03a870 0x7f467c0dcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f933dffb640 1 -- 172.21.15.8:0/1349170234 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f933804c3b0 con 0x7f93480b3910 2023-11-18T23:41:19.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93480b3e80 con 0x7f93480b3910 2023-11-18T23:41:19.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f1825264640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180d4010 0x7f181817d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f933dffb640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f932c06af10 0x7f932c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0cea80 msgr2=0x7fe98c0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe98b7fe640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0cea80 0x7fe98c0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3242468834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0b2000 msgr2=0x7fe98c165f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe98b7fe640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0b2000 0x7fe98c165f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe98b7fe640 1 -- 172.21.15.8:0/3242468834 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c0094d0 con 0x7fe98c0702a0 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe98bfff640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0cea80 0x7fe98c0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe98b7fe640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe98c0702a0 0x7fe98c1488c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009870 tx=0x7fe97c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f1825a65640 1 -- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180d4010 msgr2=0x7f181817d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f1825a65640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180d4010 0x7f181817d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f1825a65640 1 -- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18180cf750 msgr2=0x7f18180cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f1825a65640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18180cf750 0x7f18180cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f1825a65640 1 -- 172.21.15.8:0/3032575312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181804e7c0 con 0x7f180c0047c0 2023-11-18T23:41:19.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f1825a65640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c0047c0 0x7f181804a050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1810011890 tx=0x7f1810011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f933dffb640 1 -- 172.21.15.8:0/1349170234 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93380ab480 con 0x7f93480b3910 2023-11-18T23:41:19.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f934d6f6640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f932c06af10 0x7f932c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f4680ff9640 1 -- 172.21.15.8:0/2466309761 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468406be40 con 0x7f467c004a00 2023-11-18T23:41:19.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f4680ff9640 1 -- 172.21.15.8:0/2466309761 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684068820 con 0x7f467c004a00 2023-11-18T23:41:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f4680ff9640 1 -- 172.21.15.8:0/2466309761 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684072400 con 0x7f467c004a00 2023-11-18T23:41:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19980ac7e0 con 0x7f19980ccd10 2023-11-18T23:41:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f4689472640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c189440 con 0x7f467c004a00 2023-11-18T23:41:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f4689472640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c189a00 con 0x7f467c004a00 2023-11-18T23:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7f18167fc640 1 -- 172.21.15.8:0/3032575312 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000fa30 con 0x7f180c0047c0 2023-11-18T23:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f18167fc640 1 -- 172.21.15.8:0/3032575312 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000fb90 con 0x7f180c0047c0 2023-11-18T23:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1818049570 con 0x7f180c0047c0 2023-11-18T23:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.569+0000 7fe973fff640 1 -- 172.21.15.8:0/3242468834 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c03ac60 con 0x7fe98c0702a0 2023-11-18T23:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7fe973fff640 1 -- 172.21.15.8:0/3242468834 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c03adc0 con 0x7fe98c0702a0 2023-11-18T23:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7fe973fff640 1 -- 172.21.15.8:0/3242468834 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0445f0 con 0x7fe98c0702a0 2023-11-18T23:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c14fb60 con 0x7fe98c0702a0 2023-11-18T23:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c1664d0 con 0x7fe98c0702a0 2023-11-18T23:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f934d6f6640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f932c06af10 0x7f932c06d3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9344006fd0 tx=0x7f9344008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.567+0000 7f98e3fff640 1 -- 172.21.15.8:0/3947627256 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f000c940 con 0x7f98e40047c0 2023-11-18T23:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.568+0000 7f98e3fff640 1 -- 172.21.15.8:0/3947627256 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000ccf0 con 0x7f98e40047c0 2023-11-18T23:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f98e3fff640 1 -- 172.21.15.8:0/3947627256 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98f0013470 con 0x7f98e40047c0 2023-11-18T23:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f44aaffd640 1 -- 172.21.15.8:0/4261248067 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44b00135d0 con 0x7f44ac04ff90 2023-11-18T23:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.571+0000 7f44aaffd640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f449806ae40 0x7f449806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.571+0000 7f44aaffd640 1 -- 172.21.15.8:0/4261248067 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44b00895b0 con 0x7f44ac04ff90 2023-11-18T23:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f198effd640 1 -- 172.21.15.8:0/3024767610 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1988003ba0 con 0x7f19980ccd10 2023-11-18T23:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f198effd640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197c06af10 0x7f197c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f198effd640 1 -- 172.21.15.8:0/3024767610 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19880893a0 con 0x7f19980ccd10 2023-11-18T23:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.571+0000 7f98e3fff640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f98e806af10 0x7f98e806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f18167fc640 1 -- 172.21.15.8:0/3032575312 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810014440 con 0x7f180c0047c0 2023-11-18T23:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.570+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181804e3e0 con 0x7f180c0047c0 2023-11-18T23:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.571+0000 7f4688c71640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467c053300 0x7f467c04dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.571+0000 7f98faffd640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f98e806af10 0x7f98e806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.571+0000 7f98e3fff640 1 -- 172.21.15.8:0/3947627256 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98f0089630 con 0x7f98e40047c0 2023-11-18T23:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f199e257640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197c06af10 0x7f197c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc04e840 con 0x7f98e40047c0 2023-11-18T23:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f98faffd640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f98e806af10 0x7f98e806d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98ec035000 tx=0x7f98ec039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f44ba47a640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f449806ae40 0x7f449806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c189b90 con 0x7f467c004a00 2023-11-18T23:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c005250 con 0x7fe98c0702a0 2023-11-18T23:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1818005280 con 0x7f180c0047c0 2023-11-18T23:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f18167fc640 1 -- 172.21.15.8:0/3032575312 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18100263f0 con 0x7f180c0047c0 2023-11-18T23:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f44ba47a640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f449806ae40 0x7f449806d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44b4069ca0 tx=0x7f44b40aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.572+0000 7f199e257640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197c06af10 0x7f197c06d3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1994007fd0 tx=0x7f1994009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.573+0000 7f18167fc640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f180406aec0 0x7f180406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.573+0000 7f1825264640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f180406aec0 0x7f180406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.573+0000 7f1825264640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f180406aec0 0x7f180406d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f180c00c0d0 tx=0x7f18200aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.574+0000 7f933dffb640 1 -- 172.21.15.8:0/1349170234 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9338076770 con 0x7f93480b3910 2023-11-18T23:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.575+0000 7f198effd640 1 -- 172.21.15.8:0/3024767610 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1988054570 con 0x7f19980ccd10 2023-11-18T23:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.576+0000 7f4680ff9640 1 -- 172.21.15.8:0/2466309761 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4684072560 con 0x7f467c004a00 2023-11-18T23:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.576+0000 7f4680ff9640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f466806ae90 0x7f466806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.576+0000 7fe973fff640 1 -- 172.21.15.8:0/3242468834 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe97c02f050 con 0x7fe98c0702a0 2023-11-18T23:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.577+0000 7f46837fe640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f466806ae90 0x7f466806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.577+0000 7fe973fff640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe97806ae90 0x7fe97806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.577+0000 7fe973fff640 1 -- 172.21.15.8:0/3242468834 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe97c0ab7e0 con 0x7fe98c0702a0 2023-11-18T23:41:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.577+0000 7f46837fe640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f466806ae90 0x7f466806d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4670036000 tx=0x7f4670008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.577+0000 7fe98affd640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe97806ae90 0x7fe97806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.578+0000 7fe98affd640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe97806ae90 0x7fe97806d350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe98c14c460 tx=0x7fe980008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.578+0000 7f18167fc640 1 -- 172.21.15.8:0/3032575312 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1810006bf0 con 0x7f180c0047c0 2023-11-18T23:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.578+0000 7f44aaffd640 1 -- 172.21.15.8:0/4261248067 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44ac046c40 con 0x7f44ac04ff90 2023-11-18T23:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.579+0000 7f98e3fff640 1 -- 172.21.15.8:0/3947627256 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98f0054770 con 0x7f98e40047c0 2023-11-18T23:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.579+0000 7f4680ff9640 1 -- 172.21.15.8:0/2466309761 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46840d2b50 con 0x7f467c004a00 2023-11-18T23:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.582+0000 7fe973fff640 1 -- 172.21.15.8:0/3242468834 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe97c076900 con 0x7fe98c0702a0 2023-11-18T23:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.584+0000 7f4680ff9640 1 -- 172.21.15.8:0/2466309761 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46840ce790 con 0x7f467c004a00 2023-11-18T23:41:19.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.587+0000 7f18167fc640 1 -- 172.21.15.8:0/3032575312 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1810054c10 con 0x7f180c0047c0 2023-11-18T23:41:19.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.933+0000 7f4ab51b3640 1 -- 172.21.15.8:0/302024994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4aa8005290 con 0x7f4aa8100c20 2023-11-18T23:41:19.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.934+0000 7f4aacff9640 1 -- 172.21.15.8:0/302024994 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4aa80363f0 con 0x7f4aa8100c20 2023-11-18T23:41:19.935 INFO:teuthology.orchestra.run.smithi008.stdout:55834574852 2023-11-18T23:41:19.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 -- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4a9406af40 msgr2=0x7f4a9406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4a9406af40 0x7f4a9406d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8053f60 tx=0x7f4a9c009040 comp rx=0 tx=0).stop 2023-11-18T23:41:19.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 -- 172.21.15.8:0/302024994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa8100c20 msgr2=0x7f4aa80efc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa8100c20 0x7f4aa80efc80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400b780 tx=0x7f4aa400bc40 comp rx=0 tx=0).stop 2023-11-18T23:41:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 -- 172.21.15.8:0/302024994 shutdown_connections 2023-11-18T23:41:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4a9406af40 0x7f4a9406d400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4aa8101000 0x7f4aa804cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa8100c20 0x7f4aa80efc80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 --2- 172.21.15.8:0/302024994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4aa80065c0 0x7f4aa80366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.938+0000 7f4a9a7fc640 1 -- 172.21.15.8:0/302024994 >> 172.21.15.8:0/302024994 conn(0x7f4aa8009f80 msgr2=0x7f4aa800a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.941+0000 7f4a9a7fc640 1 -- 172.21.15.8:0/302024994 shutdown_connections 2023-11-18T23:41:19.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.942+0000 7f4a9a7fc640 1 -- 172.21.15.8:0/302024994 wait complete. 2023-11-18T23:41:19.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-11-18T23:41:19.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.975+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe96c0057d0 con 0x7fe98c0702a0 2023-11-18T23:41:19.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.976+0000 7fe973fff640 1 -- 172.21.15.8:0/3242468834 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe97c031e60 con 0x7fe98c0702a0 2023-11-18T23:41:19.977 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:19.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe97806ae90 msgr2=0x7fe97806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe97806ae90 0x7fe97806d350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe98c14c460 tx=0x7fe980008040 comp rx=0 tx=0).stop 2023-11-18T23:41:19.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe98c0702a0 msgr2=0x7fe98c1488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe98c0702a0 0x7fe98c1488c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009870 tx=0x7fe97c0046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 shutdown_connections 2023-11-18T23:41:19.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe97806ae90 0x7fe97806d350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe98c0cea80 0x7fe98c0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe98c0b2000 0x7fe98c165f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 --2- 172.21.15.8:0/3242468834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe98c0702a0 0x7fe98c1488c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 >> 172.21.15.8:0/3242468834 conn(0x7fe98c06a6b0 msgr2=0x7fe98c0ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 shutdown_connections 2023-11-18T23:41:19.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.978+0000 7fe990ba0640 1 -- 172.21.15.8:0/3242468834 wait complete. 2023-11-18T23:41:19.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.987+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f934804e840 con 0x7f93480b3910 2023-11-18T23:41:19.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.988+0000 7f933dffb640 1 -- 172.21.15.8:0/1349170234 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9338035020 con 0x7f93480b3910 2023-11-18T23:41:19.990 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-11-18T23:41:19.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f932c06af10 msgr2=0x7f932c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f932c06af10 0x7f932c06d3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9344006fd0 tx=0x7f9344008040 comp rx=0 tx=0).stop 2023-11-18T23:41:19.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93480b3910 msgr2=0x7f93480aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93480b3910 0x7f93480aed60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93380098c0 tx=0x7f93380046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 shutdown_connections 2023-11-18T23:41:19.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f932c06af10 0x7f932c06d3d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f934816a0b0 0x7f93480af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93480b3910 0x7f93480aed60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 --2- 172.21.15.8:0/1349170234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93480700c0 0x7f9348089840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 >> 172.21.15.8:0/1349170234 conn(0x7f93480ceb20 msgr2=0x7f934806cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:19.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 shutdown_connections 2023-11-18T23:41:19.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.992+0000 7f934e6f8640 1 -- 172.21.15.8:0/1349170234 wait complete. 2023-11-18T23:41:19.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.993+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1998072ae0 con 0x7f19980ccd10 2023-11-18T23:41:19.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-11-18T23:41:19.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.994+0000 7f198effd640 1 -- 172.21.15.8:0/3024767610 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1988057b90 con 0x7f19980ccd10 2023-11-18T23:41:19.997 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-11-18T23:41:19.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.995+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f44ac046c40 con 0x7f44ac04ff90 2023-11-18T23:41:19.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.996+0000 7f44aaffd640 1 -- 172.21.15.8:0/4261248067 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44ac046c40 con 0x7f44ac04ff90 2023-11-18T23:41:19.998 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-11-18T23:41:19.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197c06af10 msgr2=0x7f197c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197c06af10 0x7f197c06d3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1994007fd0 tx=0x7f1994009040 comp rx=0 tx=0).stop 2023-11-18T23:41:19.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19980ccd10 msgr2=0x7f19980b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:19.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19980ccd10 0x7f19980b0c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f198800c7f0 tx=0x7f198800ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 shutdown_connections 2023-11-18T23:41:19.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197c06af10 0x7f197c06d3d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:19.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19981591a0 0x7f19980b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19980ccd10 0x7f19980b0c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 --2- 172.21.15.8:0/3024767610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199806c9a0 0x7f1998156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 >> 172.21.15.8:0/3024767610 conn(0x7f199806a8f0 msgr2=0x7f1998157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:20.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 shutdown_connections 2023-11-18T23:41:20.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.997+0000 7f19a04bb640 1 -- 172.21.15.8:0/3024767610 wait complete. 2023-11-18T23:41:20.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f467c008df0 con 0x7f467c004a00 2023-11-18T23:41:20.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f449806ae40 msgr2=0x7f449806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f449806ae40 0x7f449806d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44b4069ca0 tx=0x7f44b40aa000 comp rx=0 tx=0).stop 2023-11-18T23:41:20.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac04ff90 msgr2=0x7f44ac0e6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac04ff90 0x7f44ac0e6810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f44b000e900 tx=0x7f44b000edc0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 shutdown_connections 2023-11-18T23:41:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f449806ae40 0x7f449806d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44ac0eacc0 0x7f44ac043fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44ac04ff90 0x7f44ac0e6810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 --2- 172.21.15.8:0/4261248067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44ac0380d0 0x7f44ac046f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 >> 172.21.15.8:0/4261248067 conn(0x7f44ac009f70 msgr2=0x7f44ac0497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 shutdown_connections 2023-11-18T23:41:20.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f4680ff9640 1 -- 172.21.15.8:0/2466309761 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46840d1db0 con 0x7f467c004a00 2023-11-18T23:41:20.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:19.999+0000 7f44bb47c640 1 -- 172.21.15.8:0/4261248067 wait complete. 2023-11-18T23:41:20.003 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-11-18T23:41:20.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.000+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98fc0cc090 con 0x7f98e40047c0 2023-11-18T23:41:20.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.000+0000 7f98e3fff640 1 -- 172.21.15.8:0/3947627256 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98f0021090 con 0x7f98e40047c0 2023-11-18T23:41:20.004 INFO:teuthology.orchestra.run.smithi008.stdout:55834574856 2023-11-18T23:41:20.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f181800c060 con 0x7f180c0047c0 2023-11-18T23:41:20.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f466806ae90 msgr2=0x7f466806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f466806ae90 0x7f466806d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4670036000 tx=0x7f4670008030 comp rx=0 tx=0).stop 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c004a00 msgr2=0x7f467c0cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c004a00 0x7f467c0cc3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f468404fab0 tx=0x7f4684067f00 comp rx=0 tx=0).stop 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 shutdown_connections 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f466806ae90 0x7f466806d350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467c053300 0x7f467c04dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f467c03a870 0x7f467c0dcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 --2- 172.21.15.8:0/2466309761 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f467c004a00 0x7f467c0cc3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 >> 172.21.15.8:0/2466309761 conn(0x7f467c054ee0 msgr2=0x7f467c04f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 shutdown_connections 2023-11-18T23:41:20.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.002+0000 7f466e7fc640 1 -- 172.21.15.8:0/2466309761 wait complete. 2023-11-18T23:41:20.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.003+0000 7f18167fc640 1 -- 172.21.15.8:0/3032575312 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1810058230 con 0x7f180c0047c0 2023-11-18T23:41:20.006 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.003+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f98e806af10 msgr2=0x7f98e806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.003+0000 7f9901e5d640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f98e806af10 0x7f98e806d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98ec035000 tx=0x7f98ec039040 comp rx=0 tx=0).stop 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.003+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98e40047c0 msgr2=0x7f98fc14b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.003+0000 7f9901e5d640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98e40047c0 0x7f98fc14b730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98f000e870 tx=0x7f98f000ed30 comp rx=0 tx=0).stop 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 shutdown_connections 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f98e806af10 0x7f98e806d3d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc1fac80 0x7f98fc1fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98fc1fb820 0x7f98fc099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 --2- 172.21.15.8:0/3947627256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f98e40047c0 0x7f98fc14b730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 >> 172.21.15.8:0/3947627256 conn(0x7f98fc06a4d0 msgr2=0x7f98fc0adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 shutdown_connections 2023-11-18T23:41:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.004+0000 7f9901e5d640 1 -- 172.21.15.8:0/3947627256 wait complete. 2023-11-18T23:41:20.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f180406aec0 msgr2=0x7f180406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f180406aec0 0x7f180406d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f180c00c0d0 tx=0x7f18200aa000 comp rx=0 tx=0).stop 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c0047c0 msgr2=0x7f181804a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c0047c0 0x7f181804a050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1810011890 tx=0x7f1810011d50 comp rx=0 tx=0).stop 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 shutdown_connections 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f180406aec0 0x7f180406d380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18180cf750 0x7f18180cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18180d4010 0x7f181817d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.006+0000 7f1826a67640 1 --2- 172.21.15.8:0/3032575312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f180c0047c0 0x7f181804a050 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.007+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 >> 172.21.15.8:0/3032575312 conn(0x7f1818009f70 msgr2=0x7f18180df930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.007+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 shutdown_connections 2023-11-18T23:41:20.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:20.007+0000 7f1826a67640 1 -- 172.21.15.8:0/3032575312 wait complete. 2023-11-18T23:41:20.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-11-18T23:41:20.012 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:20.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2023-11-18T23:41:20.016 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:20.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-11-18T23:41:20.018 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:20.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-11-18T23:41:20.023 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:20.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-11-18T23:41:20.024 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:20.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2023-11-18T23:41:20.025 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:20.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T23:41:20.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T23:41:21.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.081+0000 7f3834d89640 1 Processor -- start 2023-11-18T23:41:21.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.081+0000 7f3834d89640 1 -- start start 2023-11-18T23:41:21.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f3834d89640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3830160b70 0x7f38300d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f3834d89640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300b2aa0 0x7f38300ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f3834d89640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38300ce360 con 0x7f38300ced30 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f3834d89640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300b2f20 con 0x7f3830160b70 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f3834d89640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300cdd50 con 0x7f38300b2aa0 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382ed9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f38300ced30 0x7f38300cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47784/0 (socket says 172.21.15.8:47784) 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382ed9d640 1 -- 172.21.15.8:0/88347922 learned_addr learned my addr 172.21.15.8:0/88347922 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382e59c640 1 --2- 172.21.15.8:0/88347922 >> v2:172.21.15.116:3300/0 conn(0x7f3830160b70 0x7f38300d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382dd9b640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300b2aa0 0x7f38300ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141761937 0 0) 0x7f38300ce360 con 0x7f38300ced30 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f381c003520 con 0x7f38300ced30 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142846207 0 0) 0x7f381c003520 con 0x7f38300ced30 2023-11-18T23:41:21.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300b2aa0 msgr2=0x7f38300ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300b2aa0 0x7f38300ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 >> v2:172.21.15.116:3300/0 conn(0x7f3830160b70 msgr2=0x7f38300d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 --2- 172.21.15.8:0/88347922 >> v2:172.21.15.116:3300/0 conn(0x7f3830160b70 0x7f38300d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300d1c70 con 0x7f38300ced30 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f38280019f0 con 0x7f38300ced30 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 >> v1:172.21.15.8:6789/0 conn(0x7f38300ced30 legacy=0x7f38300cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f381c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.082+0000 7f382d59a640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f381c0047c0 0x7f381c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382d59a640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f381c005180 0x7f381c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300b2f20 con 0x7f381c003970 2023-11-18T23:41:21.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300cdd50 con 0x7f381c0047c0 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c00bec0 con 0x7f381c005180 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382dd9b640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300b2aa0 0x7f38300ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382e59c640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f381c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382ed9d640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f381c005180 0x7f381c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382dd9b640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f381c0047c0 0x7f381c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382e59c640 1 -- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f381c005180 msgr2=0x7f381c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382e59c640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f381c005180 0x7f381c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382e59c640 1 -- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f381c0047c0 msgr2=0x7f381c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382e59c640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f381c0047c0 0x7f381c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382e59c640 1 -- 172.21.15.8:0/88347922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c003520 con 0x7f381c003970 2023-11-18T23:41:21.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.083+0000 7f382ed9d640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f381c005180 0x7f381c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:21.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.084+0000 7f382e59c640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f381c003d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3820009af0 tx=0x7f381c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50591c375333e78f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.084+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382002c710 con 0x7f381c003970 2023-11-18T23:41:21.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.084+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382002c870 con 0x7f381c003970 2023-11-18T23:41:21.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.084+0000 7f382d59a640 1 -- 172.21.15.8:0/88347922 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382002cc00 con 0x7f381c003970 2023-11-18T23:41:21.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.084+0000 7f3834d89640 1 -- 172.21.15.8:0/88347922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 msgr2=0x7f381c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.084+0000 7f3834d89640 1 --2- 172.21.15.8:0/88347922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f381c003d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3820009af0 tx=0x7f381c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.084+0000 7f382ed9d640 1 -- 172.21.15.8:0/88347922 reap_dead start 2023-11-18T23:41:21.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.085+0000 7f3834d89640 1 -- 172.21.15.8:0/88347922 shutdown_connections 2023-11-18T23:41:21.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.085+0000 7f3834d89640 1 -- 172.21.15.8:0/88347922 >> 172.21.15.8:0/88347922 conn(0x7f383009c470 msgr2=0x7f38300d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:21.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.085+0000 7f3834d89640 1 -- 172.21.15.8:0/88347922 shutdown_connections 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.085+0000 7f3834d89640 1 -- 172.21.15.8:0/88347922 wait complete. 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.086+0000 7f3834d89640 1 Processor -- start 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.086+0000 7f3834d89640 1 -- start start 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f3834d89640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f38300c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f3834d89640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38300b6d40 0x7f383014c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f3834d89640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300c8f70 0x7f38300c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f3834d89640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300b8130 con 0x7f381c003970 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f3834d89640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38301f38c0 con 0x7f38300b6d40 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f3834d89640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383014c990 con 0x7f38300c8f70 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f38300c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f38300c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48664/0 (socket says 172.21.15.8:48664) 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 -- 172.21.15.8:0/671016374 learned_addr learned my addr 172.21.15.8:0/671016374 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382dd9b640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38300b6d40 0x7f383014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382ed9d640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300c8f70 0x7f38300c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 -- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300c8f70 msgr2=0x7f38300c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300c8f70 0x7f38300c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 -- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38300b6d40 msgr2=0x7f383014c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38300b6d40 0x7f383014c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382e59c640 1 -- 172.21.15.8:0/671016374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300b74b0 con 0x7f381c003970 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.087+0000 7f382dd9b640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38300b6d40 0x7f383014c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.088+0000 7f382e59c640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f38300c7630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3820037040 tx=0x7f3820004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.088+0000 7f3826ffd640 1 -- 172.21.15.8:0/671016374 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820003810 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.088+0000 7f3826ffd640 1 -- 172.21.15.8:0/671016374 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382002de90 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.088+0000 7f3826ffd640 1 -- 172.21.15.8:0/671016374 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820003b70 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.088+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38300b7790 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.088+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38300b7d50 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.089+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38300a1150 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.089+0000 7f3826ffd640 1 -- 172.21.15.8:0/671016374 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3820003cd0 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.090+0000 7f3826ffd640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f381006ae70 0x7f381006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.090+0000 7f3826ffd640 1 -- 172.21.15.8:0/671016374 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38200ab3d0 con 0x7f381c003970 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.090+0000 7f382dd9b640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f381006ae70 0x7f381006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.090+0000 7f382dd9b640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f381006ae70 0x7f381006d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3830160580 tx=0x7f3818008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.094+0000 7f3826ffd640 1 -- 172.21.15.8:0/671016374 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3820076510 con 0x7f381c003970 2023-11-18T23:41:21.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.130+0000 7ff139189640 1 Processor -- start 2023-11-18T23:41:21.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.130+0000 7ff139189640 1 -- start start 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff139189640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff13415d7b0 0x7ff1340cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff139189640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff1340ced50 0x7ff1340cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff139189640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1340b04d0 con 0x7ff1340d0050 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff139189640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340d04d0 con 0x7ff13415d7b0 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff139189640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340d1e40 con 0x7ff1340ced50 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff132d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff13415d7b0 0x7ff1340cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff132d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff13415d7b0 0x7ff1340cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48678/0 (socket says 172.21.15.8:48678) 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff132d9d640 1 -- 172.21.15.8:0/3654613195 learned_addr learned my addr 172.21.15.8:0/3654613195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:21.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff12bfff640 1 --1- 172.21.15.8:0/3654613195 >> v1:172.21.15.116:6789/0 conn(0x7ff1340d0050 0x7ff1340b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:44808/0 (socket says 172.21.15.8:44808) 2023-11-18T23:41:21.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff13359e640 1 --2- 172.21.15.8:0/3654613195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff1340ced50 0x7ff1340cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff13259c640 1 -- 172.21.15.8:0/3654613195 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744917512 0 0) 0x7ff1340b04d0 con 0x7ff1340d0050 2023-11-18T23:41:21.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff132d9d640 1 -- 172.21.15.8:0/3654613195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff1340ced50 msgr2=0x7ff1340cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:21.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff132d9d640 1 --2- 172.21.15.8:0/3654613195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff1340ced50 0x7ff1340cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff132d9d640 1 -- 172.21.15.8:0/3654613195 >> v1:172.21.15.116:6789/0 conn(0x7ff1340d0050 legacy=0x7ff1340b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.131+0000 7ff132d9d640 1 -- 172.21.15.8:0/3654613195 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340afe80 con 0x7ff13415d7b0 2023-11-18T23:41:21.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.132+0000 7ff132d9d640 1 --2- 172.21.15.8:0/3654613195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13415d7b0 0x7ff1340cfb10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff124009870 tx=0x7ff12402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88004d6577b3a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.132+0000 7ff13259c640 1 -- 172.21.15.8:0/3654613195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124030840 con 0x7ff13415d7b0 2023-11-18T23:41:21.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.132+0000 7ff13259c640 1 -- 172.21.15.8:0/3654613195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240309a0 con 0x7ff13415d7b0 2023-11-18T23:41:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.132+0000 7ff13259c640 1 -- 172.21.15.8:0/3654613195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124030d30 con 0x7ff13415d7b0 2023-11-18T23:41:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 -- 172.21.15.8:0/3654613195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13415d7b0 msgr2=0x7ff1340cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 --2- 172.21.15.8:0/3654613195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13415d7b0 0x7ff1340cfb10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff124009870 tx=0x7ff12402b980 comp rx=0 tx=0).stop 2023-11-18T23:41:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 -- 172.21.15.8:0/3654613195 shutdown_connections 2023-11-18T23:41:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 --2- 172.21.15.8:0/3654613195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff1340ced50 0x7ff1340cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 --2- 172.21.15.8:0/3654613195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13415d7b0 0x7ff1340cfb10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 -- 172.21.15.8:0/3654613195 >> 172.21.15.8:0/3654613195 conn(0x7ff13409c480 msgr2=0x7ff1340d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:21.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 -- 172.21.15.8:0/3654613195 shutdown_connections 2023-11-18T23:41:21.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.133+0000 7ff139189640 1 -- 172.21.15.8:0/3654613195 wait complete. 2023-11-18T23:41:21.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.134+0000 7ff139189640 1 Processor -- start 2023-11-18T23:41:21.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.134+0000 7ff139189640 1 -- start start 2023-11-18T23:41:21.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff139189640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1340ced50 0x7ff134152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff139189640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1340d0050 0x7ff1340b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff139189640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff13415d7b0 0x7ff13415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff139189640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340b6820 con 0x7ff1340ced50 2023-11-18T23:41:21.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff139189640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1341f4100 con 0x7ff1340d0050 2023-11-18T23:41:21.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff139189640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1341526d0 con 0x7ff13415d7b0 2023-11-18T23:41:21.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1340ced50 0x7ff134152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1340ced50 0x7ff134152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48682/0 (socket says 172.21.15.8:48682) 2023-11-18T23:41:21.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 -- 172.21.15.8:0/1323944385 learned_addr learned my addr 172.21.15.8:0/1323944385 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:21.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff12bfff640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1340d0050 0x7ff1340b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff13359e640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff13415d7b0 0x7ff13415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 -- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff13415d7b0 msgr2=0x7ff13415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff13415d7b0 0x7ff13415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 -- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1340d0050 msgr2=0x7ff1340b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1340d0050 0x7ff1340b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff132d9d640 1 -- 172.21.15.8:0/1323944385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240094d0 con 0x7ff1340ced50 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.135+0000 7ff13359e640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff13415d7b0 0x7ff13415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.136+0000 7ff132d9d640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1340ced50 0x7ff134152190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff124004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.136+0000 7ff12b7fe640 1 -- 172.21.15.8:0/1323944385 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12403e040 con 0x7ff1340ced50 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.136+0000 7ff12b7fe640 1 -- 172.21.15.8:0/1323944385 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124039c10 con 0x7ff1340ced50 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.136+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1340b5e80 con 0x7ff1340ced50 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.136+0000 7ff12b7fe640 1 -- 172.21.15.8:0/1323944385 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124004020 con 0x7ff1340ced50 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.136+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1340b6440 con 0x7ff1340ced50 2023-11-18T23:41:21.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.137+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1340b6960 con 0x7ff1340ced50 2023-11-18T23:41:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.137+0000 7ff12b7fe640 1 -- 172.21.15.8:0/1323944385 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff124004180 con 0x7ff1340ced50 2023-11-18T23:41:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.138+0000 7ff12b7fe640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff11406ae40 0x7ff11406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.138+0000 7ff12b7fe640 1 -- 172.21.15.8:0/1323944385 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1240ab9b0 con 0x7ff1340ced50 2023-11-18T23:41:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.138+0000 7ff12bfff640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff11406ae40 0x7ff11406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.139+0000 7ff12bfff640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff11406ae40 0x7ff11406d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff1340b91e0 tx=0x7ff11c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.143+0000 7ff12b7fe640 1 -- 172.21.15.8:0/1323944385 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1340b6960 con 0x7ff1340ced50 2023-11-18T23:41:21.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.300+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f38300b22d0 con 0x7f381c003970 2023-11-18T23:41:21.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.300+0000 7f3826ffd640 1 -- 172.21.15.8:0/671016374 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3820079b30 con 0x7f381c003970 2023-11-18T23:41:21.302 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-11-18T23:41:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f381006ae70 msgr2=0x7f381006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f381006ae70 0x7f381006d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3830160580 tx=0x7f3818008040 comp rx=0 tx=0).stop 2023-11-18T23:41:21.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 msgr2=0x7f38300c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f38300c7630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3820037040 tx=0x7f3820004730 comp rx=0 tx=0).stop 2023-11-18T23:41:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 shutdown_connections 2023-11-18T23:41:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f381006ae70 0x7f381006d330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38300c8f70 0x7f38300c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38300b6d40 0x7f383014c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 --2- 172.21.15.8:0/671016374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f381c003970 0x7f38300c7630 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 >> 172.21.15.8:0/671016374 conn(0x7f383009c470 msgr2=0x7f38300b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 shutdown_connections 2023-11-18T23:41:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.302+0000 7f3834d89640 1 -- 172.21.15.8:0/671016374 wait complete. 2023-11-18T23:41:21.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2023-11-18T23:41:21.314 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.333+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff1340a1160 con 0x7ff1340ced50 2023-11-18T23:41:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.334+0000 7ff12b7fe640 1 -- 172.21.15.8:0/1323944385 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff124076c10 con 0x7ff1340ced50 2023-11-18T23:41:21.335 INFO:teuthology.orchestra.run.smithi008.stdout:55834574856 2023-11-18T23:41:21.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff11406ae40 msgr2=0x7ff11406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff11406ae40 0x7ff11406d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff1340b91e0 tx=0x7ff11c007d50 comp rx=0 tx=0).stop 2023-11-18T23:41:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1340ced50 msgr2=0x7ff134152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1340ced50 0x7ff134152190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff124004730 comp rx=0 tx=0).stop 2023-11-18T23:41:21.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 shutdown_connections 2023-11-18T23:41:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff11406ae40 0x7ff11406d300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff13415d7b0 0x7ff13415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1340d0050 0x7ff1340b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 --2- 172.21.15.8:0/1323944385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1340ced50 0x7ff134152190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 >> 172.21.15.8:0/1323944385 conn(0x7ff13409c480 msgr2=0x7ff1340b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:21.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 shutdown_connections 2023-11-18T23:41:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.336+0000 7ff139189640 1 -- 172.21.15.8:0/1323944385 wait complete. 2023-11-18T23:41:21.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.3 2023-11-18T23:41:21.348 DEBUG:teuthology.parallel:result is None 2023-11-18T23:41:21.348 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-18T23:41:21.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:41:21.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.493+0000 7ff4ba178640 1 Processor -- start 2023-11-18T23:41:21.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.493+0000 7ff4ba178640 1 -- start start 2023-11-18T23:41:21.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4ba178640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b4099970 0x7ff4b4099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4ba178640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4b409a530 0x7ff4b40cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4ba178640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b40d0070 con 0x7ff4b40cf890 2023-11-18T23:41:21.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4ba178640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40cbb50 con 0x7ff4b409a530 2023-11-18T23:41:21.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4ba178640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b409a290 con 0x7ff4b4099970 2023-11-18T23:41:21.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b2ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4b409a530 0x7ff4b40cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b2ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4b409a530 0x7ff4b40cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48692/0 (socket says 172.21.15.8:48692) 2023-11-18T23:41:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b2ffd640 1 -- 172.21.15.8:0/1190155477 learned_addr learned my addr 172.21.15.8:0/1190155477 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b3fff640 1 --1- 172.21.15.8:0/1190155477 >> v1:172.21.15.8:6789/0 conn(0x7ff4b40cf890 0x7ff4b40b0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47790/0 (socket says 172.21.15.8:47790) 2023-11-18T23:41:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b37fe640 1 --2- 172.21.15.8:0/1190155477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b4099970 0x7ff4b4099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b2ffd640 1 -- 172.21.15.8:0/1190155477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b4099970 msgr2=0x7ff4b4099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b2ffd640 1 --2- 172.21.15.8:0/1190155477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b4099970 0x7ff4b4099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.494+0000 7ff4b2ffd640 1 -- 172.21.15.8:0/1190155477 >> v1:172.21.15.8:6789/0 conn(0x7ff4b40cf890 legacy=0x7ff4b40b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.495+0000 7ff4b2ffd640 1 -- 172.21.15.8:0/1190155477 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40cfd90 con 0x7ff4b409a530 2023-11-18T23:41:21.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.495+0000 7ff4b2ffd640 1 --2- 172.21.15.8:0/1190155477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b409a530 0x7ff4b40cc8d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009870 tx=0x7ff4a802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca44c989ab23753 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.495+0000 7ff4b27fc640 1 -- 172.21.15.8:0/1190155477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8030840 con 0x7ff4b409a530 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.495+0000 7ff4b27fc640 1 -- 172.21.15.8:0/1190155477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80309a0 con 0x7ff4b409a530 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.495+0000 7ff4b27fc640 1 -- 172.21.15.8:0/1190155477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8030d30 con 0x7ff4b409a530 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 -- 172.21.15.8:0/1190155477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b409a530 msgr2=0x7ff4b40cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1190155477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b409a530 0x7ff4b40cc8d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009870 tx=0x7ff4a802b980 comp rx=0 tx=0).stop 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 -- 172.21.15.8:0/1190155477 shutdown_connections 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1190155477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b409a530 0x7ff4b40cc8d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1190155477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b4099970 0x7ff4b4099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 -- 172.21.15.8:0/1190155477 >> 172.21.15.8:0/1190155477 conn(0x7ff4b40b2a70 msgr2=0x7ff4b40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:21.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 -- 172.21.15.8:0/1190155477 shutdown_connections 2023-11-18T23:41:21.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.496+0000 7ff4ba178640 1 -- 172.21.15.8:0/1190155477 wait complete. 2023-11-18T23:41:21.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.497+0000 7ff4ba178640 1 Processor -- start 2023-11-18T23:41:21.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.497+0000 7ff4ba178640 1 -- start start 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4ba178640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4b4099970 0x7ff4b40b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4ba178640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b409a530 0x7ff4b4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4ba178640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b40cf890 0x7ff4b415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4ba178640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c7960 con 0x7ff4b40cf890 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4ba178640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40b68b0 con 0x7ff4b4099970 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4ba178640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40b3f90 con 0x7ff4b409a530 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4b3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b40cf890 0x7ff4b415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4b3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b40cf890 0x7ff4b415a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48698/0 (socket says 172.21.15.8:48698) 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4b3fff640 1 -- 172.21.15.8:0/1943823045 learned_addr learned my addr 172.21.15.8:0/1943823045 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4b37fe640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4b4099970 0x7ff4b40b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.498+0000 7ff4b2ffd640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b409a530 0x7ff4b4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4b3fff640 1 -- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b409a530 msgr2=0x7ff4b4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4b3fff640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b409a530 0x7ff4b4157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4b3fff640 1 -- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4b4099970 msgr2=0x7ff4b40b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4b3fff640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4b4099970 0x7ff4b40b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4b3fff640 1 -- 172.21.15.8:0/1943823045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80094d0 con 0x7ff4b40cf890 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4b3fff640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b40cf890 0x7ff4b415a200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c730 tx=0x7ff4ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff49bfff640 1 -- 172.21.15.8:0/1943823045 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac004d60 con 0x7ff4b40cf890 2023-11-18T23:41:21.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff49bfff640 1 -- 172.21.15.8:0/1943823045 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00a640 con 0x7ff4b40cf890 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b40b4270 con 0x7ff4b40cf890 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff49bfff640 1 -- 172.21.15.8:0/1943823045 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00a9d0 con 0x7ff4b40cf890 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.499+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40b0890 con 0x7ff4b40cf890 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.500+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b4067420 con 0x7ff4b40cf890 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.500+0000 7ff49bfff640 1 -- 172.21.15.8:0/1943823045 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4ac00ab30 con 0x7ff4b40cf890 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.501+0000 7ff49bfff640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4a006ae40 0x7ff4a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.501+0000 7ff49bfff640 1 -- 172.21.15.8:0/1943823045 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ac088a80 con 0x7ff4b40cf890 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.501+0000 7ff4b37fe640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4a006ae40 0x7ff4a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.501+0000 7ff4b37fe640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4a006ae40 0x7ff4a006d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4b406df20 tx=0x7ff4a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.505+0000 7ff49bfff640 1 -- 172.21.15.8:0/1943823045 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4ac053b30 con 0x7ff4b40cf890 2023-11-18T23:41:21.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.678+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4b40cc3b0 con 0x7ff4a006ae40 2023-11-18T23:41:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.685+0000 7ff49bfff640 1 -- 172.21.15.8:0/1943823045 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264561 (secure 0 0 0) 0x7ff4a40119a0 con 0x7ff4a006ae40 2023-11-18T23:41:21.689 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:41:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4a006ae40 msgr2=0x7ff4a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4a006ae40 0x7ff4a006d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4b406df20 tx=0x7ff4a4008040 comp rx=0 tx=0).stop 2023-11-18T23:41:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b40cf890 msgr2=0x7ff4b415a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b40cf890 0x7ff4b415a200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c730 tx=0x7ff4ac00cbf0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 shutdown_connections 2023-11-18T23:41:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4a006ae40 0x7ff4a006d300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4b40cf890 0x7ff4b415a200 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4b409a530 0x7ff4b4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 --2- 172.21.15.8:0/1943823045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4b4099970 0x7ff4b40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.688+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 >> 172.21.15.8:0/1943823045 conn(0x7ff4b40b2a70 msgr2=0x7ff4b406fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.689+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 shutdown_connections 2023-11-18T23:41:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.689+0000 7ff4ba178640 1 -- 172.21.15.8:0/1943823045 wait complete. 2023-11-18T23:41:21.700 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-18T23:41:21.245446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235656,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739064,"statfs":{"total":773094113280,"available":772852801536,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.321634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171816+0000","last_change":"2023-11-18T23:41:11.946811+0000","last_active":"2023-11-18T23:41:13.171816+0000","last_peered":"2023-11-18T23:41:13.171816+0000","last_clean":"2023-11-18T23:41:13.171816+0000","last_became_active":"2023-11-18T23:41:11.946364+0000","last_became_peered":"2023-11-18T23:41:11.946364+0000","last_unstale":"2023-11-18T23:41:13.171816+0000","last_undegraded":"2023-11-18T23:41:13.171816+0000","last_fullsized":"2023-11-18T23:41:13.171816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:01:13.637927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.704009+0000","last_change":"2023-11-18T23:41:11.940115+0000","last_active":"2023-11-18T23:41:13.704009+0000","last_peered":"2023-11-18T23:41:13.704009+0000","last_clean":"2023-11-18T23:41:13.704009+0000","last_became_active":"2023-11-18T23:41:11.939851+0000","last_became_peered":"2023-11-18T23:41:11.939851+0000","last_unstale":"2023-11-18T23:41:13.704009+0000","last_undegraded":"2023-11-18T23:41:13.704009+0000","last_fullsized":"2023-11-18T23:41:13.704009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924769+0000","last_change":"2023-11-18T23:41:11.933794+0000","last_active":"2023-11-18T23:41:12.924769+0000","last_peered":"2023-11-18T23:41:12.924769+0000","last_clean":"2023-11-18T23:41:12.924769+0000","last_became_active":"2023-11-18T23:41:11.931711+0000","last_became_peered":"2023-11-18T23:41:11.931711+0000","last_unstale":"2023-11-18T23:41:12.924769+0000","last_undegraded":"2023-11-18T23:41:12.924769+0000","last_fullsized":"2023-11-18T23:41:12.924769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926073+0000","last_change":"2023-11-18T23:41:11.941706+0000","last_active":"2023-11-18T23:41:12.926073+0000","last_peered":"2023-11-18T23:41:12.926073+0000","last_clean":"2023-11-18T23:41:12.926073+0000","last_became_active":"2023-11-18T23:41:11.941441+0000","last_became_peered":"2023-11-18T23:41:11.941441+0000","last_unstale":"2023-11-18T23:41:12.926073+0000","last_undegraded":"2023-11-18T23:41:12.926073+0000","last_fullsized":"2023-11-18T23:41:12.926073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171510+0000","last_change":"2023-11-18T23:41:11.940717+0000","last_active":"2023-11-18T23:41:13.171510+0000","last_peered":"2023-11-18T23:41:13.171510+0000","last_clean":"2023-11-18T23:41:13.171510+0000","last_became_active":"2023-11-18T23:41:11.939288+0000","last_became_peered":"2023-11-18T23:41:11.939288+0000","last_unstale":"2023-11-18T23:41:13.171510+0000","last_undegraded":"2023-11-18T23:41:13.171510+0000","last_fullsized":"2023-11-18T23:41:13.171510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925518+0000","last_change":"2023-11-18T23:41:11.938211+0000","last_active":"2023-11-18T23:41:12.925518+0000","last_peered":"2023-11-18T23:41:12.925518+0000","last_clean":"2023-11-18T23:41:12.925518+0000","last_became_active":"2023-11-18T23:41:11.937953+0000","last_became_peered":"2023-11-18T23:41:11.937953+0000","last_unstale":"2023-11-18T23:41:12.925518+0000","last_undegraded":"2023-11-18T23:41:12.925518+0000","last_fullsized":"2023-11-18T23:41:12.925518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171265+0000","last_change":"2023-11-18T23:41:11.943648+0000","last_active":"2023-11-18T23:41:13.171265+0000","last_peered":"2023-11-18T23:41:13.171265+0000","last_clean":"2023-11-18T23:41:13.171265+0000","last_became_active":"2023-11-18T23:41:11.943321+0000","last_became_peered":"2023-11-18T23:41:11.943321+0000","last_unstale":"2023-11-18T23:41:13.171265+0000","last_undegraded":"2023-11-18T23:41:13.171265+0000","last_fullsized":"2023-11-18T23:41:13.171265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925699+0000","last_change":"2023-11-18T23:41:11.944907+0000","last_active":"2023-11-18T23:41:12.925699+0000","last_peered":"2023-11-18T23:41:12.925699+0000","last_clean":"2023-11-18T23:41:12.925699+0000","last_became_active":"2023-11-18T23:41:11.944546+0000","last_became_peered":"2023-11-18T23:41:11.944546+0000","last_unstale":"2023-11-18T23:41:12.925699+0000","last_undegraded":"2023-11-18T23:41:12.925699+0000","last_fullsized":"2023-11-18T23:41:12.925699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171795+0000","last_change":"2023-11-18T23:41:11.945133+0000","last_active":"2023-11-18T23:41:13.171795+0000","last_peered":"2023-11-18T23:41:13.171795+0000","last_clean":"2023-11-18T23:41:13.171795+0000","last_became_active":"2023-11-18T23:41:11.944763+0000","last_became_peered":"2023-11-18T23:41:11.944763+0000","last_unstale":"2023-11-18T23:41:13.171795+0000","last_undegraded":"2023-11-18T23:41:13.171795+0000","last_fullsized":"2023-11-18T23:41:13.171795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:21.419360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703838+0000","last_change":"2023-11-18T23:41:11.945314+0000","last_active":"2023-11-18T23:41:13.703838+0000","last_peered":"2023-11-18T23:41:13.703838+0000","last_clean":"2023-11-18T23:41:13.703838+0000","last_became_active":"2023-11-18T23:41:11.945040+0000","last_became_peered":"2023-11-18T23:41:11.945040+0000","last_unstale":"2023-11-18T23:41:13.703838+0000","last_undegraded":"2023-11-18T23:41:13.703838+0000","last_fullsized":"2023-11-18T23:41:13.703838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703356+0000","last_change":"2023-11-18T23:41:11.939307+0000","last_active":"2023-11-18T23:41:13.703356+0000","last_peered":"2023-11-18T23:41:13.703356+0000","last_clean":"2023-11-18T23:41:13.703356+0000","last_became_active":"2023-11-18T23:41:11.939039+0000","last_became_peered":"2023-11-18T23:41:11.939039+0000","last_unstale":"2023-11-18T23:41:13.703356+0000","last_undegraded":"2023-11-18T23:41:13.703356+0000","last_fullsized":"2023-11-18T23:41:13.703356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703924+0000","last_change":"2023-11-18T23:41:11.940131+0000","last_active":"2023-11-18T23:41:13.703924+0000","last_peered":"2023-11-18T23:41:13.703924+0000","last_clean":"2023-11-18T23:41:13.703924+0000","last_became_active":"2023-11-18T23:41:11.939870+0000","last_became_peered":"2023-11-18T23:41:11.939870+0000","last_unstale":"2023-11-18T23:41:13.703924+0000","last_undegraded":"2023-11-18T23:41:13.703924+0000","last_fullsized":"2023-11-18T23:41:13.703924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:21.079188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925790+0000","last_change":"2023-11-18T23:41:11.940144+0000","last_active":"2023-11-18T23:41:12.925790+0000","last_peered":"2023-11-18T23:41:12.925790+0000","last_clean":"2023-11-18T23:41:12.925790+0000","last_became_active":"2023-11-18T23:41:11.939856+0000","last_became_peered":"2023-11-18T23:41:11.939856+0000","last_unstale":"2023-11-18T23:41:12.925790+0000","last_undegraded":"2023-11-18T23:41:12.925790+0000","last_fullsized":"2023-11-18T23:41:12.925790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924731+0000","last_change":"2023-11-18T23:41:11.934160+0000","last_active":"2023-11-18T23:41:12.924731+0000","last_peered":"2023-11-18T23:41:12.924731+0000","last_clean":"2023-11-18T23:41:12.924731+0000","last_became_active":"2023-11-18T23:41:11.933765+0000","last_became_peered":"2023-11-18T23:41:11.933765+0000","last_unstale":"2023-11-18T23:41:12.924731+0000","last_undegraded":"2023-11-18T23:41:12.924731+0000","last_fullsized":"2023-11-18T23:41:12.924731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:13.836738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703763+0000","last_change":"2023-11-18T23:41:11.936206+0000","last_active":"2023-11-18T23:41:13.703763+0000","last_peered":"2023-11-18T23:41:13.703763+0000","last_clean":"2023-11-18T23:41:13.703763+0000","last_became_active":"2023-11-18T23:41:11.935928+0000","last_became_peered":"2023-11-18T23:41:11.935928+0000","last_unstale":"2023-11-18T23:41:13.703763+0000","last_undegraded":"2023-11-18T23:41:13.703763+0000","last_fullsized":"2023-11-18T23:41:13.703763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925537+0000","last_change":"2023-11-18T23:41:11.933938+0000","last_active":"2023-11-18T23:41:12.925537+0000","last_peered":"2023-11-18T23:41:12.925537+0000","last_clean":"2023-11-18T23:41:12.925537+0000","last_became_active":"2023-11-18T23:41:11.933650+0000","last_became_peered":"2023-11-18T23:41:11.933650+0000","last_unstale":"2023-11-18T23:41:12.925537+0000","last_undegraded":"2023-11-18T23:41:12.925537+0000","last_fullsized":"2023-11-18T23:41:12.925537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926339+0000","last_change":"2023-11-18T23:41:11.939059+0000","last_active":"2023-11-18T23:41:12.926339+0000","last_peered":"2023-11-18T23:41:12.926339+0000","last_clean":"2023-11-18T23:41:12.926339+0000","last_became_active":"2023-11-18T23:41:11.938794+0000","last_became_peered":"2023-11-18T23:41:11.938794+0000","last_unstale":"2023-11-18T23:41:12.926339+0000","last_undegraded":"2023-11-18T23:41:12.926339+0000","last_fullsized":"2023-11-18T23:41:12.926339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703449+0000","last_change":"2023-11-18T23:41:11.940827+0000","last_active":"2023-11-18T23:41:13.703449+0000","last_peered":"2023-11-18T23:41:13.703449+0000","last_clean":"2023-11-18T23:41:13.703449+0000","last_became_active":"2023-11-18T23:41:11.940536+0000","last_became_peered":"2023-11-18T23:41:11.940536+0000","last_unstale":"2023-11-18T23:41:13.703449+0000","last_undegraded":"2023-11-18T23:41:13.703449+0000","last_fullsized":"2023-11-18T23:41:13.703449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171737+0000","last_change":"2023-11-18T23:41:11.940969+0000","last_active":"2023-11-18T23:41:13.171737+0000","last_peered":"2023-11-18T23:41:13.171737+0000","last_clean":"2023-11-18T23:41:13.171737+0000","last_became_active":"2023-11-18T23:41:11.940183+0000","last_became_peered":"2023-11-18T23:41:11.940183+0000","last_unstale":"2023-11-18T23:41:13.171737+0000","last_undegraded":"2023-11-18T23:41:13.171737+0000","last_fullsized":"2023-11-18T23:41:13.171737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703512+0000","last_change":"2023-11-18T23:41:11.941178+0000","last_active":"2023-11-18T23:41:13.703512+0000","last_peered":"2023-11-18T23:41:13.703512+0000","last_clean":"2023-11-18T23:41:13.703512+0000","last_became_active":"2023-11-18T23:41:11.940898+0000","last_became_peered":"2023-11-18T23:41:11.940898+0000","last_unstale":"2023-11-18T23:41:13.703512+0000","last_undegraded":"2023-11-18T23:41:13.703512+0000","last_fullsized":"2023-11-18T23:41:13.703512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924966+0000","last_change":"2023-11-18T23:41:11.942903+0000","last_active":"2023-11-18T23:41:12.924966+0000","last_peered":"2023-11-18T23:41:12.924966+0000","last_clean":"2023-11-18T23:41:12.924966+0000","last_became_active":"2023-11-18T23:41:11.942534+0000","last_became_peered":"2023-11-18T23:41:11.942534+0000","last_unstale":"2023-11-18T23:41:12.924966+0000","last_undegraded":"2023-11-18T23:41:12.924966+0000","last_fullsized":"2023-11-18T23:41:12.924966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925720+0000","last_change":"2023-11-18T23:41:11.944563+0000","last_active":"2023-11-18T23:41:12.925720+0000","last_peered":"2023-11-18T23:41:12.925720+0000","last_clean":"2023-11-18T23:41:12.925720+0000","last_became_active":"2023-11-18T23:41:11.943198+0000","last_became_peered":"2023-11-18T23:41:11.943198+0000","last_unstale":"2023-11-18T23:41:12.925720+0000","last_undegraded":"2023-11-18T23:41:12.925720+0000","last_fullsized":"2023-11-18T23:41:12.925720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926277+0000","last_change":"2023-11-18T23:41:11.934900+0000","last_active":"2023-11-18T23:41:12.926277+0000","last_peered":"2023-11-18T23:41:12.926277+0000","last_clean":"2023-11-18T23:41:12.926277+0000","last_became_active":"2023-11-18T23:41:11.934615+0000","last_became_peered":"2023-11-18T23:41:11.934615+0000","last_unstale":"2023-11-18T23:41:12.926277+0000","last_undegraded":"2023-11-18T23:41:12.926277+0000","last_fullsized":"2023-11-18T23:41:12.926277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925552+0000","last_change":"2023-11-18T23:41:11.940124+0000","last_active":"2023-11-18T23:41:12.925552+0000","last_peered":"2023-11-18T23:41:12.925552+0000","last_clean":"2023-11-18T23:41:12.925552+0000","last_became_active":"2023-11-18T23:41:11.939772+0000","last_became_peered":"2023-11-18T23:41:11.939772+0000","last_unstale":"2023-11-18T23:41:12.925552+0000","last_undegraded":"2023-11-18T23:41:12.925552+0000","last_fullsized":"2023-11-18T23:41:12.925552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925849+0000","last_change":"2023-11-18T23:41:11.935614+0000","last_active":"2023-11-18T23:41:12.925849+0000","last_peered":"2023-11-18T23:41:12.925849+0000","last_clean":"2023-11-18T23:41:12.925849+0000","last_became_active":"2023-11-18T23:41:11.935359+0000","last_became_peered":"2023-11-18T23:41:11.935359+0000","last_unstale":"2023-11-18T23:41:12.925849+0000","last_undegraded":"2023-11-18T23:41:12.925849+0000","last_fullsized":"2023-11-18T23:41:12.925849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703584+0000","last_change":"2023-11-18T23:41:11.942859+0000","last_active":"2023-11-18T23:41:13.703584+0000","last_peered":"2023-11-18T23:41:13.703584+0000","last_clean":"2023-11-18T23:41:13.703584+0000","last_became_active":"2023-11-18T23:41:11.940443+0000","last_became_peered":"2023-11-18T23:41:11.940443+0000","last_unstale":"2023-11-18T23:41:13.703584+0000","last_undegraded":"2023-11-18T23:41:13.703584+0000","last_fullsized":"2023-11-18T23:41:13.703584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703890+0000","last_change":"2023-11-18T23:41:11.939763+0000","last_active":"2023-11-18T23:41:13.703890+0000","last_peered":"2023-11-18T23:41:13.703890+0000","last_clean":"2023-11-18T23:41:13.703890+0000","last_became_active":"2023-11-18T23:41:11.939467+0000","last_became_peered":"2023-11-18T23:41:11.939467+0000","last_unstale":"2023-11-18T23:41:13.703890+0000","last_undegraded":"2023-11-18T23:41:13.703890+0000","last_fullsized":"2023-11-18T23:41:13.703890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926083+0000","last_change":"2023-11-18T23:41:11.938804+0000","last_active":"2023-11-18T23:41:12.926083+0000","last_peered":"2023-11-18T23:41:12.926083+0000","last_clean":"2023-11-18T23:41:12.926083+0000","last_became_active":"2023-11-18T23:41:11.938399+0000","last_became_peered":"2023-11-18T23:41:11.938399+0000","last_unstale":"2023-11-18T23:41:12.926083+0000","last_undegraded":"2023-11-18T23:41:12.926083+0000","last_fullsized":"2023-11-18T23:41:12.926083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924943+0000","last_change":"2023-11-18T23:41:11.938618+0000","last_active":"2023-11-18T23:41:12.924943+0000","last_peered":"2023-11-18T23:41:12.924943+0000","last_clean":"2023-11-18T23:41:12.924943+0000","last_became_active":"2023-11-18T23:41:11.938221+0000","last_became_peered":"2023-11-18T23:41:11.938221+0000","last_unstale":"2023-11-18T23:41:12.924943+0000","last_undegraded":"2023-11-18T23:41:12.924943+0000","last_fullsized":"2023-11-18T23:41:12.924943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925751+0000","last_change":"2023-11-18T23:41:11.939803+0000","last_active":"2023-11-18T23:41:12.925751+0000","last_peered":"2023-11-18T23:41:12.925751+0000","last_clean":"2023-11-18T23:41:12.925751+0000","last_became_active":"2023-11-18T23:41:11.939543+0000","last_became_peered":"2023-11-18T23:41:11.939543+0000","last_unstale":"2023-11-18T23:41:12.925751+0000","last_undegraded":"2023-11-18T23:41:12.925751+0000","last_fullsized":"2023-11-18T23:41:12.925751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703400+0000","last_change":"2023-11-18T23:41:11.933138+0000","last_active":"2023-11-18T23:41:13.703400+0000","last_peered":"2023-11-18T23:41:13.703400+0000","last_clean":"2023-11-18T23:41:13.703400+0000","last_became_active":"2023-11-18T23:41:11.932851+0000","last_became_peered":"2023-11-18T23:41:11.932851+0000","last_unstale":"2023-11-18T23:41:13.703400+0000","last_undegraded":"2023-11-18T23:41:13.703400+0000","last_fullsized":"2023-11-18T23:41:13.703400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:21.079188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703103+0000","last_change":"2023-11-18T23:41:11.945502+0000","last_active":"2023-11-18T23:41:13.703103+0000","last_peered":"2023-11-18T23:41:13.703103+0000","last_clean":"2023-11-18T23:41:13.703103+0000","last_became_active":"2023-11-18T23:41:11.944702+0000","last_became_peered":"2023-11-18T23:41:11.944702+0000","last_unstale":"2023-11-18T23:41:13.703103+0000","last_undegraded":"2023-11-18T23:41:13.703103+0000","last_fullsized":"2023-11-18T23:41:13.703103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703354+0000","last_change":"2023-11-18T23:41:11.935750+0000","last_active":"2023-11-18T23:41:13.703354+0000","last_peered":"2023-11-18T23:41:13.703354+0000","last_clean":"2023-11-18T23:41:13.703354+0000","last_became_active":"2023-11-18T23:41:11.935328+0000","last_became_peered":"2023-11-18T23:41:11.935328+0000","last_unstale":"2023-11-18T23:41:13.703354+0000","last_undegraded":"2023-11-18T23:41:13.703354+0000","last_fullsized":"2023-11-18T23:41:13.703354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925897+0000","last_change":"2023-11-18T23:41:10.953149+0000","last_active":"2023-11-18T23:41:12.925897+0000","last_peered":"2023-11-18T23:41:12.925897+0000","last_clean":"2023-11-18T23:41:12.925897+0000","last_became_active":"2023-11-18T23:41:10.952850+0000","last_became_peered":"2023-11-18T23:41:10.952850+0000","last_unstale":"2023-11-18T23:41:12.925897+0000","last_undegraded":"2023-11-18T23:41:12.925897+0000","last_fullsized":"2023-11-18T23:41:12.925897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925028+0000","last_change":"2023-11-18T23:41:11.932987+0000","last_active":"2023-11-18T23:41:12.925028+0000","last_peered":"2023-11-18T23:41:12.925028+0000","last_clean":"2023-11-18T23:41:12.925028+0000","last_became_active":"2023-11-18T23:41:11.932403+0000","last_became_peered":"2023-11-18T23:41:11.932403+0000","last_unstale":"2023-11-18T23:41:12.925028+0000","last_undegraded":"2023-11-18T23:41:12.925028+0000","last_fullsized":"2023-11-18T23:41:12.925028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255807+0000","last_change":"2023-11-18T23:41:10.949837+0000","last_active":"2023-11-18T23:41:13.255807+0000","last_peered":"2023-11-18T23:41:13.255807+0000","last_clean":"2023-11-18T23:41:13.255807+0000","last_became_active":"2023-11-18T23:41:10.949583+0000","last_became_peered":"2023-11-18T23:41:10.949583+0000","last_unstale":"2023-11-18T23:41:13.255807+0000","last_undegraded":"2023-11-18T23:41:13.255807+0000","last_fullsized":"2023-11-18T23:41:13.255807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:20.074426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926272+0000","last_change":"2023-11-18T23:41:10.948701+0000","last_active":"2023-11-18T23:41:12.926272+0000","last_peered":"2023-11-18T23:41:12.926272+0000","last_clean":"2023-11-18T23:41:12.926272+0000","last_became_active":"2023-11-18T23:41:10.947786+0000","last_became_peered":"2023-11-18T23:41:10.947786+0000","last_unstale":"2023-11-18T23:41:12.926272+0000","last_undegraded":"2023-11-18T23:41:12.926272+0000","last_fullsized":"2023-11-18T23:41:12.926272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925862+0000","last_change":"2023-11-18T23:41:11.935863+0000","last_active":"2023-11-18T23:41:12.925862+0000","last_peered":"2023-11-18T23:41:12.925862+0000","last_clean":"2023-11-18T23:41:12.925862+0000","last_became_active":"2023-11-18T23:41:11.935550+0000","last_became_peered":"2023-11-18T23:41:11.935550+0000","last_unstale":"2023-11-18T23:41:12.925862+0000","last_undegraded":"2023-11-18T23:41:12.925862+0000","last_fullsized":"2023-11-18T23:41:12.925862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925638+0000","last_change":"2023-11-18T23:41:10.944934+0000","last_active":"2023-11-18T23:41:12.925638+0000","last_peered":"2023-11-18T23:41:12.925638+0000","last_clean":"2023-11-18T23:41:12.925638+0000","last_became_active":"2023-11-18T23:41:10.944648+0000","last_became_peered":"2023-11-18T23:41:10.944648+0000","last_unstale":"2023-11-18T23:41:12.925638+0000","last_undegraded":"2023-11-18T23:41:12.925638+0000","last_fullsized":"2023-11-18T23:41:12.925638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703687+0000","last_change":"2023-11-18T23:41:11.937179+0000","last_active":"2023-11-18T23:41:13.703687+0000","last_peered":"2023-11-18T23:41:13.703687+0000","last_clean":"2023-11-18T23:41:13.703687+0000","last_became_active":"2023-11-18T23:41:11.936855+0000","last_became_peered":"2023-11-18T23:41:11.936855+0000","last_unstale":"2023-11-18T23:41:13.703687+0000","last_undegraded":"2023-11-18T23:41:13.703687+0000","last_fullsized":"2023-11-18T23:41:13.703687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255897+0000","last_change":"2023-11-18T23:41:10.954127+0000","last_active":"2023-11-18T23:41:13.255897+0000","last_peered":"2023-11-18T23:41:13.255897+0000","last_clean":"2023-11-18T23:41:13.255897+0000","last_became_active":"2023-11-18T23:41:10.953785+0000","last_became_peered":"2023-11-18T23:41:10.953785+0000","last_unstale":"2023-11-18T23:41:13.255897+0000","last_undegraded":"2023-11-18T23:41:13.255897+0000","last_fullsized":"2023-11-18T23:41:13.255897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926194+0000","last_change":"2023-11-18T23:41:11.944161+0000","last_active":"2023-11-18T23:41:12.926194+0000","last_peered":"2023-11-18T23:41:12.926194+0000","last_clean":"2023-11-18T23:41:12.926194+0000","last_became_active":"2023-11-18T23:41:11.943897+0000","last_became_peered":"2023-11-18T23:41:11.943897+0000","last_unstale":"2023-11-18T23:41:12.926194+0000","last_undegraded":"2023-11-18T23:41:12.926194+0000","last_fullsized":"2023-11-18T23:41:12.926194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926026+0000","last_change":"2023-11-18T23:41:10.949653+0000","last_active":"2023-11-18T23:41:12.926026+0000","last_peered":"2023-11-18T23:41:12.926026+0000","last_clean":"2023-11-18T23:41:12.926026+0000","last_became_active":"2023-11-18T23:41:10.949342+0000","last_became_peered":"2023-11-18T23:41:10.949342+0000","last_unstale":"2023-11-18T23:41:12.926026+0000","last_undegraded":"2023-11-18T23:41:12.926026+0000","last_fullsized":"2023-11-18T23:41:12.926026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:11.932620+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:11.932076+0000","last_became_peered":"2023-11-18T23:41:11.932076+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259524+0000","last_change":"2023-11-18T23:41:10.944409+0000","last_active":"2023-11-18T23:41:13.259524+0000","last_peered":"2023-11-18T23:41:13.259524+0000","last_clean":"2023-11-18T23:41:13.259524+0000","last_became_active":"2023-11-18T23:41:10.944114+0000","last_became_peered":"2023-11-18T23:41:10.944114+0000","last_unstale":"2023-11-18T23:41:13.259524+0000","last_undegraded":"2023-11-18T23:41:13.259524+0000","last_fullsized":"2023-11-18T23:41:13.259524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.704000+0000","last_change":"2023-11-18T23:41:11.943003+0000","last_active":"2023-11-18T23:41:13.704000+0000","last_peered":"2023-11-18T23:41:13.704000+0000","last_clean":"2023-11-18T23:41:13.704000+0000","last_became_active":"2023-11-18T23:41:11.942700+0000","last_became_peered":"2023-11-18T23:41:11.942700+0000","last_unstale":"2023-11-18T23:41:13.704000+0000","last_undegraded":"2023-11-18T23:41:13.704000+0000","last_fullsized":"2023-11-18T23:41:13.704000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255855+0000","last_change":"2023-11-18T23:41:10.949432+0000","last_active":"2023-11-18T23:41:13.255855+0000","last_peered":"2023-11-18T23:41:13.255855+0000","last_clean":"2023-11-18T23:41:13.255855+0000","last_became_active":"2023-11-18T23:41:10.949070+0000","last_became_peered":"2023-11-18T23:41:10.949070+0000","last_unstale":"2023-11-18T23:41:13.255855+0000","last_undegraded":"2023-11-18T23:41:13.255855+0000","last_fullsized":"2023-11-18T23:41:13.255855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171506+0000","last_change":"2023-11-18T23:41:11.944440+0000","last_active":"2023-11-18T23:41:13.171506+0000","last_peered":"2023-11-18T23:41:13.171506+0000","last_clean":"2023-11-18T23:41:13.171506+0000","last_became_active":"2023-11-18T23:41:11.944144+0000","last_became_peered":"2023-11-18T23:41:11.944144+0000","last_unstale":"2023-11-18T23:41:13.171506+0000","last_undegraded":"2023-11-18T23:41:13.171506+0000","last_fullsized":"2023-11-18T23:41:13.171506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925055+0000","last_change":"2023-11-18T23:41:10.953937+0000","last_active":"2023-11-18T23:41:12.925055+0000","last_peered":"2023-11-18T23:41:12.925055+0000","last_clean":"2023-11-18T23:41:12.925055+0000","last_became_active":"2023-11-18T23:41:10.953500+0000","last_became_peered":"2023-11-18T23:41:10.953500+0000","last_unstale":"2023-11-18T23:41:12.925055+0000","last_undegraded":"2023-11-18T23:41:12.925055+0000","last_fullsized":"2023-11-18T23:41:12.925055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924751+0000","last_change":"2023-11-18T23:41:11.941920+0000","last_active":"2023-11-18T23:41:12.924751+0000","last_peered":"2023-11-18T23:41:12.924751+0000","last_clean":"2023-11-18T23:41:12.924751+0000","last_became_active":"2023-11-18T23:41:11.941599+0000","last_became_peered":"2023-11-18T23:41:11.941599+0000","last_unstale":"2023-11-18T23:41:12.924751+0000","last_undegraded":"2023-11-18T23:41:12.924751+0000","last_fullsized":"2023-11-18T23:41:12.924751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:46.123581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925846+0000","last_change":"2023-11-18T23:41:10.948691+0000","last_active":"2023-11-18T23:41:12.925846+0000","last_peered":"2023-11-18T23:41:12.925846+0000","last_clean":"2023-11-18T23:41:12.925846+0000","last_became_active":"2023-11-18T23:41:10.948397+0000","last_became_peered":"2023-11-18T23:41:10.948397+0000","last_unstale":"2023-11-18T23:41:12.925846+0000","last_undegraded":"2023-11-18T23:41:12.925846+0000","last_fullsized":"2023-11-18T23:41:12.925846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:06.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171508+0000","last_change":"2023-11-18T23:41:11.942006+0000","last_active":"2023-11-18T23:41:13.171508+0000","last_peered":"2023-11-18T23:41:13.171508+0000","last_clean":"2023-11-18T23:41:13.171508+0000","last_became_active":"2023-11-18T23:41:11.941752+0000","last_became_peered":"2023-11-18T23:41:11.941752+0000","last_unstale":"2023-11-18T23:41:13.171508+0000","last_undegraded":"2023-11-18T23:41:13.171508+0000","last_fullsized":"2023-11-18T23:41:13.171508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255767+0000","last_change":"2023-11-18T23:41:10.948626+0000","last_active":"2023-11-18T23:41:13.255767+0000","last_peered":"2023-11-18T23:41:13.255767+0000","last_clean":"2023-11-18T23:41:13.255767+0000","last_became_active":"2023-11-18T23:41:10.948356+0000","last_became_peered":"2023-11-18T23:41:10.948356+0000","last_unstale":"2023-11-18T23:41:13.255767+0000","last_undegraded":"2023-11-18T23:41:13.255767+0000","last_fullsized":"2023-11-18T23:41:13.255767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703110+0000","last_change":"2023-11-18T23:41:11.945196+0000","last_active":"2023-11-18T23:41:13.703110+0000","last_peered":"2023-11-18T23:41:13.703110+0000","last_clean":"2023-11-18T23:41:13.703110+0000","last_became_active":"2023-11-18T23:41:11.944330+0000","last_became_peered":"2023-11-18T23:41:11.944330+0000","last_unstale":"2023-11-18T23:41:13.703110+0000","last_undegraded":"2023-11-18T23:41:13.703110+0000","last_fullsized":"2023-11-18T23:41:13.703110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.261983+0000","last_change":"2023-11-18T23:41:10.949827+0000","last_active":"2023-11-18T23:41:13.261983+0000","last_peered":"2023-11-18T23:41:13.261983+0000","last_clean":"2023-11-18T23:41:13.261983+0000","last_became_active":"2023-11-18T23:41:10.949513+0000","last_became_peered":"2023-11-18T23:41:10.949513+0000","last_unstale":"2023-11-18T23:41:13.261983+0000","last_undegraded":"2023-11-18T23:41:13.261983+0000","last_fullsized":"2023-11-18T23:41:13.261983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:08.933359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171323+0000","last_change":"2023-11-18T23:41:11.942116+0000","last_active":"2023-11-18T23:41:13.171323+0000","last_peered":"2023-11-18T23:41:13.171323+0000","last_clean":"2023-11-18T23:41:13.171323+0000","last_became_active":"2023-11-18T23:41:11.940777+0000","last_became_peered":"2023-11-18T23:41:11.940777+0000","last_unstale":"2023-11-18T23:41:13.171323+0000","last_undegraded":"2023-11-18T23:41:13.171323+0000","last_fullsized":"2023-11-18T23:41:13.171323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.256384+0000","last_change":"2023-11-18T23:41:10.952130+0000","last_active":"2023-11-18T23:41:13.256384+0000","last_peered":"2023-11-18T23:41:13.256384+0000","last_clean":"2023-11-18T23:41:13.256384+0000","last_became_active":"2023-11-18T23:41:10.951783+0000","last_became_peered":"2023-11-18T23:41:10.951783+0000","last_unstale":"2023-11-18T23:41:13.256384+0000","last_undegraded":"2023-11-18T23:41:13.256384+0000","last_fullsized":"2023-11-18T23:41:13.256384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171739+0000","last_change":"2023-11-18T23:41:11.941524+0000","last_active":"2023-11-18T23:41:13.171739+0000","last_peered":"2023-11-18T23:41:13.171739+0000","last_clean":"2023-11-18T23:41:13.171739+0000","last_became_active":"2023-11-18T23:41:11.941261+0000","last_became_peered":"2023-11-18T23:41:11.941261+0000","last_unstale":"2023-11-18T23:41:13.171739+0000","last_undegraded":"2023-11-18T23:41:13.171739+0000","last_fullsized":"2023-11-18T23:41:13.171739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.262082+0000","last_change":"2023-11-18T23:41:10.948977+0000","last_active":"2023-11-18T23:41:13.262082+0000","last_peered":"2023-11-18T23:41:13.262082+0000","last_clean":"2023-11-18T23:41:13.262082+0000","last_became_active":"2023-11-18T23:41:10.948618+0000","last_became_peered":"2023-11-18T23:41:10.948618+0000","last_unstale":"2023-11-18T23:41:13.262082+0000","last_undegraded":"2023-11-18T23:41:13.262082+0000","last_fullsized":"2023-11-18T23:41:13.262082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:05.668218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171873+0000","last_change":"2023-11-18T23:41:11.945585+0000","last_active":"2023-11-18T23:41:13.171873+0000","last_peered":"2023-11-18T23:41:13.171873+0000","last_clean":"2023-11-18T23:41:13.171873+0000","last_became_active":"2023-11-18T23:41:11.945267+0000","last_became_peered":"2023-11-18T23:41:11.945267+0000","last_unstale":"2023-11-18T23:41:13.171873+0000","last_undegraded":"2023-11-18T23:41:13.171873+0000","last_fullsized":"2023-11-18T23:41:13.171873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:32.618829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259535+0000","last_change":"2023-11-18T23:41:10.948326+0000","last_active":"2023-11-18T23:41:13.259535+0000","last_peered":"2023-11-18T23:41:13.259535+0000","last_clean":"2023-11-18T23:41:13.259535+0000","last_became_active":"2023-11-18T23:41:10.947924+0000","last_became_peered":"2023-11-18T23:41:10.947924+0000","last_unstale":"2023-11-18T23:41:13.259535+0000","last_undegraded":"2023-11-18T23:41:13.259535+0000","last_fullsized":"2023-11-18T23:41:13.259535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926090+0000","last_change":"2023-11-18T23:41:11.941133+0000","last_active":"2023-11-18T23:41:12.926090+0000","last_peered":"2023-11-18T23:41:12.926090+0000","last_clean":"2023-11-18T23:41:12.926090+0000","last_became_active":"2023-11-18T23:41:11.940871+0000","last_became_peered":"2023-11-18T23:41:11.940871+0000","last_unstale":"2023-11-18T23:41:12.926090+0000","last_undegraded":"2023-11-18T23:41:12.926090+0000","last_fullsized":"2023-11-18T23:41:12.926090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.262045+0000","last_change":"2023-11-18T23:41:10.951625+0000","last_active":"2023-11-18T23:41:13.262045+0000","last_peered":"2023-11-18T23:41:13.262045+0000","last_clean":"2023-11-18T23:41:13.262045+0000","last_became_active":"2023-11-18T23:41:10.951341+0000","last_became_peered":"2023-11-18T23:41:10.951341+0000","last_unstale":"2023-11-18T23:41:13.262045+0000","last_undegraded":"2023-11-18T23:41:13.262045+0000","last_fullsized":"2023-11-18T23:41:13.262045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171564+0000","last_change":"2023-11-18T23:41:11.946155+0000","last_active":"2023-11-18T23:41:13.171564+0000","last_peered":"2023-11-18T23:41:13.171564+0000","last_clean":"2023-11-18T23:41:13.171564+0000","last_became_active":"2023-11-18T23:41:11.945888+0000","last_became_peered":"2023-11-18T23:41:11.945888+0000","last_unstale":"2023-11-18T23:41:13.171564+0000","last_undegraded":"2023-11-18T23:41:13.171564+0000","last_fullsized":"2023-11-18T23:41:13.171564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.935408+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:41:11.935408+0000","last_peered":"2023-11-18T23:41:11.935408+0000","last_clean":"2023-11-18T23:41:11.935408+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:41:11.935408+0000","last_undegraded":"2023-11-18T23:41:11.935408+0000","last_fullsized":"2023-11-18T23:41:11.935408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925730+0000","last_change":"2023-11-18T23:41:10.950732+0000","last_active":"2023-11-18T23:41:12.925730+0000","last_peered":"2023-11-18T23:41:12.925730+0000","last_clean":"2023-11-18T23:41:12.925730+0000","last_became_active":"2023-11-18T23:41:10.950412+0000","last_became_peered":"2023-11-18T23:41:10.950412+0000","last_unstale":"2023-11-18T23:41:12.925730+0000","last_undegraded":"2023-11-18T23:41:12.925730+0000","last_fullsized":"2023-11-18T23:41:12.925730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925876+0000","last_change":"2023-11-18T23:41:11.944801+0000","last_active":"2023-11-18T23:41:12.925876+0000","last_peered":"2023-11-18T23:41:12.925876+0000","last_clean":"2023-11-18T23:41:12.925876+0000","last_became_active":"2023-11-18T23:41:11.944571+0000","last_became_peered":"2023-11-18T23:41:11.944571+0000","last_unstale":"2023-11-18T23:41:12.925876+0000","last_undegraded":"2023-11-18T23:41:12.925876+0000","last_fullsized":"2023-11-18T23:41:12.925876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.953232+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.952918+0000","last_became_peered":"2023-11-18T23:41:10.952918+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924571+0000","last_change":"2023-11-18T23:41:11.936302+0000","last_active":"2023-11-18T23:41:12.924571+0000","last_peered":"2023-11-18T23:41:12.924571+0000","last_clean":"2023-11-18T23:41:12.924571+0000","last_became_active":"2023-11-18T23:41:11.935466+0000","last_became_peered":"2023-11-18T23:41:11.935466+0000","last_unstale":"2023-11-18T23:41:12.924571+0000","last_undegraded":"2023-11-18T23:41:12.924571+0000","last_fullsized":"2023-11-18T23:41:12.924571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:30.278282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.262026+0000","last_change":"2023-11-18T23:41:10.949423+0000","last_active":"2023-11-18T23:41:13.262026+0000","last_peered":"2023-11-18T23:41:13.262026+0000","last_clean":"2023-11-18T23:41:13.262026+0000","last_became_active":"2023-11-18T23:41:10.949116+0000","last_became_peered":"2023-11-18T23:41:10.949116+0000","last_unstale":"2023-11-18T23:41:13.262026+0000","last_undegraded":"2023-11-18T23:41:13.262026+0000","last_fullsized":"2023-11-18T23:41:13.262026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703610+0000","last_change":"2023-11-18T23:41:11.938131+0000","last_active":"2023-11-18T23:41:13.703610+0000","last_peered":"2023-11-18T23:41:13.703610+0000","last_clean":"2023-11-18T23:41:13.703610+0000","last_became_active":"2023-11-18T23:41:11.937846+0000","last_became_peered":"2023-11-18T23:41:11.937846+0000","last_unstale":"2023-11-18T23:41:13.703610+0000","last_undegraded":"2023-11-18T23:41:13.703610+0000","last_fullsized":"2023-11-18T23:41:13.703610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926059+0000","last_change":"2023-11-18T23:41:10.940990+0000","last_active":"2023-11-18T23:41:12.926059+0000","last_peered":"2023-11-18T23:41:12.926059+0000","last_clean":"2023-11-18T23:41:12.926059+0000","last_became_active":"2023-11-18T23:41:10.940710+0000","last_became_peered":"2023-11-18T23:41:10.940710+0000","last_unstale":"2023-11-18T23:41:12.926059+0000","last_undegraded":"2023-11-18T23:41:12.926059+0000","last_fullsized":"2023-11-18T23:41:12.926059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:19.427443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703758+0000","last_change":"2023-11-18T23:41:11.938142+0000","last_active":"2023-11-18T23:41:13.703758+0000","last_peered":"2023-11-18T23:41:13.703758+0000","last_clean":"2023-11-18T23:41:13.703758+0000","last_became_active":"2023-11-18T23:41:11.937563+0000","last_became_peered":"2023-11-18T23:41:11.937563+0000","last_unstale":"2023-11-18T23:41:13.703758+0000","last_undegraded":"2023-11-18T23:41:13.703758+0000","last_fullsized":"2023-11-18T23:41:13.703758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:42:00.578989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259503+0000","last_change":"2023-11-18T23:41:10.949142+0000","last_active":"2023-11-18T23:41:13.259503+0000","last_peered":"2023-11-18T23:41:13.259503+0000","last_clean":"2023-11-18T23:41:13.259503+0000","last_became_active":"2023-11-18T23:41:10.948855+0000","last_became_peered":"2023-11-18T23:41:10.948855+0000","last_unstale":"2023-11-18T23:41:13.259503+0000","last_undegraded":"2023-11-18T23:41:13.259503+0000","last_fullsized":"2023-11-18T23:41:13.259503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:03.847100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926199+0000","last_change":"2023-11-18T23:41:11.941744+0000","last_active":"2023-11-18T23:41:12.926199+0000","last_peered":"2023-11-18T23:41:12.926199+0000","last_clean":"2023-11-18T23:41:12.926199+0000","last_became_active":"2023-11-18T23:41:11.941469+0000","last_became_peered":"2023-11-18T23:41:11.941469+0000","last_unstale":"2023-11-18T23:41:12.926199+0000","last_undegraded":"2023-11-18T23:41:12.926199+0000","last_fullsized":"2023-11-18T23:41:12.926199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171719+0000","last_change":"2023-11-18T23:41:10.955650+0000","last_active":"2023-11-18T23:41:13.171719+0000","last_peered":"2023-11-18T23:41:13.171719+0000","last_clean":"2023-11-18T23:41:13.171719+0000","last_became_active":"2023-11-18T23:41:10.955331+0000","last_became_peered":"2023-11-18T23:41:10.955331+0000","last_unstale":"2023-11-18T23:41:13.171719+0000","last_undegraded":"2023-11-18T23:41:13.171719+0000","last_fullsized":"2023-11-18T23:41:13.171719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:50.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703828+0000","last_change":"2023-11-18T23:41:11.934954+0000","last_active":"2023-11-18T23:41:13.703828+0000","last_peered":"2023-11-18T23:41:13.703828+0000","last_clean":"2023-11-18T23:41:13.703828+0000","last_became_active":"2023-11-18T23:41:11.934651+0000","last_became_peered":"2023-11-18T23:41:11.934651+0000","last_unstale":"2023-11-18T23:41:13.703828+0000","last_undegraded":"2023-11-18T23:41:13.703828+0000","last_fullsized":"2023-11-18T23:41:13.703828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.704032+0000","last_change":"2023-11-18T23:41:10.947031+0000","last_active":"2023-11-18T23:41:13.704032+0000","last_peered":"2023-11-18T23:41:13.704032+0000","last_clean":"2023-11-18T23:41:13.704032+0000","last_became_active":"2023-11-18T23:41:10.946758+0000","last_became_peered":"2023-11-18T23:41:10.946758+0000","last_unstale":"2023-11-18T23:41:13.704032+0000","last_undegraded":"2023-11-18T23:41:13.704032+0000","last_fullsized":"2023-11-18T23:41:13.704032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925991+0000","last_change":"2023-11-18T23:41:11.941903+0000","last_active":"2023-11-18T23:41:12.925991+0000","last_peered":"2023-11-18T23:41:12.925991+0000","last_clean":"2023-11-18T23:41:12.925991+0000","last_became_active":"2023-11-18T23:41:11.941319+0000","last_became_peered":"2023-11-18T23:41:11.941319+0000","last_unstale":"2023-11-18T23:41:12.925991+0000","last_undegraded":"2023-11-18T23:41:12.925991+0000","last_fullsized":"2023-11-18T23:41:12.925991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255907+0000","last_change":"2023-11-18T23:41:10.953396+0000","last_active":"2023-11-18T23:41:13.255907+0000","last_peered":"2023-11-18T23:41:13.255907+0000","last_clean":"2023-11-18T23:41:13.255907+0000","last_became_active":"2023-11-18T23:41:10.952840+0000","last_became_peered":"2023-11-18T23:41:10.952840+0000","last_unstale":"2023-11-18T23:41:13.255907+0000","last_undegraded":"2023-11-18T23:41:13.255907+0000","last_fullsized":"2023-11-18T23:41:13.255907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924847+0000","last_change":"2023-11-18T23:41:11.938451+0000","last_active":"2023-11-18T23:41:12.924847+0000","last_peered":"2023-11-18T23:41:12.924847+0000","last_clean":"2023-11-18T23:41:12.924847+0000","last_became_active":"2023-11-18T23:41:11.938166+0000","last_became_peered":"2023-11-18T23:41:11.938166+0000","last_unstale":"2023-11-18T23:41:12.924847+0000","last_undegraded":"2023-11-18T23:41:12.924847+0000","last_fullsized":"2023-11-18T23:41:12.924847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.955647+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.955339+0000","last_became_peered":"2023-11-18T23:41:10.955339+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:33.115860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703647+0000","last_change":"2023-11-18T23:41:11.935837+0000","last_active":"2023-11-18T23:41:13.703647+0000","last_peered":"2023-11-18T23:41:13.703647+0000","last_clean":"2023-11-18T23:41:13.703647+0000","last_became_active":"2023-11-18T23:41:11.935574+0000","last_became_peered":"2023-11-18T23:41:11.935574+0000","last_unstale":"2023-11-18T23:41:13.703647+0000","last_undegraded":"2023-11-18T23:41:13.703647+0000","last_fullsized":"2023-11-18T23:41:13.703647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:06.672979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259470+0000","last_change":"2023-11-18T23:41:10.952633+0000","last_active":"2023-11-18T23:41:13.259470+0000","last_peered":"2023-11-18T23:41:13.259470+0000","last_clean":"2023-11-18T23:41:13.259470+0000","last_became_active":"2023-11-18T23:41:10.952172+0000","last_became_peered":"2023-11-18T23:41:10.952172+0000","last_unstale":"2023-11-18T23:41:13.259470+0000","last_undegraded":"2023-11-18T23:41:13.259470+0000","last_fullsized":"2023-11-18T23:41:13.259470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926000+0000","last_change":"2023-11-18T23:41:11.935331+0000","last_active":"2023-11-18T23:41:12.926000+0000","last_peered":"2023-11-18T23:41:12.926000+0000","last_clean":"2023-11-18T23:41:12.926000+0000","last_became_active":"2023-11-18T23:41:11.935022+0000","last_became_peered":"2023-11-18T23:41:11.935022+0000","last_unstale":"2023-11-18T23:41:12.926000+0000","last_undegraded":"2023-11-18T23:41:12.926000+0000","last_fullsized":"2023-11-18T23:41:12.926000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259480+0000","last_change":"2023-11-18T23:41:10.942836+0000","last_active":"2023-11-18T23:41:13.259480+0000","last_peered":"2023-11-18T23:41:13.259480+0000","last_clean":"2023-11-18T23:41:13.259480+0000","last_became_active":"2023-11-18T23:41:10.942491+0000","last_became_peered":"2023-11-18T23:41:10.942491+0000","last_unstale":"2023-11-18T23:41:13.259480+0000","last_undegraded":"2023-11-18T23:41:13.259480+0000","last_fullsized":"2023-11-18T23:41:13.259480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:12.831977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926129+0000","last_change":"2023-11-18T23:41:11.937215+0000","last_active":"2023-11-18T23:41:12.926129+0000","last_peered":"2023-11-18T23:41:12.926129+0000","last_clean":"2023-11-18T23:41:12.926129+0000","last_became_active":"2023-11-18T23:41:11.936805+0000","last_became_peered":"2023-11-18T23:41:11.936805+0000","last_unstale":"2023-11-18T23:41:12.926129+0000","last_undegraded":"2023-11-18T23:41:12.926129+0000","last_fullsized":"2023-11-18T23:41:12.926129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171642+0000","last_change":"2023-11-18T23:41:10.954159+0000","last_active":"2023-11-18T23:41:13.171642+0000","last_peered":"2023-11-18T23:41:13.171642+0000","last_clean":"2023-11-18T23:41:13.171642+0000","last_became_active":"2023-11-18T23:41:10.953615+0000","last_became_peered":"2023-11-18T23:41:10.953615+0000","last_unstale":"2023-11-18T23:41:13.171642+0000","last_undegraded":"2023-11-18T23:41:13.171642+0000","last_fullsized":"2023-11-18T23:41:13.171642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703226+0000","last_change":"2023-11-18T23:41:11.936655+0000","last_active":"2023-11-18T23:41:13.703226+0000","last_peered":"2023-11-18T23:41:13.703226+0000","last_clean":"2023-11-18T23:41:13.703226+0000","last_became_active":"2023-11-18T23:41:11.936383+0000","last_became_peered":"2023-11-18T23:41:11.936383+0000","last_unstale":"2023-11-18T23:41:13.703226+0000","last_undegraded":"2023-11-18T23:41:13.703226+0000","last_fullsized":"2023-11-18T23:41:13.703226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926177+0000","last_change":"2023-11-18T23:41:11.932101+0000","last_active":"2023-11-18T23:41:12.926177+0000","last_peered":"2023-11-18T23:41:12.926177+0000","last_clean":"2023-11-18T23:41:12.926177+0000","last_became_active":"2023-11-18T23:41:11.931783+0000","last_became_peered":"2023-11-18T23:41:11.931783+0000","last_unstale":"2023-11-18T23:41:12.926177+0000","last_undegraded":"2023-11-18T23:41:12.926177+0000","last_fullsized":"2023-11-18T23:41:12.926177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171386+0000","last_change":"2023-11-18T23:41:10.952684+0000","last_active":"2023-11-18T23:41:13.171386+0000","last_peered":"2023-11-18T23:41:13.171386+0000","last_clean":"2023-11-18T23:41:13.171386+0000","last_became_active":"2023-11-18T23:41:10.952350+0000","last_became_peered":"2023-11-18T23:41:10.952350+0000","last_unstale":"2023-11-18T23:41:13.171386+0000","last_undegraded":"2023-11-18T23:41:13.171386+0000","last_fullsized":"2023-11-18T23:41:13.171386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925917+0000","last_change":"2023-11-18T23:41:11.936793+0000","last_active":"2023-11-18T23:41:12.925917+0000","last_peered":"2023-11-18T23:41:12.925917+0000","last_clean":"2023-11-18T23:41:12.925917+0000","last_became_active":"2023-11-18T23:41:11.936505+0000","last_became_peered":"2023-11-18T23:41:11.936505+0000","last_unstale":"2023-11-18T23:41:12.925917+0000","last_undegraded":"2023-11-18T23:41:12.925917+0000","last_fullsized":"2023-11-18T23:41:12.925917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171615+0000","last_change":"2023-11-18T23:41:10.952889+0000","last_active":"2023-11-18T23:41:13.171615+0000","last_peered":"2023-11-18T23:41:13.171615+0000","last_clean":"2023-11-18T23:41:13.171615+0000","last_became_active":"2023-11-18T23:41:10.952351+0000","last_became_peered":"2023-11-18T23:41:10.952351+0000","last_unstale":"2023-11-18T23:41:13.171615+0000","last_undegraded":"2023-11-18T23:41:13.171615+0000","last_fullsized":"2023-11-18T23:41:13.171615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924965+0000","last_change":"2023-11-18T23:41:11.932536+0000","last_active":"2023-11-18T23:41:12.924965+0000","last_peered":"2023-11-18T23:41:12.924965+0000","last_clean":"2023-11-18T23:41:12.924965+0000","last_became_active":"2023-11-18T23:41:11.931747+0000","last_became_peered":"2023-11-18T23:41:11.931747+0000","last_unstale":"2023-11-18T23:41:12.924965+0000","last_undegraded":"2023-11-18T23:41:12.924965+0000","last_fullsized":"2023-11-18T23:41:12.924965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926169+0000","last_change":"2023-11-18T23:41:10.948118+0000","last_active":"2023-11-18T23:41:12.926169+0000","last_peered":"2023-11-18T23:41:12.926169+0000","last_clean":"2023-11-18T23:41:12.926169+0000","last_became_active":"2023-11-18T23:41:10.947802+0000","last_became_peered":"2023-11-18T23:41:10.947802+0000","last_unstale":"2023-11-18T23:41:12.926169+0000","last_undegraded":"2023-11-18T23:41:12.926169+0000","last_fullsized":"2023-11-18T23:41:12.926169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926158+0000","last_change":"2023-11-18T23:41:11.939056+0000","last_active":"2023-11-18T23:41:12.926158+0000","last_peered":"2023-11-18T23:41:12.926158+0000","last_clean":"2023-11-18T23:41:12.926158+0000","last_became_active":"2023-11-18T23:41:11.938752+0000","last_became_peered":"2023-11-18T23:41:11.938752+0000","last_unstale":"2023-11-18T23:41:12.926158+0000","last_undegraded":"2023-11-18T23:41:12.926158+0000","last_fullsized":"2023-11-18T23:41:12.926158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:10.954940+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:10.954216+0000","last_became_peered":"2023-11-18T23:41:10.954216+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:41:21.705 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:41:21.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.846+0000 7f5d4ad6c640 1 Processor -- start 2023-11-18T23:41:21.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.846+0000 7f5d4ad6c640 1 -- start start 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.846+0000 7f5d4ad6c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d4415d3e0 0x7f5d440ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.846+0000 7f5d4ad6c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d440ced30 0x7f5d440d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.846+0000 7f5d4ad6c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d440b5f90 con 0x7f5d440d1c60 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.846+0000 7f5d4ad6c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d440cf170 con 0x7f5d440ced30 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.846+0000 7f5d4ad6c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440d20f0 con 0x7f5d4415d3e0 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d43fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d440ced30 0x7f5d440d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d49309640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5d440d1c60 0x7f5d440b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47804/0 (socket says 172.21.15.8:47804) 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d43fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d440ced30 0x7f5d440d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48710/0 (socket says 172.21.15.8:48710) 2023-11-18T23:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d49309640 1 -- 172.21.15.8:0/4098518372 learned_addr learned my addr 172.21.15.8:0/4098518372 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d48b08640 1 --2- 172.21.15.8:0/4098518372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d4415d3e0 0x7f5d440ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d43fff640 1 -- 172.21.15.8:0/4098518372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d4415d3e0 msgr2=0x7f5d440ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d43fff640 1 --2- 172.21.15.8:0/4098518372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d4415d3e0 0x7f5d440ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d43fff640 1 -- 172.21.15.8:0/4098518372 >> v1:172.21.15.8:6789/0 conn(0x7f5d440d1c60 legacy=0x7f5d440b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d43fff640 1 -- 172.21.15.8:0/4098518372 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d440b61e0 con 0x7f5d440ced30 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d437fe640 1 -- 172.21.15.8:0/4098518372 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313347877 0 0) 0x7f5d440b5f90 con 0x7f5d440d1c60 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.847+0000 7f5d48b08640 1 --2- 172.21.15.8:0/4098518372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d4415d3e0 0x7f5d440ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d43fff640 1 --2- 172.21.15.8:0/4098518372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d440d1720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d300097a0 tx=0x7f5d3002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49287f0adee6514 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d437fe640 1 -- 172.21.15.8:0/4098518372 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3002d040 con 0x7f5d440ced30 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d437fe640 1 -- 172.21.15.8:0/4098518372 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30031810 con 0x7f5d440ced30 2023-11-18T23:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d437fe640 1 -- 172.21.15.8:0/4098518372 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30031ba0 con 0x7f5d440ced30 2023-11-18T23:41:21.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/4098518372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 msgr2=0x7f5d440d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/4098518372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d440d1720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d300097a0 tx=0x7f5d3002b8b0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/4098518372 shutdown_connections 2023-11-18T23:41:21.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/4098518372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d440d1720 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/4098518372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d4415d3e0 0x7f5d440ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/4098518372 >> 172.21.15.8:0/4098518372 conn(0x7f5d4409c480 msgr2=0x7f5d440d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:21.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/4098518372 shutdown_connections 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.848+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/4098518372 wait complete. 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 Processor -- start 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 -- start start 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d4414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d440d1c60 0x7f5d440cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d4415d3e0 0x7f5d441f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440cc570 con 0x7f5d440ced30 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d441f0a10 con 0x7f5d4415d3e0 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.850+0000 7f5d4ad6c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440cb960 con 0x7f5d440d1c60 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d4414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d4414aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48716/0 (socket says 172.21.15.8:48716) 2023-11-18T23:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 -- 172.21.15.8:0/1568752019 learned_addr learned my addr 172.21.15.8:0/1568752019 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d49309640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d4415d3e0 0x7f5d441f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d43fff640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d440d1c60 0x7f5d440cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 -- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d440d1c60 msgr2=0x7f5d440cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d440d1c60 0x7f5d440cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 -- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d4415d3e0 msgr2=0x7f5d441f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d4415d3e0 0x7f5d441f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 -- 172.21.15.8:0/1568752019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30009400 con 0x7f5d440ced30 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d49309640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d4415d3e0 0x7f5d441f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d43fff640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d440d1c60 0x7f5d440cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d48b08640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d4414aee0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c7f0 tx=0x7f5d3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d417fa640 1 -- 172.21.15.8:0/1568752019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38007820 con 0x7f5d440ced30 2023-11-18T23:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d417fa640 1 -- 172.21.15.8:0/1568752019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38007980 con 0x7f5d440ced30 2023-11-18T23:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d440cbc40 con 0x7f5d440ced30 2023-11-18T23:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d417fa640 1 -- 172.21.15.8:0/1568752019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38007cf0 con 0x7f5d440ced30 2023-11-18T23:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.851+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d440cc200 con 0x7f5d440ced30 2023-11-18T23:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.852+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d44067420 con 0x7f5d440ced30 2023-11-18T23:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.852+0000 7f5d417fa640 1 -- 172.21.15.8:0/1568752019 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d380113f0 con 0x7f5d440ced30 2023-11-18T23:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.853+0000 7f5d417fa640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5d2806ae40 0x7f5d2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.853+0000 7f5d417fa640 1 -- 172.21.15.8:0/1568752019 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d380898c0 con 0x7f5d440ced30 2023-11-18T23:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.853+0000 7f5d43fff640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5d2806ae40 0x7f5d2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.854+0000 7f5d43fff640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5d2806ae40 0x7f5d2806d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d30036000 tx=0x7f5d30008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:21.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:21.858+0000 7f5d417fa640 1 -- 172.21.15.8:0/1568752019 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d38054a00 con 0x7f5d440ced30 2023-11-18T23:41:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.033+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d440b6a80 con 0x7f5d2806ae40 2023-11-18T23:41:22.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.041+0000 7f5d417fa640 1 -- 172.21.15.8:0/1568752019 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264561 (secure 0 0 0) 0x7f5d30031610 con 0x7f5d2806ae40 2023-11-18T23:41:22.048 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5d2806ae40 msgr2=0x7f5d2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5d2806ae40 0x7f5d2806d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d30036000 tx=0x7f5d30008030 comp rx=0 tx=0).stop 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 msgr2=0x7f5d4414aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d4414aee0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c7f0 tx=0x7f5d3800ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 shutdown_connections 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5d2806ae40 0x7f5d2806d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d4415d3e0 0x7f5d441f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d440d1c60 0x7f5d440cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 --2- 172.21.15.8:0/1568752019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d440ced30 0x7f5d4414aee0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 >> 172.21.15.8:0/1568752019 conn(0x7f5d4409c480 msgr2=0x7f5d440cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:22.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 shutdown_connections 2023-11-18T23:41:22.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.043+0000 7f5d4ad6c640 1 -- 172.21.15.8:0/1568752019 wait complete. 2023-11-18T23:41:22.055 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-18T23:41:21.245446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235656,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739064,"statfs":{"total":773094113280,"available":772852801536,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.321634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171816+0000","last_change":"2023-11-18T23:41:11.946811+0000","last_active":"2023-11-18T23:41:13.171816+0000","last_peered":"2023-11-18T23:41:13.171816+0000","last_clean":"2023-11-18T23:41:13.171816+0000","last_became_active":"2023-11-18T23:41:11.946364+0000","last_became_peered":"2023-11-18T23:41:11.946364+0000","last_unstale":"2023-11-18T23:41:13.171816+0000","last_undegraded":"2023-11-18T23:41:13.171816+0000","last_fullsized":"2023-11-18T23:41:13.171816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:01:13.637927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.704009+0000","last_change":"2023-11-18T23:41:11.940115+0000","last_active":"2023-11-18T23:41:13.704009+0000","last_peered":"2023-11-18T23:41:13.704009+0000","last_clean":"2023-11-18T23:41:13.704009+0000","last_became_active":"2023-11-18T23:41:11.939851+0000","last_became_peered":"2023-11-18T23:41:11.939851+0000","last_unstale":"2023-11-18T23:41:13.704009+0000","last_undegraded":"2023-11-18T23:41:13.704009+0000","last_fullsized":"2023-11-18T23:41:13.704009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924769+0000","last_change":"2023-11-18T23:41:11.933794+0000","last_active":"2023-11-18T23:41:12.924769+0000","last_peered":"2023-11-18T23:41:12.924769+0000","last_clean":"2023-11-18T23:41:12.924769+0000","last_became_active":"2023-11-18T23:41:11.931711+0000","last_became_peered":"2023-11-18T23:41:11.931711+0000","last_unstale":"2023-11-18T23:41:12.924769+0000","last_undegraded":"2023-11-18T23:41:12.924769+0000","last_fullsized":"2023-11-18T23:41:12.924769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926073+0000","last_change":"2023-11-18T23:41:11.941706+0000","last_active":"2023-11-18T23:41:12.926073+0000","last_peered":"2023-11-18T23:41:12.926073+0000","last_clean":"2023-11-18T23:41:12.926073+0000","last_became_active":"2023-11-18T23:41:11.941441+0000","last_became_peered":"2023-11-18T23:41:11.941441+0000","last_unstale":"2023-11-18T23:41:12.926073+0000","last_undegraded":"2023-11-18T23:41:12.926073+0000","last_fullsized":"2023-11-18T23:41:12.926073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171510+0000","last_change":"2023-11-18T23:41:11.940717+0000","last_active":"2023-11-18T23:41:13.171510+0000","last_peered":"2023-11-18T23:41:13.171510+0000","last_clean":"2023-11-18T23:41:13.171510+0000","last_became_active":"2023-11-18T23:41:11.939288+0000","last_became_peered":"2023-11-18T23:41:11.939288+0000","last_unstale":"2023-11-18T23:41:13.171510+0000","last_undegraded":"2023-11-18T23:41:13.171510+0000","last_fullsized":"2023-11-18T23:41:13.171510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925518+0000","last_change":"2023-11-18T23:41:11.938211+0000","last_active":"2023-11-18T23:41:12.925518+0000","last_peered":"2023-11-18T23:41:12.925518+0000","last_clean":"2023-11-18T23:41:12.925518+0000","last_became_active":"2023-11-18T23:41:11.937953+0000","last_became_peered":"2023-11-18T23:41:11.937953+0000","last_unstale":"2023-11-18T23:41:12.925518+0000","last_undegraded":"2023-11-18T23:41:12.925518+0000","last_fullsized":"2023-11-18T23:41:12.925518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171265+0000","last_change":"2023-11-18T23:41:11.943648+0000","last_active":"2023-11-18T23:41:13.171265+0000","last_peered":"2023-11-18T23:41:13.171265+0000","last_clean":"2023-11-18T23:41:13.171265+0000","last_became_active":"2023-11-18T23:41:11.943321+0000","last_became_peered":"2023-11-18T23:41:11.943321+0000","last_unstale":"2023-11-18T23:41:13.171265+0000","last_undegraded":"2023-11-18T23:41:13.171265+0000","last_fullsized":"2023-11-18T23:41:13.171265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925699+0000","last_change":"2023-11-18T23:41:11.944907+0000","last_active":"2023-11-18T23:41:12.925699+0000","last_peered":"2023-11-18T23:41:12.925699+0000","last_clean":"2023-11-18T23:41:12.925699+0000","last_became_active":"2023-11-18T23:41:11.944546+0000","last_became_peered":"2023-11-18T23:41:11.944546+0000","last_unstale":"2023-11-18T23:41:12.925699+0000","last_undegraded":"2023-11-18T23:41:12.925699+0000","last_fullsized":"2023-11-18T23:41:12.925699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:36.330588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171795+0000","last_change":"2023-11-18T23:41:11.945133+0000","last_active":"2023-11-18T23:41:13.171795+0000","last_peered":"2023-11-18T23:41:13.171795+0000","last_clean":"2023-11-18T23:41:13.171795+0000","last_became_active":"2023-11-18T23:41:11.944763+0000","last_became_peered":"2023-11-18T23:41:11.944763+0000","last_unstale":"2023-11-18T23:41:13.171795+0000","last_undegraded":"2023-11-18T23:41:13.171795+0000","last_fullsized":"2023-11-18T23:41:13.171795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:21.419360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703838+0000","last_change":"2023-11-18T23:41:11.945314+0000","last_active":"2023-11-18T23:41:13.703838+0000","last_peered":"2023-11-18T23:41:13.703838+0000","last_clean":"2023-11-18T23:41:13.703838+0000","last_became_active":"2023-11-18T23:41:11.945040+0000","last_became_peered":"2023-11-18T23:41:11.945040+0000","last_unstale":"2023-11-18T23:41:13.703838+0000","last_undegraded":"2023-11-18T23:41:13.703838+0000","last_fullsized":"2023-11-18T23:41:13.703838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703356+0000","last_change":"2023-11-18T23:41:11.939307+0000","last_active":"2023-11-18T23:41:13.703356+0000","last_peered":"2023-11-18T23:41:13.703356+0000","last_clean":"2023-11-18T23:41:13.703356+0000","last_became_active":"2023-11-18T23:41:11.939039+0000","last_became_peered":"2023-11-18T23:41:11.939039+0000","last_unstale":"2023-11-18T23:41:13.703356+0000","last_undegraded":"2023-11-18T23:41:13.703356+0000","last_fullsized":"2023-11-18T23:41:13.703356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703924+0000","last_change":"2023-11-18T23:41:11.940131+0000","last_active":"2023-11-18T23:41:13.703924+0000","last_peered":"2023-11-18T23:41:13.703924+0000","last_clean":"2023-11-18T23:41:13.703924+0000","last_became_active":"2023-11-18T23:41:11.939870+0000","last_became_peered":"2023-11-18T23:41:11.939870+0000","last_unstale":"2023-11-18T23:41:13.703924+0000","last_undegraded":"2023-11-18T23:41:13.703924+0000","last_fullsized":"2023-11-18T23:41:13.703924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:21.079188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925790+0000","last_change":"2023-11-18T23:41:11.940144+0000","last_active":"2023-11-18T23:41:12.925790+0000","last_peered":"2023-11-18T23:41:12.925790+0000","last_clean":"2023-11-18T23:41:12.925790+0000","last_became_active":"2023-11-18T23:41:11.939856+0000","last_became_peered":"2023-11-18T23:41:11.939856+0000","last_unstale":"2023-11-18T23:41:12.925790+0000","last_undegraded":"2023-11-18T23:41:12.925790+0000","last_fullsized":"2023-11-18T23:41:12.925790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924731+0000","last_change":"2023-11-18T23:41:11.934160+0000","last_active":"2023-11-18T23:41:12.924731+0000","last_peered":"2023-11-18T23:41:12.924731+0000","last_clean":"2023-11-18T23:41:12.924731+0000","last_became_active":"2023-11-18T23:41:11.933765+0000","last_became_peered":"2023-11-18T23:41:11.933765+0000","last_unstale":"2023-11-18T23:41:12.924731+0000","last_undegraded":"2023-11-18T23:41:12.924731+0000","last_fullsized":"2023-11-18T23:41:12.924731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:13.836738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703763+0000","last_change":"2023-11-18T23:41:11.936206+0000","last_active":"2023-11-18T23:41:13.703763+0000","last_peered":"2023-11-18T23:41:13.703763+0000","last_clean":"2023-11-18T23:41:13.703763+0000","last_became_active":"2023-11-18T23:41:11.935928+0000","last_became_peered":"2023-11-18T23:41:11.935928+0000","last_unstale":"2023-11-18T23:41:13.703763+0000","last_undegraded":"2023-11-18T23:41:13.703763+0000","last_fullsized":"2023-11-18T23:41:13.703763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925537+0000","last_change":"2023-11-18T23:41:11.933938+0000","last_active":"2023-11-18T23:41:12.925537+0000","last_peered":"2023-11-18T23:41:12.925537+0000","last_clean":"2023-11-18T23:41:12.925537+0000","last_became_active":"2023-11-18T23:41:11.933650+0000","last_became_peered":"2023-11-18T23:41:11.933650+0000","last_unstale":"2023-11-18T23:41:12.925537+0000","last_undegraded":"2023-11-18T23:41:12.925537+0000","last_fullsized":"2023-11-18T23:41:12.925537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926339+0000","last_change":"2023-11-18T23:41:11.939059+0000","last_active":"2023-11-18T23:41:12.926339+0000","last_peered":"2023-11-18T23:41:12.926339+0000","last_clean":"2023-11-18T23:41:12.926339+0000","last_became_active":"2023-11-18T23:41:11.938794+0000","last_became_peered":"2023-11-18T23:41:11.938794+0000","last_unstale":"2023-11-18T23:41:12.926339+0000","last_undegraded":"2023-11-18T23:41:12.926339+0000","last_fullsized":"2023-11-18T23:41:12.926339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703449+0000","last_change":"2023-11-18T23:41:11.940827+0000","last_active":"2023-11-18T23:41:13.703449+0000","last_peered":"2023-11-18T23:41:13.703449+0000","last_clean":"2023-11-18T23:41:13.703449+0000","last_became_active":"2023-11-18T23:41:11.940536+0000","last_became_peered":"2023-11-18T23:41:11.940536+0000","last_unstale":"2023-11-18T23:41:13.703449+0000","last_undegraded":"2023-11-18T23:41:13.703449+0000","last_fullsized":"2023-11-18T23:41:13.703449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171737+0000","last_change":"2023-11-18T23:41:11.940969+0000","last_active":"2023-11-18T23:41:13.171737+0000","last_peered":"2023-11-18T23:41:13.171737+0000","last_clean":"2023-11-18T23:41:13.171737+0000","last_became_active":"2023-11-18T23:41:11.940183+0000","last_became_peered":"2023-11-18T23:41:11.940183+0000","last_unstale":"2023-11-18T23:41:13.171737+0000","last_undegraded":"2023-11-18T23:41:13.171737+0000","last_fullsized":"2023-11-18T23:41:13.171737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703512+0000","last_change":"2023-11-18T23:41:11.941178+0000","last_active":"2023-11-18T23:41:13.703512+0000","last_peered":"2023-11-18T23:41:13.703512+0000","last_clean":"2023-11-18T23:41:13.703512+0000","last_became_active":"2023-11-18T23:41:11.940898+0000","last_became_peered":"2023-11-18T23:41:11.940898+0000","last_unstale":"2023-11-18T23:41:13.703512+0000","last_undegraded":"2023-11-18T23:41:13.703512+0000","last_fullsized":"2023-11-18T23:41:13.703512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924966+0000","last_change":"2023-11-18T23:41:11.942903+0000","last_active":"2023-11-18T23:41:12.924966+0000","last_peered":"2023-11-18T23:41:12.924966+0000","last_clean":"2023-11-18T23:41:12.924966+0000","last_became_active":"2023-11-18T23:41:11.942534+0000","last_became_peered":"2023-11-18T23:41:11.942534+0000","last_unstale":"2023-11-18T23:41:12.924966+0000","last_undegraded":"2023-11-18T23:41:12.924966+0000","last_fullsized":"2023-11-18T23:41:12.924966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925720+0000","last_change":"2023-11-18T23:41:11.944563+0000","last_active":"2023-11-18T23:41:12.925720+0000","last_peered":"2023-11-18T23:41:12.925720+0000","last_clean":"2023-11-18T23:41:12.925720+0000","last_became_active":"2023-11-18T23:41:11.943198+0000","last_became_peered":"2023-11-18T23:41:11.943198+0000","last_unstale":"2023-11-18T23:41:12.925720+0000","last_undegraded":"2023-11-18T23:41:12.925720+0000","last_fullsized":"2023-11-18T23:41:12.925720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926277+0000","last_change":"2023-11-18T23:41:11.934900+0000","last_active":"2023-11-18T23:41:12.926277+0000","last_peered":"2023-11-18T23:41:12.926277+0000","last_clean":"2023-11-18T23:41:12.926277+0000","last_became_active":"2023-11-18T23:41:11.934615+0000","last_became_peered":"2023-11-18T23:41:11.934615+0000","last_unstale":"2023-11-18T23:41:12.926277+0000","last_undegraded":"2023-11-18T23:41:12.926277+0000","last_fullsized":"2023-11-18T23:41:12.926277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925552+0000","last_change":"2023-11-18T23:41:11.940124+0000","last_active":"2023-11-18T23:41:12.925552+0000","last_peered":"2023-11-18T23:41:12.925552+0000","last_clean":"2023-11-18T23:41:12.925552+0000","last_became_active":"2023-11-18T23:41:11.939772+0000","last_became_peered":"2023-11-18T23:41:11.939772+0000","last_unstale":"2023-11-18T23:41:12.925552+0000","last_undegraded":"2023-11-18T23:41:12.925552+0000","last_fullsized":"2023-11-18T23:41:12.925552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925849+0000","last_change":"2023-11-18T23:41:11.935614+0000","last_active":"2023-11-18T23:41:12.925849+0000","last_peered":"2023-11-18T23:41:12.925849+0000","last_clean":"2023-11-18T23:41:12.925849+0000","last_became_active":"2023-11-18T23:41:11.935359+0000","last_became_peered":"2023-11-18T23:41:11.935359+0000","last_unstale":"2023-11-18T23:41:12.925849+0000","last_undegraded":"2023-11-18T23:41:12.925849+0000","last_fullsized":"2023-11-18T23:41:12.925849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703584+0000","last_change":"2023-11-18T23:41:11.942859+0000","last_active":"2023-11-18T23:41:13.703584+0000","last_peered":"2023-11-18T23:41:13.703584+0000","last_clean":"2023-11-18T23:41:13.703584+0000","last_became_active":"2023-11-18T23:41:11.940443+0000","last_became_peered":"2023-11-18T23:41:11.940443+0000","last_unstale":"2023-11-18T23:41:13.703584+0000","last_undegraded":"2023-11-18T23:41:13.703584+0000","last_fullsized":"2023-11-18T23:41:13.703584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703890+0000","last_change":"2023-11-18T23:41:11.939763+0000","last_active":"2023-11-18T23:41:13.703890+0000","last_peered":"2023-11-18T23:41:13.703890+0000","last_clean":"2023-11-18T23:41:13.703890+0000","last_became_active":"2023-11-18T23:41:11.939467+0000","last_became_peered":"2023-11-18T23:41:11.939467+0000","last_unstale":"2023-11-18T23:41:13.703890+0000","last_undegraded":"2023-11-18T23:41:13.703890+0000","last_fullsized":"2023-11-18T23:41:13.703890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926083+0000","last_change":"2023-11-18T23:41:11.938804+0000","last_active":"2023-11-18T23:41:12.926083+0000","last_peered":"2023-11-18T23:41:12.926083+0000","last_clean":"2023-11-18T23:41:12.926083+0000","last_became_active":"2023-11-18T23:41:11.938399+0000","last_became_peered":"2023-11-18T23:41:11.938399+0000","last_unstale":"2023-11-18T23:41:12.926083+0000","last_undegraded":"2023-11-18T23:41:12.926083+0000","last_fullsized":"2023-11-18T23:41:12.926083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:51.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924943+0000","last_change":"2023-11-18T23:41:11.938618+0000","last_active":"2023-11-18T23:41:12.924943+0000","last_peered":"2023-11-18T23:41:12.924943+0000","last_clean":"2023-11-18T23:41:12.924943+0000","last_became_active":"2023-11-18T23:41:11.938221+0000","last_became_peered":"2023-11-18T23:41:11.938221+0000","last_unstale":"2023-11-18T23:41:12.924943+0000","last_undegraded":"2023-11-18T23:41:12.924943+0000","last_fullsized":"2023-11-18T23:41:12.924943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925751+0000","last_change":"2023-11-18T23:41:11.939803+0000","last_active":"2023-11-18T23:41:12.925751+0000","last_peered":"2023-11-18T23:41:12.925751+0000","last_clean":"2023-11-18T23:41:12.925751+0000","last_became_active":"2023-11-18T23:41:11.939543+0000","last_became_peered":"2023-11-18T23:41:11.939543+0000","last_unstale":"2023-11-18T23:41:12.925751+0000","last_undegraded":"2023-11-18T23:41:12.925751+0000","last_fullsized":"2023-11-18T23:41:12.925751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703400+0000","last_change":"2023-11-18T23:41:11.933138+0000","last_active":"2023-11-18T23:41:13.703400+0000","last_peered":"2023-11-18T23:41:13.703400+0000","last_clean":"2023-11-18T23:41:13.703400+0000","last_became_active":"2023-11-18T23:41:11.932851+0000","last_became_peered":"2023-11-18T23:41:11.932851+0000","last_unstale":"2023-11-18T23:41:13.703400+0000","last_undegraded":"2023-11-18T23:41:13.703400+0000","last_fullsized":"2023-11-18T23:41:13.703400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:21.079188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703103+0000","last_change":"2023-11-18T23:41:11.945502+0000","last_active":"2023-11-18T23:41:13.703103+0000","last_peered":"2023-11-18T23:41:13.703103+0000","last_clean":"2023-11-18T23:41:13.703103+0000","last_became_active":"2023-11-18T23:41:11.944702+0000","last_became_peered":"2023-11-18T23:41:11.944702+0000","last_unstale":"2023-11-18T23:41:13.703103+0000","last_undegraded":"2023-11-18T23:41:13.703103+0000","last_fullsized":"2023-11-18T23:41:13.703103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703354+0000","last_change":"2023-11-18T23:41:11.935750+0000","last_active":"2023-11-18T23:41:13.703354+0000","last_peered":"2023-11-18T23:41:13.703354+0000","last_clean":"2023-11-18T23:41:13.703354+0000","last_became_active":"2023-11-18T23:41:11.935328+0000","last_became_peered":"2023-11-18T23:41:11.935328+0000","last_unstale":"2023-11-18T23:41:13.703354+0000","last_undegraded":"2023-11-18T23:41:13.703354+0000","last_fullsized":"2023-11-18T23:41:13.703354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:41.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925897+0000","last_change":"2023-11-18T23:41:10.953149+0000","last_active":"2023-11-18T23:41:12.925897+0000","last_peered":"2023-11-18T23:41:12.925897+0000","last_clean":"2023-11-18T23:41:12.925897+0000","last_became_active":"2023-11-18T23:41:10.952850+0000","last_became_peered":"2023-11-18T23:41:10.952850+0000","last_unstale":"2023-11-18T23:41:12.925897+0000","last_undegraded":"2023-11-18T23:41:12.925897+0000","last_fullsized":"2023-11-18T23:41:12.925897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925028+0000","last_change":"2023-11-18T23:41:11.932987+0000","last_active":"2023-11-18T23:41:12.925028+0000","last_peered":"2023-11-18T23:41:12.925028+0000","last_clean":"2023-11-18T23:41:12.925028+0000","last_became_active":"2023-11-18T23:41:11.932403+0000","last_became_peered":"2023-11-18T23:41:11.932403+0000","last_unstale":"2023-11-18T23:41:12.925028+0000","last_undegraded":"2023-11-18T23:41:12.925028+0000","last_fullsized":"2023-11-18T23:41:12.925028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255807+0000","last_change":"2023-11-18T23:41:10.949837+0000","last_active":"2023-11-18T23:41:13.255807+0000","last_peered":"2023-11-18T23:41:13.255807+0000","last_clean":"2023-11-18T23:41:13.255807+0000","last_became_active":"2023-11-18T23:41:10.949583+0000","last_became_peered":"2023-11-18T23:41:10.949583+0000","last_unstale":"2023-11-18T23:41:13.255807+0000","last_undegraded":"2023-11-18T23:41:13.255807+0000","last_fullsized":"2023-11-18T23:41:13.255807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:20.074426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926272+0000","last_change":"2023-11-18T23:41:10.948701+0000","last_active":"2023-11-18T23:41:12.926272+0000","last_peered":"2023-11-18T23:41:12.926272+0000","last_clean":"2023-11-18T23:41:12.926272+0000","last_became_active":"2023-11-18T23:41:10.947786+0000","last_became_peered":"2023-11-18T23:41:10.947786+0000","last_unstale":"2023-11-18T23:41:12.926272+0000","last_undegraded":"2023-11-18T23:41:12.926272+0000","last_fullsized":"2023-11-18T23:41:12.926272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925862+0000","last_change":"2023-11-18T23:41:11.935863+0000","last_active":"2023-11-18T23:41:12.925862+0000","last_peered":"2023-11-18T23:41:12.925862+0000","last_clean":"2023-11-18T23:41:12.925862+0000","last_became_active":"2023-11-18T23:41:11.935550+0000","last_became_peered":"2023-11-18T23:41:11.935550+0000","last_unstale":"2023-11-18T23:41:12.925862+0000","last_undegraded":"2023-11-18T23:41:12.925862+0000","last_fullsized":"2023-11-18T23:41:12.925862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925638+0000","last_change":"2023-11-18T23:41:10.944934+0000","last_active":"2023-11-18T23:41:12.925638+0000","last_peered":"2023-11-18T23:41:12.925638+0000","last_clean":"2023-11-18T23:41:12.925638+0000","last_became_active":"2023-11-18T23:41:10.944648+0000","last_became_peered":"2023-11-18T23:41:10.944648+0000","last_unstale":"2023-11-18T23:41:12.925638+0000","last_undegraded":"2023-11-18T23:41:12.925638+0000","last_fullsized":"2023-11-18T23:41:12.925638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703687+0000","last_change":"2023-11-18T23:41:11.937179+0000","last_active":"2023-11-18T23:41:13.703687+0000","last_peered":"2023-11-18T23:41:13.703687+0000","last_clean":"2023-11-18T23:41:13.703687+0000","last_became_active":"2023-11-18T23:41:11.936855+0000","last_became_peered":"2023-11-18T23:41:11.936855+0000","last_unstale":"2023-11-18T23:41:13.703687+0000","last_undegraded":"2023-11-18T23:41:13.703687+0000","last_fullsized":"2023-11-18T23:41:13.703687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255897+0000","last_change":"2023-11-18T23:41:10.954127+0000","last_active":"2023-11-18T23:41:13.255897+0000","last_peered":"2023-11-18T23:41:13.255897+0000","last_clean":"2023-11-18T23:41:13.255897+0000","last_became_active":"2023-11-18T23:41:10.953785+0000","last_became_peered":"2023-11-18T23:41:10.953785+0000","last_unstale":"2023-11-18T23:41:13.255897+0000","last_undegraded":"2023-11-18T23:41:13.255897+0000","last_fullsized":"2023-11-18T23:41:13.255897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926194+0000","last_change":"2023-11-18T23:41:11.944161+0000","last_active":"2023-11-18T23:41:12.926194+0000","last_peered":"2023-11-18T23:41:12.926194+0000","last_clean":"2023-11-18T23:41:12.926194+0000","last_became_active":"2023-11-18T23:41:11.943897+0000","last_became_peered":"2023-11-18T23:41:11.943897+0000","last_unstale":"2023-11-18T23:41:12.926194+0000","last_undegraded":"2023-11-18T23:41:12.926194+0000","last_fullsized":"2023-11-18T23:41:12.926194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926026+0000","last_change":"2023-11-18T23:41:10.949653+0000","last_active":"2023-11-18T23:41:12.926026+0000","last_peered":"2023-11-18T23:41:12.926026+0000","last_clean":"2023-11-18T23:41:12.926026+0000","last_became_active":"2023-11-18T23:41:10.949342+0000","last_became_peered":"2023-11-18T23:41:10.949342+0000","last_unstale":"2023-11-18T23:41:12.926026+0000","last_undegraded":"2023-11-18T23:41:12.926026+0000","last_fullsized":"2023-11-18T23:41:12.926026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:11.932620+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:11.932076+0000","last_became_peered":"2023-11-18T23:41:11.932076+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259524+0000","last_change":"2023-11-18T23:41:10.944409+0000","last_active":"2023-11-18T23:41:13.259524+0000","last_peered":"2023-11-18T23:41:13.259524+0000","last_clean":"2023-11-18T23:41:13.259524+0000","last_became_active":"2023-11-18T23:41:10.944114+0000","last_became_peered":"2023-11-18T23:41:10.944114+0000","last_unstale":"2023-11-18T23:41:13.259524+0000","last_undegraded":"2023-11-18T23:41:13.259524+0000","last_fullsized":"2023-11-18T23:41:13.259524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.704000+0000","last_change":"2023-11-18T23:41:11.943003+0000","last_active":"2023-11-18T23:41:13.704000+0000","last_peered":"2023-11-18T23:41:13.704000+0000","last_clean":"2023-11-18T23:41:13.704000+0000","last_became_active":"2023-11-18T23:41:11.942700+0000","last_became_peered":"2023-11-18T23:41:11.942700+0000","last_unstale":"2023-11-18T23:41:13.704000+0000","last_undegraded":"2023-11-18T23:41:13.704000+0000","last_fullsized":"2023-11-18T23:41:13.704000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:34.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255855+0000","last_change":"2023-11-18T23:41:10.949432+0000","last_active":"2023-11-18T23:41:13.255855+0000","last_peered":"2023-11-18T23:41:13.255855+0000","last_clean":"2023-11-18T23:41:13.255855+0000","last_became_active":"2023-11-18T23:41:10.949070+0000","last_became_peered":"2023-11-18T23:41:10.949070+0000","last_unstale":"2023-11-18T23:41:13.255855+0000","last_undegraded":"2023-11-18T23:41:13.255855+0000","last_fullsized":"2023-11-18T23:41:13.255855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171506+0000","last_change":"2023-11-18T23:41:11.944440+0000","last_active":"2023-11-18T23:41:13.171506+0000","last_peered":"2023-11-18T23:41:13.171506+0000","last_clean":"2023-11-18T23:41:13.171506+0000","last_became_active":"2023-11-18T23:41:11.944144+0000","last_became_peered":"2023-11-18T23:41:11.944144+0000","last_unstale":"2023-11-18T23:41:13.171506+0000","last_undegraded":"2023-11-18T23:41:13.171506+0000","last_fullsized":"2023-11-18T23:41:13.171506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925055+0000","last_change":"2023-11-18T23:41:10.953937+0000","last_active":"2023-11-18T23:41:12.925055+0000","last_peered":"2023-11-18T23:41:12.925055+0000","last_clean":"2023-11-18T23:41:12.925055+0000","last_became_active":"2023-11-18T23:41:10.953500+0000","last_became_peered":"2023-11-18T23:41:10.953500+0000","last_unstale":"2023-11-18T23:41:12.925055+0000","last_undegraded":"2023-11-18T23:41:12.925055+0000","last_fullsized":"2023-11-18T23:41:12.925055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924751+0000","last_change":"2023-11-18T23:41:11.941920+0000","last_active":"2023-11-18T23:41:12.924751+0000","last_peered":"2023-11-18T23:41:12.924751+0000","last_clean":"2023-11-18T23:41:12.924751+0000","last_became_active":"2023-11-18T23:41:11.941599+0000","last_became_peered":"2023-11-18T23:41:11.941599+0000","last_unstale":"2023-11-18T23:41:12.924751+0000","last_undegraded":"2023-11-18T23:41:12.924751+0000","last_fullsized":"2023-11-18T23:41:12.924751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:46.123581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925846+0000","last_change":"2023-11-18T23:41:10.948691+0000","last_active":"2023-11-18T23:41:12.925846+0000","last_peered":"2023-11-18T23:41:12.925846+0000","last_clean":"2023-11-18T23:41:12.925846+0000","last_became_active":"2023-11-18T23:41:10.948397+0000","last_became_peered":"2023-11-18T23:41:10.948397+0000","last_unstale":"2023-11-18T23:41:12.925846+0000","last_undegraded":"2023-11-18T23:41:12.925846+0000","last_fullsized":"2023-11-18T23:41:12.925846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:06.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171508+0000","last_change":"2023-11-18T23:41:11.942006+0000","last_active":"2023-11-18T23:41:13.171508+0000","last_peered":"2023-11-18T23:41:13.171508+0000","last_clean":"2023-11-18T23:41:13.171508+0000","last_became_active":"2023-11-18T23:41:11.941752+0000","last_became_peered":"2023-11-18T23:41:11.941752+0000","last_unstale":"2023-11-18T23:41:13.171508+0000","last_undegraded":"2023-11-18T23:41:13.171508+0000","last_fullsized":"2023-11-18T23:41:13.171508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:11:31.341988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255767+0000","last_change":"2023-11-18T23:41:10.948626+0000","last_active":"2023-11-18T23:41:13.255767+0000","last_peered":"2023-11-18T23:41:13.255767+0000","last_clean":"2023-11-18T23:41:13.255767+0000","last_became_active":"2023-11-18T23:41:10.948356+0000","last_became_peered":"2023-11-18T23:41:10.948356+0000","last_unstale":"2023-11-18T23:41:13.255767+0000","last_undegraded":"2023-11-18T23:41:13.255767+0000","last_fullsized":"2023-11-18T23:41:13.255767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:29.273521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703110+0000","last_change":"2023-11-18T23:41:11.945196+0000","last_active":"2023-11-18T23:41:13.703110+0000","last_peered":"2023-11-18T23:41:13.703110+0000","last_clean":"2023-11-18T23:41:13.703110+0000","last_became_active":"2023-11-18T23:41:11.944330+0000","last_became_peered":"2023-11-18T23:41:11.944330+0000","last_unstale":"2023-11-18T23:41:13.703110+0000","last_undegraded":"2023-11-18T23:41:13.703110+0000","last_fullsized":"2023-11-18T23:41:13.703110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:20:48.427837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.261983+0000","last_change":"2023-11-18T23:41:10.949827+0000","last_active":"2023-11-18T23:41:13.261983+0000","last_peered":"2023-11-18T23:41:13.261983+0000","last_clean":"2023-11-18T23:41:13.261983+0000","last_became_active":"2023-11-18T23:41:10.949513+0000","last_became_peered":"2023-11-18T23:41:10.949513+0000","last_unstale":"2023-11-18T23:41:13.261983+0000","last_undegraded":"2023-11-18T23:41:13.261983+0000","last_fullsized":"2023-11-18T23:41:13.261983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:08.933359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171323+0000","last_change":"2023-11-18T23:41:11.942116+0000","last_active":"2023-11-18T23:41:13.171323+0000","last_peered":"2023-11-18T23:41:13.171323+0000","last_clean":"2023-11-18T23:41:13.171323+0000","last_became_active":"2023-11-18T23:41:11.940777+0000","last_became_peered":"2023-11-18T23:41:11.940777+0000","last_unstale":"2023-11-18T23:41:13.171323+0000","last_undegraded":"2023-11-18T23:41:13.171323+0000","last_fullsized":"2023-11-18T23:41:13.171323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.256384+0000","last_change":"2023-11-18T23:41:10.952130+0000","last_active":"2023-11-18T23:41:13.256384+0000","last_peered":"2023-11-18T23:41:13.256384+0000","last_clean":"2023-11-18T23:41:13.256384+0000","last_became_active":"2023-11-18T23:41:10.951783+0000","last_became_peered":"2023-11-18T23:41:10.951783+0000","last_unstale":"2023-11-18T23:41:13.256384+0000","last_undegraded":"2023-11-18T23:41:13.256384+0000","last_fullsized":"2023-11-18T23:41:13.256384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171739+0000","last_change":"2023-11-18T23:41:11.941524+0000","last_active":"2023-11-18T23:41:13.171739+0000","last_peered":"2023-11-18T23:41:13.171739+0000","last_clean":"2023-11-18T23:41:13.171739+0000","last_became_active":"2023-11-18T23:41:11.941261+0000","last_became_peered":"2023-11-18T23:41:11.941261+0000","last_unstale":"2023-11-18T23:41:13.171739+0000","last_undegraded":"2023-11-18T23:41:13.171739+0000","last_fullsized":"2023-11-18T23:41:13.171739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:47:33.609920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.262082+0000","last_change":"2023-11-18T23:41:10.948977+0000","last_active":"2023-11-18T23:41:13.262082+0000","last_peered":"2023-11-18T23:41:13.262082+0000","last_clean":"2023-11-18T23:41:13.262082+0000","last_became_active":"2023-11-18T23:41:10.948618+0000","last_became_peered":"2023-11-18T23:41:10.948618+0000","last_unstale":"2023-11-18T23:41:13.262082+0000","last_undegraded":"2023-11-18T23:41:13.262082+0000","last_fullsized":"2023-11-18T23:41:13.262082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:05.668218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171873+0000","last_change":"2023-11-18T23:41:11.945585+0000","last_active":"2023-11-18T23:41:13.171873+0000","last_peered":"2023-11-18T23:41:13.171873+0000","last_clean":"2023-11-18T23:41:13.171873+0000","last_became_active":"2023-11-18T23:41:11.945267+0000","last_became_peered":"2023-11-18T23:41:11.945267+0000","last_unstale":"2023-11-18T23:41:13.171873+0000","last_undegraded":"2023-11-18T23:41:13.171873+0000","last_fullsized":"2023-11-18T23:41:13.171873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:07:32.618829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259535+0000","last_change":"2023-11-18T23:41:10.948326+0000","last_active":"2023-11-18T23:41:13.259535+0000","last_peered":"2023-11-18T23:41:13.259535+0000","last_clean":"2023-11-18T23:41:13.259535+0000","last_became_active":"2023-11-18T23:41:10.947924+0000","last_became_peered":"2023-11-18T23:41:10.947924+0000","last_unstale":"2023-11-18T23:41:13.259535+0000","last_undegraded":"2023-11-18T23:41:13.259535+0000","last_fullsized":"2023-11-18T23:41:13.259535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:45.118819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926090+0000","last_change":"2023-11-18T23:41:11.941133+0000","last_active":"2023-11-18T23:41:12.926090+0000","last_peered":"2023-11-18T23:41:12.926090+0000","last_clean":"2023-11-18T23:41:12.926090+0000","last_became_active":"2023-11-18T23:41:11.940871+0000","last_became_peered":"2023-11-18T23:41:11.940871+0000","last_unstale":"2023-11-18T23:41:12.926090+0000","last_undegraded":"2023-11-18T23:41:12.926090+0000","last_fullsized":"2023-11-18T23:41:12.926090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:15.686166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.262045+0000","last_change":"2023-11-18T23:41:10.951625+0000","last_active":"2023-11-18T23:41:13.262045+0000","last_peered":"2023-11-18T23:41:13.262045+0000","last_clean":"2023-11-18T23:41:13.262045+0000","last_became_active":"2023-11-18T23:41:10.951341+0000","last_became_peered":"2023-11-18T23:41:10.951341+0000","last_unstale":"2023-11-18T23:41:13.262045+0000","last_undegraded":"2023-11-18T23:41:13.262045+0000","last_fullsized":"2023-11-18T23:41:13.262045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:38:04.663481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171564+0000","last_change":"2023-11-18T23:41:11.946155+0000","last_active":"2023-11-18T23:41:13.171564+0000","last_peered":"2023-11-18T23:41:13.171564+0000","last_clean":"2023-11-18T23:41:13.171564+0000","last_became_active":"2023-11-18T23:41:11.945888+0000","last_became_peered":"2023-11-18T23:41:11.945888+0000","last_unstale":"2023-11-18T23:41:13.171564+0000","last_undegraded":"2023-11-18T23:41:13.171564+0000","last_fullsized":"2023-11-18T23:41:13.171564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:44:55.662121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:11.935408+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:41:11.935408+0000","last_peered":"2023-11-18T23:41:11.935408+0000","last_clean":"2023-11-18T23:41:11.935408+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:41:11.935408+0000","last_undegraded":"2023-11-18T23:41:11.935408+0000","last_fullsized":"2023-11-18T23:41:11.935408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925730+0000","last_change":"2023-11-18T23:41:10.950732+0000","last_active":"2023-11-18T23:41:12.925730+0000","last_peered":"2023-11-18T23:41:12.925730+0000","last_clean":"2023-11-18T23:41:12.925730+0000","last_became_active":"2023-11-18T23:41:10.950412+0000","last_became_peered":"2023-11-18T23:41:10.950412+0000","last_unstale":"2023-11-18T23:41:12.925730+0000","last_undegraded":"2023-11-18T23:41:12.925730+0000","last_fullsized":"2023-11-18T23:41:12.925730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925876+0000","last_change":"2023-11-18T23:41:11.944801+0000","last_active":"2023-11-18T23:41:12.925876+0000","last_peered":"2023-11-18T23:41:12.925876+0000","last_clean":"2023-11-18T23:41:12.925876+0000","last_became_active":"2023-11-18T23:41:11.944571+0000","last_became_peered":"2023-11-18T23:41:11.944571+0000","last_unstale":"2023-11-18T23:41:12.925876+0000","last_undegraded":"2023-11-18T23:41:12.925876+0000","last_fullsized":"2023-11-18T23:41:12.925876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:07.781186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.953232+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.952918+0000","last_became_peered":"2023-11-18T23:41:10.952918+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924571+0000","last_change":"2023-11-18T23:41:11.936302+0000","last_active":"2023-11-18T23:41:12.924571+0000","last_peered":"2023-11-18T23:41:12.924571+0000","last_clean":"2023-11-18T23:41:12.924571+0000","last_became_active":"2023-11-18T23:41:11.935466+0000","last_became_peered":"2023-11-18T23:41:11.935466+0000","last_unstale":"2023-11-18T23:41:12.924571+0000","last_undegraded":"2023-11-18T23:41:12.924571+0000","last_fullsized":"2023-11-18T23:41:12.924571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:30.278282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.262026+0000","last_change":"2023-11-18T23:41:10.949423+0000","last_active":"2023-11-18T23:41:13.262026+0000","last_peered":"2023-11-18T23:41:13.262026+0000","last_clean":"2023-11-18T23:41:13.262026+0000","last_became_active":"2023-11-18T23:41:10.949116+0000","last_became_peered":"2023-11-18T23:41:10.949116+0000","last_unstale":"2023-11-18T23:41:13.262026+0000","last_undegraded":"2023-11-18T23:41:13.262026+0000","last_fullsized":"2023-11-18T23:41:13.262026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703610+0000","last_change":"2023-11-18T23:41:11.938131+0000","last_active":"2023-11-18T23:41:13.703610+0000","last_peered":"2023-11-18T23:41:13.703610+0000","last_clean":"2023-11-18T23:41:13.703610+0000","last_became_active":"2023-11-18T23:41:11.937846+0000","last_became_peered":"2023-11-18T23:41:11.937846+0000","last_unstale":"2023-11-18T23:41:13.703610+0000","last_undegraded":"2023-11-18T23:41:13.703610+0000","last_fullsized":"2023-11-18T23:41:13.703610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926059+0000","last_change":"2023-11-18T23:41:10.940990+0000","last_active":"2023-11-18T23:41:12.926059+0000","last_peered":"2023-11-18T23:41:12.926059+0000","last_clean":"2023-11-18T23:41:12.926059+0000","last_became_active":"2023-11-18T23:41:10.940710+0000","last_became_peered":"2023-11-18T23:41:10.940710+0000","last_unstale":"2023-11-18T23:41:12.926059+0000","last_undegraded":"2023-11-18T23:41:12.926059+0000","last_fullsized":"2023-11-18T23:41:12.926059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:19.427443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703758+0000","last_change":"2023-11-18T23:41:11.938142+0000","last_active":"2023-11-18T23:41:13.703758+0000","last_peered":"2023-11-18T23:41:13.703758+0000","last_clean":"2023-11-18T23:41:13.703758+0000","last_became_active":"2023-11-18T23:41:11.937563+0000","last_became_peered":"2023-11-18T23:41:11.937563+0000","last_unstale":"2023-11-18T23:41:13.703758+0000","last_undegraded":"2023-11-18T23:41:13.703758+0000","last_fullsized":"2023-11-18T23:41:13.703758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:42:00.578989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259503+0000","last_change":"2023-11-18T23:41:10.949142+0000","last_active":"2023-11-18T23:41:13.259503+0000","last_peered":"2023-11-18T23:41:13.259503+0000","last_clean":"2023-11-18T23:41:13.259503+0000","last_became_active":"2023-11-18T23:41:10.948855+0000","last_became_peered":"2023-11-18T23:41:10.948855+0000","last_unstale":"2023-11-18T23:41:13.259503+0000","last_undegraded":"2023-11-18T23:41:13.259503+0000","last_fullsized":"2023-11-18T23:41:13.259503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:03.847100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926199+0000","last_change":"2023-11-18T23:41:11.941744+0000","last_active":"2023-11-18T23:41:12.926199+0000","last_peered":"2023-11-18T23:41:12.926199+0000","last_clean":"2023-11-18T23:41:12.926199+0000","last_became_active":"2023-11-18T23:41:11.941469+0000","last_became_peered":"2023-11-18T23:41:11.941469+0000","last_unstale":"2023-11-18T23:41:12.926199+0000","last_undegraded":"2023-11-18T23:41:12.926199+0000","last_fullsized":"2023-11-18T23:41:12.926199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:01:42.978975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171719+0000","last_change":"2023-11-18T23:41:10.955650+0000","last_active":"2023-11-18T23:41:13.171719+0000","last_peered":"2023-11-18T23:41:13.171719+0000","last_clean":"2023-11-18T23:41:13.171719+0000","last_became_active":"2023-11-18T23:41:10.955331+0000","last_became_peered":"2023-11-18T23:41:10.955331+0000","last_unstale":"2023-11-18T23:41:13.171719+0000","last_undegraded":"2023-11-18T23:41:13.171719+0000","last_fullsized":"2023-11-18T23:41:13.171719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:03:50.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703828+0000","last_change":"2023-11-18T23:41:11.934954+0000","last_active":"2023-11-18T23:41:13.703828+0000","last_peered":"2023-11-18T23:41:13.703828+0000","last_clean":"2023-11-18T23:41:13.703828+0000","last_became_active":"2023-11-18T23:41:11.934651+0000","last_became_peered":"2023-11-18T23:41:11.934651+0000","last_unstale":"2023-11-18T23:41:13.703828+0000","last_undegraded":"2023-11-18T23:41:13.703828+0000","last_fullsized":"2023-11-18T23:41:13.703828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.704032+0000","last_change":"2023-11-18T23:41:10.947031+0000","last_active":"2023-11-18T23:41:13.704032+0000","last_peered":"2023-11-18T23:41:13.704032+0000","last_clean":"2023-11-18T23:41:13.704032+0000","last_became_active":"2023-11-18T23:41:10.946758+0000","last_became_peered":"2023-11-18T23:41:10.946758+0000","last_unstale":"2023-11-18T23:41:13.704032+0000","last_undegraded":"2023-11-18T23:41:13.704032+0000","last_fullsized":"2023-11-18T23:41:13.704032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925991+0000","last_change":"2023-11-18T23:41:11.941903+0000","last_active":"2023-11-18T23:41:12.925991+0000","last_peered":"2023-11-18T23:41:12.925991+0000","last_clean":"2023-11-18T23:41:12.925991+0000","last_became_active":"2023-11-18T23:41:11.941319+0000","last_became_peered":"2023-11-18T23:41:11.941319+0000","last_unstale":"2023-11-18T23:41:12.925991+0000","last_undegraded":"2023-11-18T23:41:12.925991+0000","last_fullsized":"2023-11-18T23:41:12.925991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:33.771527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.255907+0000","last_change":"2023-11-18T23:41:10.953396+0000","last_active":"2023-11-18T23:41:13.255907+0000","last_peered":"2023-11-18T23:41:13.255907+0000","last_clean":"2023-11-18T23:41:13.255907+0000","last_became_active":"2023-11-18T23:41:10.952840+0000","last_became_peered":"2023-11-18T23:41:10.952840+0000","last_unstale":"2023-11-18T23:41:13.255907+0000","last_undegraded":"2023-11-18T23:41:13.255907+0000","last_fullsized":"2023-11-18T23:41:13.255907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924847+0000","last_change":"2023-11-18T23:41:11.938451+0000","last_active":"2023-11-18T23:41:12.924847+0000","last_peered":"2023-11-18T23:41:12.924847+0000","last_clean":"2023-11-18T23:41:12.924847+0000","last_became_active":"2023-11-18T23:41:11.938166+0000","last_became_peered":"2023-11-18T23:41:11.938166+0000","last_unstale":"2023-11-18T23:41:12.924847+0000","last_undegraded":"2023-11-18T23:41:12.924847+0000","last_fullsized":"2023-11-18T23:41:12.924847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:26.765656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171121+0000","last_change":"2023-11-18T23:41:10.955647+0000","last_active":"2023-11-18T23:41:13.171121+0000","last_peered":"2023-11-18T23:41:13.171121+0000","last_clean":"2023-11-18T23:41:13.171121+0000","last_became_active":"2023-11-18T23:41:10.955339+0000","last_became_peered":"2023-11-18T23:41:10.955339+0000","last_unstale":"2023-11-18T23:41:13.171121+0000","last_undegraded":"2023-11-18T23:41:13.171121+0000","last_fullsized":"2023-11-18T23:41:13.171121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:34:33.115860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703647+0000","last_change":"2023-11-18T23:41:11.935837+0000","last_active":"2023-11-18T23:41:13.703647+0000","last_peered":"2023-11-18T23:41:13.703647+0000","last_clean":"2023-11-18T23:41:13.703647+0000","last_became_active":"2023-11-18T23:41:11.935574+0000","last_became_peered":"2023-11-18T23:41:11.935574+0000","last_unstale":"2023-11-18T23:41:13.703647+0000","last_undegraded":"2023-11-18T23:41:13.703647+0000","last_fullsized":"2023-11-18T23:41:13.703647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:37:06.672979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259470+0000","last_change":"2023-11-18T23:41:10.952633+0000","last_active":"2023-11-18T23:41:13.259470+0000","last_peered":"2023-11-18T23:41:13.259470+0000","last_clean":"2023-11-18T23:41:13.259470+0000","last_became_active":"2023-11-18T23:41:10.952172+0000","last_became_peered":"2023-11-18T23:41:10.952172+0000","last_unstale":"2023-11-18T23:41:13.259470+0000","last_undegraded":"2023-11-18T23:41:13.259470+0000","last_fullsized":"2023-11-18T23:41:13.259470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926000+0000","last_change":"2023-11-18T23:41:11.935331+0000","last_active":"2023-11-18T23:41:12.926000+0000","last_peered":"2023-11-18T23:41:12.926000+0000","last_clean":"2023-11-18T23:41:12.926000+0000","last_became_active":"2023-11-18T23:41:11.935022+0000","last_became_peered":"2023-11-18T23:41:11.935022+0000","last_unstale":"2023-11-18T23:41:12.926000+0000","last_undegraded":"2023-11-18T23:41:12.926000+0000","last_fullsized":"2023-11-18T23:41:12.926000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:05.042791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.259480+0000","last_change":"2023-11-18T23:41:10.942836+0000","last_active":"2023-11-18T23:41:13.259480+0000","last_peered":"2023-11-18T23:41:13.259480+0000","last_clean":"2023-11-18T23:41:13.259480+0000","last_became_active":"2023-11-18T23:41:10.942491+0000","last_became_peered":"2023-11-18T23:41:10.942491+0000","last_unstale":"2023-11-18T23:41:13.259480+0000","last_undegraded":"2023-11-18T23:41:13.259480+0000","last_fullsized":"2023-11-18T23:41:13.259480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:59:12.831977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926129+0000","last_change":"2023-11-18T23:41:11.937215+0000","last_active":"2023-11-18T23:41:12.926129+0000","last_peered":"2023-11-18T23:41:12.926129+0000","last_clean":"2023-11-18T23:41:12.926129+0000","last_became_active":"2023-11-18T23:41:11.936805+0000","last_became_peered":"2023-11-18T23:41:11.936805+0000","last_unstale":"2023-11-18T23:41:12.926129+0000","last_undegraded":"2023-11-18T23:41:12.926129+0000","last_fullsized":"2023-11-18T23:41:12.926129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:26.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171642+0000","last_change":"2023-11-18T23:41:10.954159+0000","last_active":"2023-11-18T23:41:13.171642+0000","last_peered":"2023-11-18T23:41:13.171642+0000","last_clean":"2023-11-18T23:41:13.171642+0000","last_became_active":"2023-11-18T23:41:10.953615+0000","last_became_peered":"2023-11-18T23:41:10.953615+0000","last_unstale":"2023-11-18T23:41:13.171642+0000","last_undegraded":"2023-11-18T23:41:13.171642+0000","last_fullsized":"2023-11-18T23:41:13.171642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:25.760895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.703226+0000","last_change":"2023-11-18T23:41:11.936655+0000","last_active":"2023-11-18T23:41:13.703226+0000","last_peered":"2023-11-18T23:41:13.703226+0000","last_clean":"2023-11-18T23:41:13.703226+0000","last_became_active":"2023-11-18T23:41:11.936383+0000","last_became_peered":"2023-11-18T23:41:11.936383+0000","last_unstale":"2023-11-18T23:41:13.703226+0000","last_undegraded":"2023-11-18T23:41:13.703226+0000","last_fullsized":"2023-11-18T23:41:13.703226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926177+0000","last_change":"2023-11-18T23:41:11.932101+0000","last_active":"2023-11-18T23:41:12.926177+0000","last_peered":"2023-11-18T23:41:12.926177+0000","last_clean":"2023-11-18T23:41:12.926177+0000","last_became_active":"2023-11-18T23:41:11.931783+0000","last_became_peered":"2023-11-18T23:41:11.931783+0000","last_unstale":"2023-11-18T23:41:12.926177+0000","last_undegraded":"2023-11-18T23:41:12.926177+0000","last_fullsized":"2023-11-18T23:41:12.926177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:41.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171386+0000","last_change":"2023-11-18T23:41:10.952684+0000","last_active":"2023-11-18T23:41:13.171386+0000","last_peered":"2023-11-18T23:41:13.171386+0000","last_clean":"2023-11-18T23:41:13.171386+0000","last_became_active":"2023-11-18T23:41:10.952350+0000","last_became_peered":"2023-11-18T23:41:10.952350+0000","last_unstale":"2023-11-18T23:41:13.171386+0000","last_undegraded":"2023-11-18T23:41:13.171386+0000","last_fullsized":"2023-11-18T23:41:13.171386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:59.574228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925917+0000","last_change":"2023-11-18T23:41:11.936793+0000","last_active":"2023-11-18T23:41:12.925917+0000","last_peered":"2023-11-18T23:41:12.925917+0000","last_clean":"2023-11-18T23:41:12.925917+0000","last_became_active":"2023-11-18T23:41:11.936505+0000","last_became_peered":"2023-11-18T23:41:11.936505+0000","last_unstale":"2023-11-18T23:41:12.925917+0000","last_undegraded":"2023-11-18T23:41:12.925917+0000","last_fullsized":"2023-11-18T23:41:12.925917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:22:25.996759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:13.171615+0000","last_change":"2023-11-18T23:41:10.952889+0000","last_active":"2023-11-18T23:41:13.171615+0000","last_peered":"2023-11-18T23:41:13.171615+0000","last_clean":"2023-11-18T23:41:13.171615+0000","last_became_active":"2023-11-18T23:41:10.952351+0000","last_became_peered":"2023-11-18T23:41:10.952351+0000","last_unstale":"2023-11-18T23:41:13.171615+0000","last_undegraded":"2023-11-18T23:41:13.171615+0000","last_fullsized":"2023-11-18T23:41:13.171615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:03:35.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.924965+0000","last_change":"2023-11-18T23:41:11.932536+0000","last_active":"2023-11-18T23:41:12.924965+0000","last_peered":"2023-11-18T23:41:12.924965+0000","last_clean":"2023-11-18T23:41:12.924965+0000","last_became_active":"2023-11-18T23:41:11.931747+0000","last_became_peered":"2023-11-18T23:41:11.931747+0000","last_unstale":"2023-11-18T23:41:12.924965+0000","last_undegraded":"2023-11-18T23:41:12.924965+0000","last_fullsized":"2023-11-18T23:41:12.924965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:43:20.432204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926169+0000","last_change":"2023-11-18T23:41:10.948118+0000","last_active":"2023-11-18T23:41:12.926169+0000","last_peered":"2023-11-18T23:41:12.926169+0000","last_clean":"2023-11-18T23:41:12.926169+0000","last_became_active":"2023-11-18T23:41:10.947802+0000","last_became_peered":"2023-11-18T23:41:10.947802+0000","last_unstale":"2023-11-18T23:41:12.926169+0000","last_undegraded":"2023-11-18T23:41:12.926169+0000","last_fullsized":"2023-11-18T23:41:12.926169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.926158+0000","last_change":"2023-11-18T23:41:11.939056+0000","last_active":"2023-11-18T23:41:12.926158+0000","last_peered":"2023-11-18T23:41:12.926158+0000","last_clean":"2023-11-18T23:41:12.926158+0000","last_became_active":"2023-11-18T23:41:11.938752+0000","last_became_peered":"2023-11-18T23:41:11.938752+0000","last_unstale":"2023-11-18T23:41:12.926158+0000","last_undegraded":"2023-11-18T23:41:12.926158+0000","last_fullsized":"2023-11-18T23:41:12.926158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:10.929190+0000","last_clean_scrub_stamp":"2023-11-18T23:41:10.929190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:28:32.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-18T23:41:12.925052+0000","last_change":"2023-11-18T23:41:10.954940+0000","last_active":"2023-11-18T23:41:12.925052+0000","last_peered":"2023-11-18T23:41:12.925052+0000","last_clean":"2023-11-18T23:41:12.925052+0000","last_became_active":"2023-11-18T23:41:10.954216+0000","last_became_peered":"2023-11-18T23:41:10.954216+0000","last_unstale":"2023-11-18T23:41:12.925052+0000","last_undegraded":"2023-11-18T23:41:12.925052+0000","last_fullsized":"2023-11-18T23:41:12.925052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:41:09.924429+0000","last_clean_scrub_stamp":"2023-11-18T23:41:09.924429+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:34:59.346406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:41:22.059 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-18T23:41:22.059 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-18T23:41:22.059 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-18T23:41:22.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-18T23:41:22.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.200+0000 7f5400639640 1 Processor -- start 2023-11-18T23:41:22.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.200+0000 7f5400639640 1 -- start start 2023-11-18T23:41:22.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f5400639640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f53f815d900 0x7f53f8099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f5400639640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f80b1de0 0x7f53f8099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f5400639640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f80b0660 con 0x7f53f80b2610 2023-11-18T23:41:22.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f5400639640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f806c900 con 0x7f53f815d900 2023-11-18T23:41:22.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f5400639640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f806cbe0 con 0x7f53f80b1de0 2023-11-18T23:41:22.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f53febd6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f80b1de0 0x7f53f8099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f53fe3d5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f53f815d900 0x7f53f8099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f53fdbd4640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f53f80b2610 0x7f53f80cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:44816/0 (socket says 172.21.15.8:44816) 2023-11-18T23:41:22.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f53fe3d5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f53f815d900 0x7f53f8099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:53772/0 (socket says 172.21.15.8:53772) 2023-11-18T23:41:22.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f53fdbd4640 1 -- 172.21.15.8:0/4139631071 learned_addr learned my addr 172.21.15.8:0/4139631071 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:22.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.201+0000 7f53febd6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f80b1de0 0x7f53f8099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.8:55542/0 (socket says 172.21.15.8:55542) 2023-11-18T23:41:22.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.202+0000 7f53fe3d5640 1 -- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f80b1de0 msgr2=0x7f53f8099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:22.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.202+0000 7f53fe3d5640 1 --2- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f80b1de0 0x7f53f8099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.202+0000 7f53fe3d5640 1 -- 172.21.15.8:0/4139631071 >> v1:172.21.15.116:6789/0 conn(0x7f53f80b2610 legacy=0x7f53f80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.202+0000 7f53fe3d5640 1 -- 172.21.15.8:0/4139631071 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f806cec0 con 0x7f53f815d900 2023-11-18T23:41:22.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.202+0000 7f53febd6640 1 --2- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f80b1de0 0x7f53f8099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.202+0000 7f53fe3d5640 1 --2- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f815d900 0x7f53f8099970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009d90 tx=0x7f53f002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28ea936b5d3f4cd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f53fd3d3640 1 -- 172.21.15.8:0/4139631071 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f002cc50 con 0x7f53f815d900 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f53fd3d3640 1 -- 172.21.15.8:0/4139631071 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f002cdb0 con 0x7f53f815d900 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f53fd3d3640 1 -- 172.21.15.8:0/4139631071 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0034660 con 0x7f53f815d900 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 -- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f815d900 msgr2=0x7f53f8099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 --2- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f815d900 0x7f53f8099970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009d90 tx=0x7f53f002bea0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 -- 172.21.15.8:0/4139631071 shutdown_connections 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 --2- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f80b1de0 0x7f53f8099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 --2- 172.21.15.8:0/4139631071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f815d900 0x7f53f8099970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 -- 172.21.15.8:0/4139631071 >> 172.21.15.8:0/4139631071 conn(0x7f53f80b2a70 msgr2=0x7f53f80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 -- 172.21.15.8:0/4139631071 shutdown_connections 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.203+0000 7f5400639640 1 -- 172.21.15.8:0/4139631071 wait complete. 2023-11-18T23:41:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.204+0000 7f5400639640 1 Processor -- start 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.204+0000 7f5400639640 1 -- start start 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f5400639640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f80b1de0 0x7f53f81f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f5400639640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53f80b2610 0x7f53f81f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f5400639640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f815d900 0x7f53f81f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f5400639640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8152d70 con 0x7f53f80b2610 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f5400639640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80c8c90 con 0x7f53f80b1de0 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f5400639640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80b4090 con 0x7f53f815d900 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f53fdbd4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53f80b2610 0x7f53f81f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f53fdbd4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53f80b2610 0x7f53f81f6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48732/0 (socket says 172.21.15.8:48732) 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f53fdbd4640 1 -- 172.21.15.8:0/730383762 learned_addr learned my addr 172.21.15.8:0/730383762 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f53fe3d5640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f80b1de0 0x7f53f81f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.205+0000 7f53febd6640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f815d900 0x7f53f81f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53fdbd4640 1 -- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f815d900 msgr2=0x7f53f81f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53fdbd4640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f815d900 0x7f53f81f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53fdbd4640 1 -- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f80b1de0 msgr2=0x7f53f81f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53fdbd4640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f80b1de0 0x7f53f81f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53fdbd4640 1 -- 172.21.15.8:0/730383762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8009400 con 0x7f53f80b2610 2023-11-18T23:41:22.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53febd6640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f815d900 0x7f53f81f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53fdbd4640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53f80b2610 0x7f53f81f6880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c390 tx=0x7f53ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53f6ffd640 1 -- 172.21.15.8:0/730383762 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec005ce0 con 0x7f53f80b2610 2023-11-18T23:41:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53f6ffd640 1 -- 172.21.15.8:0/730383762 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec005e40 con 0x7f53f80b2610 2023-11-18T23:41:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f53f6ffd640 1 -- 172.21.15.8:0/730383762 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0072d0 con 0x7f53f80b2610 2023-11-18T23:41:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f0009a70 con 0x7f53f80b2610 2023-11-18T23:41:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.206+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f80c91c0 con 0x7f53f80b2610 2023-11-18T23:41:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.207+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f8067420 con 0x7f53f80b2610 2023-11-18T23:41:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.208+0000 7f53f6ffd640 1 -- 172.21.15.8:0/730383762 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53ec007430 con 0x7f53f80b2610 2023-11-18T23:41:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.208+0000 7f53f6ffd640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f53e406ae40 0x7f53e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.208+0000 7f53f6ffd640 1 -- 172.21.15.8:0/730383762 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53ec088a40 con 0x7f53f80b2610 2023-11-18T23:41:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.208+0000 7f53fe3d5640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f53e406ae40 0x7f53e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.209+0000 7f53fe3d5640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f53e406ae40 0x7f53e406d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53f0036000 tx=0x7f53f0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.213+0000 7f53f6ffd640 1 -- 172.21.15.8:0/730383762 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53ec08ae60 con 0x7f53f80b2610 2023-11-18T23:41:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.425+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f53f80b00c0 con 0x7f53f80b2610 2023-11-18T23:41:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.426+0000 7f53f6ffd640 1 -- 172.21.15.8:0/730383762 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f53ec017040 con 0x7f53f80b2610 2023-11-18T23:41:22.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:22.427 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-18T23:41:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.427+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f53e406ae40 msgr2=0x7f53e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.427+0000 7f5400639640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f53e406ae40 0x7f53e406d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53f0036000 tx=0x7f53f0030000 comp rx=0 tx=0).stop 2023-11-18T23:41:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53f80b2610 msgr2=0x7f53f81f6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53f80b2610 0x7f53f81f6880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c390 tx=0x7f53ec00c850 comp rx=0 tx=0).stop 2023-11-18T23:41:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 shutdown_connections 2023-11-18T23:41:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f53e406ae40 0x7f53e406d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53f815d900 0x7f53f81f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53f80b2610 0x7f53f81f6880 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 --2- 172.21.15.8:0/730383762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53f80b1de0 0x7f53f81f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 >> 172.21.15.8:0/730383762 conn(0x7f53f80b2a70 msgr2=0x7f53f806f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 shutdown_connections 2023-11-18T23:41:22.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.428+0000 7f5400639640 1 -- 172.21.15.8:0/730383762 wait complete. 2023-11-18T23:41:22.440 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-18T23:41:22.440 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:22.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.545+0000 7fc01e6a2640 1 Processor -- start 2023-11-18T23:41:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.545+0000 7fc01e6a2640 1 -- start start 2023-11-18T23:41:22.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01e6a2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc0180d30e0 0x7fc0180d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01e6a2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0180b39b0 0x7fc0180b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01e6a2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0180cf260 con 0x7fc01815d460 2023-11-18T23:41:22.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01e6a2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0180d3ab0 con 0x7fc0180b39b0 2023-11-18T23:41:22.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01e6a2640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0180ceca0 con 0x7fc0180d30e0 2023-11-18T23:41:22.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01cc3f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0180b39b0 0x7fc0180b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01cc3f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0180b39b0 0x7fc0180b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48742/0 (socket says 172.21.15.8:48742) 2023-11-18T23:41:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01cc3f640 1 -- 172.21.15.8:0/3627847226 learned_addr learned my addr 172.21.15.8:0/3627847226 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc0177fe640 1 --2- 172.21.15.8:0/3627847226 >> v2:172.21.15.116:3300/0 conn(0x7fc0180d30e0 0x7fc0180d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01cc3f640 1 -- 172.21.15.8:0/3627847226 >> v2:172.21.15.116:3300/0 conn(0x7fc0180d30e0 msgr2=0x7fc0180d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01cc3f640 1 --2- 172.21.15.8:0/3627847226 >> v2:172.21.15.116:3300/0 conn(0x7fc0180d30e0 0x7fc0180d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01cc3f640 1 -- 172.21.15.8:0/3627847226 >> v1:172.21.15.116:6789/0 conn(0x7fc01815d460 legacy=0x7fc0180d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.546+0000 7fc01cc3f640 1 -- 172.21.15.8:0/3627847226 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0180cef80 con 0x7fc0180b39b0 2023-11-18T23:41:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.547+0000 7fc01cc3f640 1 --2- 172.21.15.8:0/3627847226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180b39b0 0x7fc0180b3e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc010009e50 tx=0x7fc01002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c1cfbe455851a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.547+0000 7fc016ffd640 1 -- 172.21.15.8:0/3627847226 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01002c9f0 con 0x7fc0180b39b0 2023-11-18T23:41:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.547+0000 7fc016ffd640 1 -- 172.21.15.8:0/3627847226 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01002cb50 con 0x7fc0180b39b0 2023-11-18T23:41:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.547+0000 7fc016ffd640 1 -- 172.21.15.8:0/3627847226 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100343f0 con 0x7fc0180b39b0 2023-11-18T23:41:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.547+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3627847226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180b39b0 msgr2=0x7fc0180b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.547+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3627847226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180b39b0 0x7fc0180b3e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc010009e50 tx=0x7fc01002be50 comp rx=0 tx=0).stop 2023-11-18T23:41:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.548+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3627847226 shutdown_connections 2023-11-18T23:41:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.548+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3627847226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180b39b0 0x7fc0180b3e20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.548+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3627847226 >> v2:172.21.15.116:3300/0 conn(0x7fc0180d30e0 0x7fc0180d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.548+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3627847226 >> 172.21.15.8:0/3627847226 conn(0x7fc01808cb60 msgr2=0x7fc01809c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:22.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.548+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3627847226 shutdown_connections 2023-11-18T23:41:22.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.548+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3627847226 wait complete. 2023-11-18T23:41:22.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.549+0000 7fc01e6a2640 1 Processor -- start 2023-11-18T23:41:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.549+0000 7fc01e6a2640 1 -- start start 2023-11-18T23:41:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01e6a2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc0180b39b0 0x7fc0180ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01e6a2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180d30e0 0x7fc0180ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01e6a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc01815d460 0x7fc0180cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01e6a2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180cd5c0 con 0x7fc0180d30e0 2023-11-18T23:41:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01e6a2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01814d550 con 0x7fc01815d460 2023-11-18T23:41:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01e6a2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01814d830 con 0x7fc0180b39b0 2023-11-18T23:41:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180d30e0 0x7fc0180ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180d30e0 0x7fc0180ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48744/0 (socket says 172.21.15.8:48744) 2023-11-18T23:41:22.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 -- 172.21.15.8:0/3885381090 learned_addr learned my addr 172.21.15.8:0/3885381090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:22.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc017fff640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc0180b39b0 0x7fc0180ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01cc3f640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc01815d460 0x7fc0180cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 -- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc0180b39b0 msgr2=0x7fc0180ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc0180b39b0 0x7fc0180ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 -- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc01815d460 msgr2=0x7fc0180cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc01815d460 0x7fc0180cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 -- 172.21.15.8:0/3885381090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010009b30 con 0x7fc0180d30e0 2023-11-18T23:41:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc0177fe640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180d30e0 0x7fc0180ccb40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00d800 tx=0x7fc00c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc014ff9640 1 -- 172.21.15.8:0/3885381090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00b6c0 con 0x7fc0180d30e0 2023-11-18T23:41:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc014ff9640 1 -- 172.21.15.8:0/3885381090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00b820 con 0x7fc0180d30e0 2023-11-18T23:41:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01814db10 con 0x7fc0180d30e0 2023-11-18T23:41:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.550+0000 7fc014ff9640 1 -- 172.21.15.8:0/3885381090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00bbb0 con 0x7fc0180d30e0 2023-11-18T23:41:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.551+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01814e0d0 con 0x7fc0180d30e0 2023-11-18T23:41:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.551+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc018067420 con 0x7fc0180d30e0 2023-11-18T23:41:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.552+0000 7fc014ff9640 1 -- 172.21.15.8:0/3885381090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc00c00bd10 con 0x7fc0180d30e0 2023-11-18T23:41:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.552+0000 7fc014ff9640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc00406ae40 0x7fc00406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.552+0000 7fc014ff9640 1 -- 172.21.15.8:0/3885381090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc00c089b20 con 0x7fc0180d30e0 2023-11-18T23:41:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.553+0000 7fc017fff640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc00406ae40 0x7fc00406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.553+0000 7fc017fff640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc00406ae40 0x7fc00406d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc008004f60 tx=0x7fc008007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.557+0000 7fc014ff9640 1 -- 172.21.15.8:0/3885381090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc00c054be0 con 0x7fc0180d30e0 2023-11-18T23:41:22.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.734+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0180c97b0 con 0x7fc0180d30e0 2023-11-18T23:41:22.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.735+0000 7fc014ff9640 1 -- 172.21.15.8:0/3885381090 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fc00c058200 con 0x7fc0180d30e0 2023-11-18T23:41:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:22.737 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc00406ae40 msgr2=0x7fc00406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc00406ae40 0x7fc00406d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc008004f60 tx=0x7fc008007e30 comp rx=0 tx=0).stop 2023-11-18T23:41:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180d30e0 msgr2=0x7fc0180ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180d30e0 0x7fc0180ccb40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00d800 tx=0x7fc00c00dcc0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 shutdown_connections 2023-11-18T23:41:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc00406ae40 0x7fc00406d300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc01815d460 0x7fc0180cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0180d30e0 0x7fc0180ccb40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 --2- 172.21.15.8:0/3885381090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc0180b39b0 0x7fc0180ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 >> 172.21.15.8:0/3885381090 conn(0x7fc01808cb60 msgr2=0x7fc01806ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 shutdown_connections 2023-11-18T23:41:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.737+0000 7fc01e6a2640 1 -- 172.21.15.8:0/3885381090 wait complete. 2023-11-18T23:41:22.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:22.750 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:22.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.859+0000 7f75b55e3640 1 Processor -- start 2023-11-18T23:41:22.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.859+0000 7f75b55e3640 1 -- start start 2023-11-18T23:41:22.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.859+0000 7f75b55e3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f75b00d0240 0x7f75b0168580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.859+0000 7f75b55e3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b00b4b30 con 0x7f75b0160ad0 2023-11-18T23:41:22.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.859+0000 7f75b55e3640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b00d16a0 con 0x7f75b00b2110 2023-11-18T23:41:22.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.859+0000 7f75b55e3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b00d1980 con 0x7f75b00d0240 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75af7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f75b00d0240 0x7f75b0168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75aeffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f75b0160ad0 0x7f75b00b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47820/0 (socket says 172.21.15.8:47820) 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75af7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f75b00d0240 0x7f75b0168580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48752/0 (socket says 172.21.15.8:48752) 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75aeffd640 1 -- 172.21.15.8:0/3471836427 learned_addr learned my addr 172.21.15.8:0/3471836427 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75af7fe640 1 -- 172.21.15.8:0/3471836427 >> v1:172.21.15.116:6789/0 conn(0x7f75b00b2110 legacy=0x7f75b00cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75af7fe640 1 -- 172.21.15.8:0/3471836427 >> v1:172.21.15.8:6789/0 conn(0x7f75b0160ad0 legacy=0x7f75b00b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75af7fe640 1 -- 172.21.15.8:0/3471836427 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b00d1c60 con 0x7f75b00d0240 2023-11-18T23:41:22.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.860+0000 7f75adffb640 1 -- 172.21.15.8:0/3471836427 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120000793 0 0) 0x7f75b00b4b30 con 0x7f75b0160ad0 2023-11-18T23:41:22.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75af7fe640 1 --2- 172.21.15.8:0/3471836427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00d0240 0x7f75b0168580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009d90 tx=0x7f75a002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797dc5967a7c7d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75adffb640 1 -- 172.21.15.8:0/3471836427 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a002cc60 con 0x7f75b00d0240 2023-11-18T23:41:22.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75adffb640 1 -- 172.21.15.8:0/3471836427 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a002cdc0 con 0x7f75b00d0240 2023-11-18T23:41:22.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75adffb640 1 -- 172.21.15.8:0/3471836427 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0034660 con 0x7f75b00d0240 2023-11-18T23:41:22.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75b55e3640 1 -- 172.21.15.8:0/3471836427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00d0240 msgr2=0x7f75b0168580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3471836427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00d0240 0x7f75b0168580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009d90 tx=0x7f75a002beb0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75b55e3640 1 -- 172.21.15.8:0/3471836427 shutdown_connections 2023-11-18T23:41:22.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3471836427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00d0240 0x7f75b0168580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75b55e3640 1 -- 172.21.15.8:0/3471836427 >> 172.21.15.8:0/3471836427 conn(0x7f75b009c500 msgr2=0x7f75b00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:22.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75b55e3640 1 -- 172.21.15.8:0/3471836427 shutdown_connections 2023-11-18T23:41:22.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.861+0000 7f75b55e3640 1 -- 172.21.15.8:0/3471836427 wait complete. 2023-11-18T23:41:22.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 Processor -- start 2023-11-18T23:41:22.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 -- start start 2023-11-18T23:41:22.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00b2110 0x7f75b014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f75b00d0240 0x7f75b009f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75b0160ad0 0x7f75b009fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00cce10 con 0x7f75b00b2110 2023-11-18T23:41:22.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00cc290 con 0x7f75b0160ad0 2023-11-18T23:41:22.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75b55e3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00cc570 con 0x7f75b00d0240 2023-11-18T23:41:22.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75aeffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00b2110 0x7f75b014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.863+0000 7f75aeffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00b2110 0x7f75b014e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48760/0 (socket says 172.21.15.8:48760) 2023-11-18T23:41:22.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75aeffd640 1 -- 172.21.15.8:0/3742099151 learned_addr learned my addr 172.21.15.8:0/3742099151 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:22.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75ae7fc640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f75b00d0240 0x7f75b009f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75af7fe640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75b0160ad0 0x7f75b009fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75aeffd640 1 -- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f75b00d0240 msgr2=0x7f75b009f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75aeffd640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f75b00d0240 0x7f75b009f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75aeffd640 1 -- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75b0160ad0 msgr2=0x7f75b009fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:22.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75aeffd640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75b0160ad0 0x7f75b009fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:22.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75aeffd640 1 -- 172.21.15.8:0/3742099151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009a70 con 0x7f75b00b2110 2023-11-18T23:41:22.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75af7fe640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75b0160ad0 0x7f75b009fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:22.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75aeffd640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00b2110 0x7f75b014e4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c3f0 tx=0x7f75a800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75a77fe640 1 -- 172.21.15.8:0/3742099151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80074e0 con 0x7f75b00b2110 2023-11-18T23:41:22.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75a77fe640 1 -- 172.21.15.8:0/3742099151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8007640 con 0x7f75b00b2110 2023-11-18T23:41:22.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b00cc850 con 0x7f75b00b2110 2023-11-18T23:41:22.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75a77fe640 1 -- 172.21.15.8:0/3742099151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8004a00 con 0x7f75b00b2110 2023-11-18T23:41:22.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.864+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b014ea30 con 0x7f75b00b2110 2023-11-18T23:41:22.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.865+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b009cf00 con 0x7f75b00b2110 2023-11-18T23:41:22.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.866+0000 7f75a77fe640 1 -- 172.21.15.8:0/3742099151 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75a8004b60 con 0x7f75b00b2110 2023-11-18T23:41:22.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.866+0000 7f75a77fe640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f759006ae40 0x7f759006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:22.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.866+0000 7f75a77fe640 1 -- 172.21.15.8:0/3742099151 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75a80892e0 con 0x7f75b00b2110 2023-11-18T23:41:22.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.866+0000 7f75ae7fc640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f759006ae40 0x7f759006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:22.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.867+0000 7f75ae7fc640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f759006ae40 0x7f759006d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f75b015b750 tx=0x7f7598009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:22.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:22.870+0000 7f75a77fe640 1 -- 172.21.15.8:0/3742099151 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75b009cf00 con 0x7f75b00b2110 2023-11-18T23:41:23.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.045+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75b009cf00 con 0x7f75b00b2110 2023-11-18T23:41:23.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.046+0000 7f75a77fe640 1 -- 172.21.15.8:0/3742099151 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75b009cf00 con 0x7f75b00b2110 2023-11-18T23:41:23.047 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f759006ae40 msgr2=0x7f759006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f759006ae40 0x7f759006d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f75b015b750 tx=0x7f7598009040 comp rx=0 tx=0).stop 2023-11-18T23:41:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00b2110 msgr2=0x7f75b014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00b2110 0x7f75b014e4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c3f0 tx=0x7f75a800c8b0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 shutdown_connections 2023-11-18T23:41:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f759006ae40 0x7f759006d300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75b0160ad0 0x7f75b009fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f75b00d0240 0x7f75b009f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 --2- 172.21.15.8:0/3742099151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00b2110 0x7f75b014e4f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.047+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 >> 172.21.15.8:0/3742099151 conn(0x7f75b009c500 msgr2=0x7f75b015fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.048+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 shutdown_connections 2023-11-18T23:41:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.048+0000 7f75b55e3640 1 -- 172.21.15.8:0/3742099151 wait complete. 2023-11-18T23:41:23.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:23.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.168+0000 7f61d427c640 1 Processor -- start 2023-11-18T23:41:23.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.168+0000 7f61d427c640 1 -- start start 2023-11-18T23:41:23.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d427c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f61cc0d1570 0x7f61cc0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d427c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0ce360 con 0x7f61cc0cef00 2023-11-18T23:41:23.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d427c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0d19f0 con 0x7f61cc160b70 2023-11-18T23:41:23.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d427c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0cdd50 con 0x7f61cc0d1570 2023-11-18T23:41:23.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d1817640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f61cc0d1570 0x7f61cc0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d2819640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f61cc0cef00 0x7f61cc161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47834/0 (socket says 172.21.15.8:47834) 2023-11-18T23:41:23.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d1817640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f61cc0d1570 0x7f61cc0b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48768/0 (socket says 172.21.15.8:48768) 2023-11-18T23:41:23.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.169+0000 7f61d2819640 1 -- 172.21.15.8:0/61484193 learned_addr learned my addr 172.21.15.8:0/61484193 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:23.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.170+0000 7f61d1817640 1 -- 172.21.15.8:0/61484193 >> v1:172.21.15.116:6789/0 conn(0x7f61cc160b70 legacy=0x7f61cc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.170+0000 7f61d1817640 1 -- 172.21.15.8:0/61484193 >> v1:172.21.15.8:6789/0 conn(0x7f61cc0cef00 legacy=0x7f61cc161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.170+0000 7f61d1817640 1 -- 172.21.15.8:0/61484193 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0d1c70 con 0x7f61cc0d1570 2023-11-18T23:41:23.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.170+0000 7f61d1817640 1 --2- 172.21.15.8:0/61484193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0d1570 0x7f61cc0b2aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61c00097a0 tx=0x7f61c002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899486b7c5e13035 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.170+0000 7f61d1016640 1 -- 172.21.15.8:0/61484193 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0030610 con 0x7f61cc0d1570 2023-11-18T23:41:23.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d1016640 1 -- 172.21.15.8:0/61484193 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c0030770 con 0x7f61cc0d1570 2023-11-18T23:41:23.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d1016640 1 -- 172.21.15.8:0/61484193 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0030b00 con 0x7f61cc0d1570 2023-11-18T23:41:23.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d427c640 1 -- 172.21.15.8:0/61484193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0d1570 msgr2=0x7f61cc0b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d427c640 1 --2- 172.21.15.8:0/61484193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0d1570 0x7f61cc0b2aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61c00097a0 tx=0x7f61c002b960 comp rx=0 tx=0).stop 2023-11-18T23:41:23.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d427c640 1 -- 172.21.15.8:0/61484193 shutdown_connections 2023-11-18T23:41:23.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d427c640 1 --2- 172.21.15.8:0/61484193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0d1570 0x7f61cc0b2aa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d427c640 1 -- 172.21.15.8:0/61484193 >> 172.21.15.8:0/61484193 conn(0x7f61cc09c470 msgr2=0x7f61cc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:23.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d427c640 1 -- 172.21.15.8:0/61484193 shutdown_connections 2023-11-18T23:41:23.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.171+0000 7f61d427c640 1 -- 172.21.15.8:0/61484193 wait complete. 2023-11-18T23:41:23.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.172+0000 7f61d427c640 1 Processor -- start 2023-11-18T23:41:23.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.172+0000 7f61d427c640 1 -- start start 2023-11-18T23:41:23.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d427c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0cef00 0x7f61cc15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d427c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61cc0d1570 0x7f61cc15cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d427c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61cc160b70 0x7f61cc0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d427c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc15e220 con 0x7f61cc0cef00 2023-11-18T23:41:23.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d427c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc15d5a0 con 0x7f61cc0d1570 2023-11-18T23:41:23.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d427c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc15d880 con 0x7f61cc160b70 2023-11-18T23:41:23.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0cef00 0x7f61cc15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0cef00 0x7f61cc15b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48770/0 (socket says 172.21.15.8:48770) 2023-11-18T23:41:23.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 -- 172.21.15.8:0/2556332992 learned_addr learned my addr 172.21.15.8:0/2556332992 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:23.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2819640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61cc160b70 0x7f61cc0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 -- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61cc160b70 msgr2=0x7f61cc0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d1817640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61cc0d1570 0x7f61cc15cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61cc160b70 0x7f61cc0ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 -- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61cc0d1570 msgr2=0x7f61cc15cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61cc0d1570 0x7f61cc15cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d2018640 1 -- 172.21.15.8:0/2556332992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0009400 con 0x7f61cc0cef00 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.173+0000 7f61d1817640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61cc0d1570 0x7f61cc15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.174+0000 7f61d2018640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0cef00 0x7f61cc15b640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c450 tx=0x7f61c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.174+0000 7f61caffd640 1 -- 172.21.15.8:0/2556332992 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40052d0 con 0x7f61cc0cef00 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.174+0000 7f61caffd640 1 -- 172.21.15.8:0/2556332992 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4005430 con 0x7f61cc0cef00 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.174+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc15db60 con 0x7f61cc0cef00 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.174+0000 7f61caffd640 1 -- 172.21.15.8:0/2556332992 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4012870 con 0x7f61cc0cef00 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.174+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc15f360 con 0x7f61cc0cef00 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.175+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc15e360 con 0x7f61cc0cef00 2023-11-18T23:41:23.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.175+0000 7f61caffd640 1 -- 172.21.15.8:0/2556332992 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61c40129d0 con 0x7f61cc0cef00 2023-11-18T23:41:23.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.176+0000 7f61caffd640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f61b806ae40 0x7f61b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.176+0000 7f61caffd640 1 -- 172.21.15.8:0/2556332992 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61c40890c0 con 0x7f61cc0cef00 2023-11-18T23:41:23.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.176+0000 7f61d1817640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f61b806ae40 0x7f61b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.176+0000 7f61d1817640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f61b806ae40 0x7f61b806d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61c0036000 tx=0x7f61c003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.180+0000 7f61caffd640 1 -- 172.21.15.8:0/2556332992 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61c4054200 con 0x7f61cc0cef00 2023-11-18T23:41:23.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.356+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61cc0a1150 con 0x7f61cc0cef00 2023-11-18T23:41:23.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.357+0000 7f61caffd640 1 -- 172.21.15.8:0/2556332992 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61c4057820 con 0x7f61cc0cef00 2023-11-18T23:41:23.358 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.358+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f61b806ae40 msgr2=0x7f61b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.358+0000 7f61d427c640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f61b806ae40 0x7f61b806d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61c0036000 tx=0x7f61c003b040 comp rx=0 tx=0).stop 2023-11-18T23:41:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.358+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0cef00 msgr2=0x7f61cc15b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.358+0000 7f61d427c640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0cef00 0x7f61cc15b640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c450 tx=0x7f61c400c910 comp rx=0 tx=0).stop 2023-11-18T23:41:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 shutdown_connections 2023-11-18T23:41:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f61b806ae40 0x7f61b806d300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61cc160b70 0x7f61cc0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61cc0d1570 0x7f61cc15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 --2- 172.21.15.8:0/2556332992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61cc0cef00 0x7f61cc15b640 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 >> 172.21.15.8:0/2556332992 conn(0x7f61cc09c470 msgr2=0x7f61cc06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:23.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 shutdown_connections 2023-11-18T23:41:23.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.359+0000 7f61d427c640 1 -- 172.21.15.8:0/2556332992 wait complete. 2023-11-18T23:41:23.370 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.478+0000 7f7b25e1f640 1 Processor -- start 2023-11-18T23:41:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.478+0000 7f7b25e1f640 1 -- start start 2023-11-18T23:41:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b25e1f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200d0220 0x7f7b200cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b25e1f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b200b1970 0x7f7b200ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b25e1f640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b200b04d0 con 0x7f7b2015d7b0 2023-11-18T23:41:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b25e1f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b200d1e40 con 0x7f7b200b1970 2023-11-18T23:41:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b25e1f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b200afe80 con 0x7f7b200d0220 2023-11-18T23:41:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b1ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b200b1970 0x7f7b200ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b1ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b200b1970 0x7f7b200ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48780/0 (socket says 172.21.15.8:48780) 2023-11-18T23:41:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b1ffff640 1 -- 172.21.15.8:0/9803007 learned_addr learned my addr 172.21.15.8:0/9803007 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.479+0000 7f7b1effd640 1 --2- 172.21.15.8:0/9803007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200d0220 0x7f7b200cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.480+0000 7f7b1ffff640 1 -- 172.21.15.8:0/9803007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200d0220 msgr2=0x7f7b200cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.480+0000 7f7b1ffff640 1 --2- 172.21.15.8:0/9803007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200d0220 0x7f7b200cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.480+0000 7f7b1ffff640 1 -- 172.21.15.8:0/9803007 >> v1:172.21.15.116:6789/0 conn(0x7f7b2015d7b0 legacy=0x7f7b200cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.480+0000 7f7b1ffff640 1 -- 172.21.15.8:0/9803007 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b200b0160 con 0x7f7b200b1970 2023-11-18T23:41:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.480+0000 7f7b1ffff640 1 --2- 172.21.15.8:0/9803007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200b1970 0x7f7b200ce280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009e50 tx=0x7f7b1802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0b94423437a190 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b1e7fc640 1 -- 172.21.15.8:0/9803007 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1802cb00 con 0x7f7b200b1970 2023-11-18T23:41:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b1e7fc640 1 -- 172.21.15.8:0/9803007 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1802cc60 con 0x7f7b200b1970 2023-11-18T23:41:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b1e7fc640 1 -- 172.21.15.8:0/9803007 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180343f0 con 0x7f7b200b1970 2023-11-18T23:41:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 -- 172.21.15.8:0/9803007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200b1970 msgr2=0x7f7b200ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/9803007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200b1970 0x7f7b200ce280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009e50 tx=0x7f7b1802bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 -- 172.21.15.8:0/9803007 shutdown_connections 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/9803007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200b1970 0x7f7b200ce280 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/9803007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200d0220 0x7f7b200cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 -- 172.21.15.8:0/9803007 >> 172.21.15.8:0/9803007 conn(0x7f7b2009c480 msgr2=0x7f7b200d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 -- 172.21.15.8:0/9803007 shutdown_connections 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.481+0000 7f7b25e1f640 1 -- 172.21.15.8:0/9803007 wait complete. 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.482+0000 7f7b25e1f640 1 Processor -- start 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.482+0000 7f7b25e1f640 1 -- start start 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b25e1f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200b1970 0x7f7b2015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b25e1f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200d0220 0x7f7b200b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b25e1f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b2015d7b0 0x7f7b200b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b25e1f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2014ebd0 con 0x7f7b200d0220 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b25e1f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2014beb0 con 0x7f7b2015d7b0 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b25e1f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2014e2a0 con 0x7f7b200b1970 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b1effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200d0220 0x7f7b200b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b1effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200d0220 0x7f7b200b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48784/0 (socket says 172.21.15.8:48784) 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b1effd640 1 -- 172.21.15.8:0/1040860756 learned_addr learned my addr 172.21.15.8:0/1040860756 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b1f7fe640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200b1970 0x7f7b2015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.483+0000 7f7b1ffff640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b2015d7b0 0x7f7b200b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1effd640 1 -- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200b1970 msgr2=0x7f7b2015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1effd640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200b1970 0x7f7b2015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1effd640 1 -- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b2015d7b0 msgr2=0x7f7b200b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1effd640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b2015d7b0 0x7f7b200b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1effd640 1 -- 172.21.15.8:0/1040860756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18009b30 con 0x7f7b200d0220 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1f7fe640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200b1970 0x7f7b2015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1ffff640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b2015d7b0 0x7f7b200b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b1effd640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200d0220 0x7f7b200b4bd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400e870 tx=0x7f7b1400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b07fff640 1 -- 172.21.15.8:0/1040860756 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140094f0 con 0x7f7b200d0220 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b07fff640 1 -- 172.21.15.8:0/1040860756 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400c940 con 0x7f7b200d0220 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2014e580 con 0x7f7b200d0220 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b07fff640 1 -- 172.21.15.8:0/1040860756 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400ccf0 con 0x7f7b200d0220 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.484+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2014f060 con 0x7f7b200d0220 2023-11-18T23:41:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.485+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b200d19e0 con 0x7f7b200d0220 2023-11-18T23:41:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.485+0000 7f7b07fff640 1 -- 172.21.15.8:0/1040860756 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b14013470 con 0x7f7b200d0220 2023-11-18T23:41:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.486+0000 7f7b07fff640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7b0c06ae40 0x7f7b0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.486+0000 7f7b07fff640 1 -- 172.21.15.8:0/1040860756 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b14089630 con 0x7f7b200d0220 2023-11-18T23:41:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.486+0000 7f7b1f7fe640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7b0c06ae40 0x7f7b0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.486+0000 7f7b1f7fe640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7b0c06ae40 0x7f7b0c06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007fd0 tx=0x7f7b10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.490+0000 7f7b07fff640 1 -- 172.21.15.8:0/1040860756 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b14054770 con 0x7f7b200d0220 2023-11-18T23:41:23.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.666+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b200a1160 con 0x7f7b200d0220 2023-11-18T23:41:23.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.667+0000 7f7b07fff640 1 -- 172.21.15.8:0/1040860756 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b14057d90 con 0x7f7b200d0220 2023-11-18T23:41:23.669 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:23.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7b0c06ae40 msgr2=0x7f7b0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7b0c06ae40 0x7f7b0c06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007fd0 tx=0x7f7b10009040 comp rx=0 tx=0).stop 2023-11-18T23:41:23.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200d0220 msgr2=0x7f7b200b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200d0220 0x7f7b200b4bd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400e870 tx=0x7f7b1400ed30 comp rx=0 tx=0).stop 2023-11-18T23:41:23.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 shutdown_connections 2023-11-18T23:41:23.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7b0c06ae40 0x7f7b0c06d300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b2015d7b0 0x7f7b200b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b200d0220 0x7f7b200b4bd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 --2- 172.21.15.8:0/1040860756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b200b1970 0x7f7b2015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 >> 172.21.15.8:0/1040860756 conn(0x7f7b2009c480 msgr2=0x7f7b2006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 shutdown_connections 2023-11-18T23:41:23.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.669+0000 7f7b25e1f640 1 -- 172.21.15.8:0/1040860756 wait complete. 2023-11-18T23:41:23.681 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:23.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.785+0000 7f084815a640 1 Processor -- start 2023-11-18T23:41:23.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.786+0000 7f084815a640 1 -- start start 2023-11-18T23:41:23.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.786+0000 7f084815a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400b8290 0x7f08400d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.786+0000 7f084815a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08400b5f90 con 0x7f08400d1720 2023-11-18T23:41:23.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.786+0000 7f084815a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08400d20a0 con 0x7f084015d3e0 2023-11-18T23:41:23.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.786+0000 7f084815a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08400b61e0 con 0x7f08400b8290 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.786+0000 7f08456f5640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f08400d1720 0x7f08400b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47848/0 (socket says 172.21.15.8:47848) 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.786+0000 7f08456f5640 1 -- 172.21.15.8:0/3400757648 learned_addr learned my addr 172.21.15.8:0/3400757648 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f08466f7640 1 --2- 172.21.15.8:0/3400757648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400b8290 0x7f08400d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f0844ef4640 1 -- 172.21.15.8:0/3400757648 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899318666 0 0) 0x7f08400b5f90 con 0x7f08400d1720 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f0844ef4640 1 -- 172.21.15.8:0/3400757648 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0828003520 con 0x7f08400d1720 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f0844ef4640 1 -- 172.21.15.8:0/3400757648 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780322403 0 0) 0x7f08400d20a0 con 0x7f084015d3e0 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f0844ef4640 1 -- 172.21.15.8:0/3400757648 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08400b5f90 con 0x7f084015d3e0 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f08466f7640 1 -- 172.21.15.8:0/3400757648 >> v1:172.21.15.116:6789/0 conn(0x7f084015d3e0 legacy=0x7f08400ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f08466f7640 1 -- 172.21.15.8:0/3400757648 >> v1:172.21.15.8:6789/0 conn(0x7f08400d1720 legacy=0x7f08400b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.787+0000 7f08466f7640 1 -- 172.21.15.8:0/3400757648 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08400b64c0 con 0x7f08400b8290 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f08466f7640 1 --2- 172.21.15.8:0/3400757648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400b8290 0x7f08400d1b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0830009dc0 tx=0x7f083002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3539fbfb0eb50173 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f0844ef4640 1 -- 172.21.15.8:0/3400757648 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083002cd50 con 0x7f08400b8290 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f0844ef4640 1 -- 172.21.15.8:0/3400757648 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830034440 con 0x7f08400b8290 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f0844ef4640 1 -- 172.21.15.8:0/3400757648 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08300347b0 con 0x7f08400b8290 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f084815a640 1 -- 172.21.15.8:0/3400757648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400b8290 msgr2=0x7f08400d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f084815a640 1 --2- 172.21.15.8:0/3400757648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400b8290 0x7f08400d1b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0830009dc0 tx=0x7f083002bfa0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f084815a640 1 -- 172.21.15.8:0/3400757648 shutdown_connections 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f084815a640 1 --2- 172.21.15.8:0/3400757648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400b8290 0x7f08400d1b60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.788+0000 7f084815a640 1 -- 172.21.15.8:0/3400757648 >> 172.21.15.8:0/3400757648 conn(0x7f084009c480 msgr2=0x7f08400d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.789+0000 7f084815a640 1 -- 172.21.15.8:0/3400757648 shutdown_connections 2023-11-18T23:41:23.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.789+0000 7f084815a640 1 -- 172.21.15.8:0/3400757648 wait complete. 2023-11-18T23:41:23.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 Processor -- start 2023-11-18T23:41:23.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 -- start start 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08400b8290 0x7f08400c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400d1720 0x7f0840155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f084015d3e0 0x7f0840157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0840156d00 con 0x7f084015d3e0 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08400c9300 con 0x7f08400b8290 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.790+0000 7f084815a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08401560f0 con 0x7f08400d1720 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f084015d3e0 0x7f0840157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f084015d3e0 0x7f0840157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48790/0 (socket says 172.21.15.8:48790) 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 -- 172.21.15.8:0/1363575880 learned_addr learned my addr 172.21.15.8:0/1363575880 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f0845ef6640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08400b8290 0x7f08400c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08456f5640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400d1720 0x7f0840155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 -- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400d1720 msgr2=0x7f0840155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400d1720 0x7f0840155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 -- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08400b8290 msgr2=0x7f08400c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08400b8290 0x7f08400c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 -- 172.21.15.8:0/1363575880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830009a70 con 0x7f084015d3e0 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08456f5640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400d1720 0x7f0840155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f08466f7640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f084015d3e0 0x7f0840157190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0830009eb0 tx=0x7f0830004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f083e7fc640 1 -- 172.21.15.8:0/1363575880 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083003e610 con 0x7f084015d3e0 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f083e7fc640 1 -- 172.21.15.8:0/1363575880 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083003e770 con 0x7f084015d3e0 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08401563d0 con 0x7f084015d3e0 2023-11-18T23:41:23.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f083e7fc640 1 -- 172.21.15.8:0/1363575880 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083003eb20 con 0x7f084015d3e0 2023-11-18T23:41:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.791+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0840156990 con 0x7f084015d3e0 2023-11-18T23:41:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.792+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0840156eb0 con 0x7f084015d3e0 2023-11-18T23:41:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.793+0000 7f083e7fc640 1 -- 172.21.15.8:0/1363575880 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f083003b050 con 0x7f084015d3e0 2023-11-18T23:41:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.793+0000 7f083e7fc640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f082c06ae40 0x7f082c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.793+0000 7f083e7fc640 1 -- 172.21.15.8:0/1363575880 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08300abe90 con 0x7f084015d3e0 2023-11-18T23:41:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.793+0000 7f0845ef6640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f082c06ae40 0x7f082c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.794+0000 7f0845ef6640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f082c06ae40 0x7f082c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0838007fd0 tx=0x7f0838009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:23.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:23.798+0000 7f083e7fc640 1 -- 172.21.15.8:0/1363575880 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0840156eb0 con 0x7f084015d3e0 2023-11-18T23:41:24.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.012+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0840156eb0 con 0x7f084015d3e0 2023-11-18T23:41:24.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.012+0000 7f083e7fc640 1 -- 172.21.15.8:0/1363575880 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f0840156eb0 con 0x7f084015d3e0 2023-11-18T23:41:24.014 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:24.014 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:24.014 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f082c06ae40 msgr2=0x7f082c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f082c06ae40 0x7f082c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0838007fd0 tx=0x7f0838009040 comp rx=0 tx=0).stop 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f084015d3e0 msgr2=0x7f0840157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f084015d3e0 0x7f0840157190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0830009eb0 tx=0x7f0830004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 shutdown_connections 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f082c06ae40 0x7f082c06d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f084015d3e0 0x7f0840157190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08400d1720 0x7f0840155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 --2- 172.21.15.8:0/1363575880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08400b8290 0x7f08400c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 >> 172.21.15.8:0/1363575880 conn(0x7f084009c480 msgr2=0x7f08400cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:24.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 shutdown_connections 2023-11-18T23:41:24.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.014+0000 7f084815a640 1 -- 172.21.15.8:0/1363575880 wait complete. 2023-11-18T23:41:24.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:24.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.131+0000 7f633a07c640 1 Processor -- start 2023-11-18T23:41:24.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.131+0000 7f633a07c640 1 -- start start 2023-11-18T23:41:24.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f633a07c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f633415d3e0 0x7f63340ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f633a07c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f63340d1e30 0x7f63340b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f633a07c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63340b5f90 con 0x7f63340ced30 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f633a07c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340cf170 con 0x7f633415d3e0 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f633a07c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340b61e0 con 0x7f63340d1e30 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f63337fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f633415d3e0 0x7f63340ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f63337fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f633415d3e0 0x7f63340ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48806/0 (socket says 172.21.15.8:48806) 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f6332ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f63340ced30 0x7f63340d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47850/0 (socket says 172.21.15.8:47850) 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.132+0000 7f63337fe640 1 -- 172.21.15.8:0/3152393410 learned_addr learned my addr 172.21.15.8:0/3152393410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f6333fff640 1 --2- 172.21.15.8:0/3152393410 >> v2:172.21.15.116:3300/0 conn(0x7f63340d1e30 0x7f63340b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63337fe640 1 -- 172.21.15.8:0/3152393410 >> v2:172.21.15.116:3300/0 conn(0x7f63340d1e30 msgr2=0x7f63340b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63337fe640 1 --2- 172.21.15.8:0/3152393410 >> v2:172.21.15.116:3300/0 conn(0x7f63340d1e30 0x7f63340b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63337fe640 1 -- 172.21.15.8:0/3152393410 >> v1:172.21.15.8:6789/0 conn(0x7f63340ced30 legacy=0x7f63340d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63327fc640 1 -- 172.21.15.8:0/3152393410 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188641085 0 0) 0x7f63340b5f90 con 0x7f63340ced30 2023-11-18T23:41:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63337fe640 1 -- 172.21.15.8:0/3152393410 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340b64c0 con 0x7f633415d3e0 2023-11-18T23:41:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f6333fff640 1 --2- 172.21.15.8:0/3152393410 >> v2:172.21.15.116:3300/0 conn(0x7f63340d1e30 0x7f63340b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63337fe640 1 --2- 172.21.15.8:0/3152393410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f63340ce7f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f63340cdc30 tx=0x7f632402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0eaf90d6161afa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63327fc640 1 -- 172.21.15.8:0/3152393410 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632402f850 con 0x7f633415d3e0 2023-11-18T23:41:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63327fc640 1 -- 172.21.15.8:0/3152393410 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632402f9b0 con 0x7f633415d3e0 2023-11-18T23:41:24.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.133+0000 7f63327fc640 1 -- 172.21.15.8:0/3152393410 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632402fd40 con 0x7f633415d3e0 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 -- 172.21.15.8:0/3152393410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 msgr2=0x7f63340ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 --2- 172.21.15.8:0/3152393410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f63340ce7f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f63340cdc30 tx=0x7f632402ba30 comp rx=0 tx=0).stop 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 -- 172.21.15.8:0/3152393410 shutdown_connections 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 --2- 172.21.15.8:0/3152393410 >> v2:172.21.15.116:3300/0 conn(0x7f63340d1e30 0x7f63340b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 --2- 172.21.15.8:0/3152393410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f63340ce7f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 -- 172.21.15.8:0/3152393410 >> 172.21.15.8:0/3152393410 conn(0x7f633409c480 msgr2=0x7f63340d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 -- 172.21.15.8:0/3152393410 shutdown_connections 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.134+0000 7f633a07c640 1 -- 172.21.15.8:0/3152393410 wait complete. 2023-11-18T23:41:24.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.135+0000 7f633a07c640 1 Processor -- start 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.135+0000 7f633a07c640 1 -- start start 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f633a07c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f63340ced30 0x7f633409cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f633a07c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63340d1e30 0x7f633406c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f633a07c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f633409f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f633a07c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633414b860 con 0x7f633415d3e0 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f633a07c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633414bb40 con 0x7f63340d1e30 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f633a07c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633414be20 con 0x7f63340ced30 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f6333fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f633409f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f6333fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f633409f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48820/0 (socket says 172.21.15.8:48820) 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f6333fff640 1 -- 172.21.15.8:0/2108256673 learned_addr learned my addr 172.21.15.8:0/2108256673 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f6332ffd640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63340d1e30 0x7f633406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f63337fe640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f63340ced30 0x7f633409cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f6333fff640 1 -- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f63340ced30 msgr2=0x7f633409cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.136+0000 7f6333fff640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f63340ced30 0x7f633409cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f6333fff640 1 -- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63340d1e30 msgr2=0x7f633406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f6333fff640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63340d1e30 0x7f633406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f6333fff640 1 -- 172.21.15.8:0/2108256673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63240094d0 con 0x7f633415d3e0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f6333fff640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f633409f600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f632c00cef0 tx=0x7f632c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f631bfff640 1 -- 172.21.15.8:0/2108256673 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00d840 con 0x7f633415d3e0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f631bfff640 1 -- 172.21.15.8:0/2108256673 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00d9c0 con 0x7f633415d3e0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633414c100 con 0x7f633415d3e0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f631bfff640 1 -- 172.21.15.8:0/2108256673 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00dd70 con 0x7f633415d3e0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.137+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633406c690 con 0x7f633415d3e0 2023-11-18T23:41:24.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.138+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633406c8b0 con 0x7f633415d3e0 2023-11-18T23:41:24.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.138+0000 7f631bfff640 1 -- 172.21.15.8:0/2108256673 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f632c01e3b0 con 0x7f633415d3e0 2023-11-18T23:41:24.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.139+0000 7f631bfff640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f632006ae40 0x7f632006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.139+0000 7f631bfff640 1 -- 172.21.15.8:0/2108256673 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f632c08a010 con 0x7f633415d3e0 2023-11-18T23:41:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.139+0000 7f63337fe640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f632006ae40 0x7f632006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.139+0000 7f63337fe640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f632006ae40 0x7f632006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6324036000 tx=0x7f6324008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.143+0000 7f631bfff640 1 -- 172.21.15.8:0/2108256673 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f632c055220 con 0x7f633415d3e0 2023-11-18T23:41:24.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.318+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6334067420 con 0x7f633415d3e0 2023-11-18T23:41:24.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.319+0000 7f631bfff640 1 -- 172.21.15.8:0/2108256673 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f632c01a090 con 0x7f633415d3e0 2023-11-18T23:41:24.321 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:24.321 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f632006ae40 msgr2=0x7f632006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f632006ae40 0x7f632006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6324036000 tx=0x7f6324008030 comp rx=0 tx=0).stop 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 msgr2=0x7f633409f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f633409f600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f632c00cef0 tx=0x7f632c00a710 comp rx=0 tx=0).stop 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 shutdown_connections 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f632006ae40 0x7f632006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633415d3e0 0x7f633409f600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63340d1e30 0x7f633406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 --2- 172.21.15.8:0/2108256673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f63340ced30 0x7f633409cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.321+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 >> 172.21.15.8:0/2108256673 conn(0x7f633409c480 msgr2=0x7f63340ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:24.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.322+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 shutdown_connections 2023-11-18T23:41:24.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.322+0000 7f633a07c640 1 -- 172.21.15.8:0/2108256673 wait complete. 2023-11-18T23:41:24.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:24.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:24.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.441+0000 7f1d28d89640 1 Processor -- start 2023-11-18T23:41:24.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.441+0000 7f1d28d89640 1 -- start start 2023-11-18T23:41:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.442+0000 7f1d28d89640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1d2406f0d0 0x7f1d240b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.442+0000 7f1d28d89640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d240b3440 0x7f1d240ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.442+0000 7f1d28d89640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d24160d70 0x7f1d24161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.442+0000 7f1d28d89640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d24161760 con 0x7f1d2406f0d0 2023-11-18T23:41:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.442+0000 7f1d28d89640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d240b38d0 con 0x7f1d240b3440 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.442+0000 7f1d28d89640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d240b3bb0 con 0x7f1d24160d70 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.442+0000 7f1d2259c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1d2406f0d0 0x7f1d240b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d2259c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1d2406f0d0 0x7f1d240b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48824/0 (socket says 172.21.15.8:48824) 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d2259c640 1 -- 172.21.15.8:0/2694844747 learned_addr learned my addr 172.21.15.8:0/2694844747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d21d9b640 1 --2- 172.21.15.8:0/2694844747 >> v2:172.21.15.116:3300/0 conn(0x7f1d240b3440 0x7f1d240ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d22d9d640 1 --2- 172.21.15.8:0/2694844747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d24160d70 0x7f1d24161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d2259c640 1 -- 172.21.15.8:0/2694844747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d24160d70 msgr2=0x7f1d24161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d2259c640 1 --2- 172.21.15.8:0/2694844747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d24160d70 0x7f1d24161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d2259c640 1 -- 172.21.15.8:0/2694844747 >> v2:172.21.15.116:3300/0 conn(0x7f1d240b3440 msgr2=0x7f1d240ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d2259c640 1 --2- 172.21.15.8:0/2694844747 >> v2:172.21.15.116:3300/0 conn(0x7f1d240b3440 0x7f1d240ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d2259c640 1 -- 172.21.15.8:0/2694844747 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240b3e90 con 0x7f1d2406f0d0 2023-11-18T23:41:24.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.443+0000 7f1d22d9d640 1 --2- 172.21.15.8:0/2694844747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d24160d70 0x7f1d24161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d2259c640 1 --2- 172.21.15.8:0/2694844747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2406f0d0 0x7f1d240b4970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d240aea30 tx=0x7f1d1c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9530d6459dc5e52a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d2159a640 1 -- 172.21.15.8:0/2694844747 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c031870 con 0x7f1d2406f0d0 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d2159a640 1 -- 172.21.15.8:0/2694844747 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c0319d0 con 0x7f1d2406f0d0 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d2159a640 1 -- 172.21.15.8:0/2694844747 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c031d60 con 0x7f1d2406f0d0 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 -- 172.21.15.8:0/2694844747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2406f0d0 msgr2=0x7f1d240b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 --2- 172.21.15.8:0/2694844747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2406f0d0 0x7f1d240b4970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d240aea30 tx=0x7f1d1c02b910 comp rx=0 tx=0).stop 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 -- 172.21.15.8:0/2694844747 shutdown_connections 2023-11-18T23:41:24.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 --2- 172.21.15.8:0/2694844747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d24160d70 0x7f1d24161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 --2- 172.21.15.8:0/2694844747 >> v2:172.21.15.116:3300/0 conn(0x7f1d240b3440 0x7f1d240ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 --2- 172.21.15.8:0/2694844747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d2406f0d0 0x7f1d240b4970 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 -- 172.21.15.8:0/2694844747 >> 172.21.15.8:0/2694844747 conn(0x7f1d240b1670 msgr2=0x7f1d240b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 -- 172.21.15.8:0/2694844747 shutdown_connections 2023-11-18T23:41:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.444+0000 7f1d28d89640 1 -- 172.21.15.8:0/2694844747 wait complete. 2023-11-18T23:41:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 Processor -- start 2023-11-18T23:41:24.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 -- start start 2023-11-18T23:41:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2406f0d0 0x7f1d24157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d24160d70 0x7f1d240cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d240ce1f0 0x7f1d240ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24153600 con 0x7f1d24160d70 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2406cdb0 con 0x7f1d2406f0d0 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.446+0000 7f1d28d89640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2406d090 con 0x7f1d240ce1f0 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d24160d70 0x7f1d240cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d24160d70 0x7f1d240cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48834/0 (socket says 172.21.15.8:48834) 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 -- 172.21.15.8:0/71490913 learned_addr learned my addr 172.21.15.8:0/71490913 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d2259c640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2406f0d0 0x7f1d24157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d22d9d640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d240ce1f0 0x7f1d240ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 -- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d240ce1f0 msgr2=0x7f1d240ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d240ce1f0 0x7f1d240ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 -- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2406f0d0 msgr2=0x7f1d24157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2406f0d0 0x7f1d24157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 -- 172.21.15.8:0/71490913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0094d0 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d21d9b640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d24160d70 0x7f1d240cc540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00e980 tx=0x7f1d0c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d1affd640 1 -- 172.21.15.8:0/71490913 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c009670 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d1affd640 1 -- 172.21.15.8:0/71490913 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c00ca00 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d1affd640 1 -- 172.21.15.8:0/71490913 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c00cd90 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2406d370 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.447+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2406d930 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.448+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d24072720 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.449+0000 7f1d1affd640 1 -- 172.21.15.8:0/71490913 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d0c013470 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.449+0000 7f1d1affd640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1d0406ae40 0x7f1d0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.449+0000 7f1d1affd640 1 -- 172.21.15.8:0/71490913 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d0c089780 con 0x7f1d24160d70 2023-11-18T23:41:24.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.449+0000 7f1d2259c640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1d0406ae40 0x7f1d0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.450+0000 7f1d2259c640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1d0406ae40 0x7f1d0406d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c036000 tx=0x7f1d1c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.453+0000 7f1d1affd640 1 -- 172.21.15.8:0/71490913 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d0c0548e0 con 0x7f1d24160d70 2023-11-18T23:41:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.630+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d2404e920 con 0x7f1d24160d70 2023-11-18T23:41:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.630+0000 7f1d1affd640 1 -- 172.21.15.8:0/71490913 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d0c057f00 con 0x7f1d24160d70 2023-11-18T23:41:24.632 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:24.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1d0406ae40 msgr2=0x7f1d0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1d0406ae40 0x7f1d0406d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c036000 tx=0x7f1d1c03c040 comp rx=0 tx=0).stop 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d24160d70 msgr2=0x7f1d240cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d24160d70 0x7f1d240cc540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00e980 tx=0x7f1d0c00ee40 comp rx=0 tx=0).stop 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 shutdown_connections 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f1d0406ae40 0x7f1d0406d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d240ce1f0 0x7f1d240ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d24160d70 0x7f1d240cc540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 --2- 172.21.15.8:0/71490913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d2406f0d0 0x7f1d24157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 >> 172.21.15.8:0/71490913 conn(0x7f1d240b1670 msgr2=0x7f1d24070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 shutdown_connections 2023-11-18T23:41:24.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.632+0000 7f1d28d89640 1 -- 172.21.15.8:0/71490913 wait complete. 2023-11-18T23:41:24.644 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:24.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.751+0000 7fab832ec640 1 Processor -- start 2023-11-18T23:41:24.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.752+0000 7fab832ec640 1 -- start start 2023-11-18T23:41:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.752+0000 7fab832ec640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab7c15e8a0 0x7fab7c0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.752+0000 7fab832ec640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0ceb70 0x7fab7c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.752+0000 7fab832ec640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c09a520 con 0x7fab7c0cccd0 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.752+0000 7fab832ec640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7c09a330 con 0x7fab7c15e8a0 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.752+0000 7fab832ec640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c09a800 con 0x7fab7c0ceb70 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.752+0000 7fab81088640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab7c15e8a0 0x7fab7c0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.753+0000 7fab81088640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab7c15e8a0 0x7fab7c0cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48846/0 (socket says 172.21.15.8:48846) 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.753+0000 7fab81088640 1 -- 172.21.15.8:0/3628344642 learned_addr learned my addr 172.21.15.8:0/3628344642 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.753+0000 7fab80887640 1 --2- 172.21.15.8:0/3628344642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0ceb70 0x7fab7c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.753+0000 7fab81088640 1 -- 172.21.15.8:0/3628344642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0ceb70 msgr2=0x7fab7c0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.753+0000 7fab81088640 1 --2- 172.21.15.8:0/3628344642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0ceb70 0x7fab7c0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.753+0000 7fab81088640 1 -- 172.21.15.8:0/3628344642 >> v1:172.21.15.116:6789/0 conn(0x7fab7c0cccd0 legacy=0x7fab7c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.753+0000 7fab81088640 1 -- 172.21.15.8:0/3628344642 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0cbf90 con 0x7fab7c15e8a0 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab81088640 1 --2- 172.21.15.8:0/3628344642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c0cc790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab74009e50 tx=0x7fab7402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e7c9ce054726e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab7bfff640 1 -- 172.21.15.8:0/3628344642 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7402cb00 con 0x7fab7c15e8a0 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab7bfff640 1 -- 172.21.15.8:0/3628344642 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7402cc60 con 0x7fab7c15e8a0 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab7bfff640 1 -- 172.21.15.8:0/3628344642 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab740343f0 con 0x7fab7c15e8a0 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 -- 172.21.15.8:0/3628344642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 msgr2=0x7fab7c0cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 --2- 172.21.15.8:0/3628344642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c0cc790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab74009e50 tx=0x7fab7402bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 -- 172.21.15.8:0/3628344642 shutdown_connections 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 --2- 172.21.15.8:0/3628344642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0ceb70 0x7fab7c0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 --2- 172.21.15.8:0/3628344642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c0cc790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 -- 172.21.15.8:0/3628344642 >> 172.21.15.8:0/3628344642 conn(0x7fab7c0b2a90 msgr2=0x7fab7c0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 -- 172.21.15.8:0/3628344642 shutdown_connections 2023-11-18T23:41:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.754+0000 7fab832ec640 1 -- 172.21.15.8:0/3628344642 wait complete. 2023-11-18T23:41:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 Processor -- start 2023-11-18T23:41:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 -- start start 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0cccd0 0x7fab7c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab7c0ceb70 0x7fab7c0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0cb2b0 con 0x7fab7c15e8a0 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0b55c0 con 0x7fab7c0ceb70 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab832ec640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0b58a0 con 0x7fab7c0cccd0 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab81889640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab81889640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48848/0 (socket says 172.21.15.8:48848) 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.756+0000 7fab81889640 1 -- 172.21.15.8:0/3692384588 learned_addr learned my addr 172.21.15.8:0/3692384588 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:24.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81088640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0cccd0 0x7fab7c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab80887640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab7c0ceb70 0x7fab7c0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81889640 1 -- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0cccd0 msgr2=0x7fab7c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81889640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0cccd0 0x7fab7c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81889640 1 -- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab7c0ceb70 msgr2=0x7fab7c0ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81889640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab7c0ceb70 0x7fab7c0ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81889640 1 -- 172.21.15.8:0/3692384588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74009b30 con 0x7fab7c15e8a0 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81088640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0cccd0 0x7fab7c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab80887640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab7c0ceb70 0x7fab7c0ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab81889640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c155e60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c390 tx=0x7fab6c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab79ffb640 1 -- 172.21.15.8:0/3692384588 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0052d0 con 0x7fab7c15e8a0 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab79ffb640 1 -- 172.21.15.8:0/3692384588 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c005430 con 0x7fab7c15e8a0 2023-11-18T23:41:24.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c0b5b80 con 0x7fab7c15e8a0 2023-11-18T23:41:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab79ffb640 1 -- 172.21.15.8:0/3692384588 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c003810 con 0x7fab7c15e8a0 2023-11-18T23:41:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.757+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c0b6140 con 0x7fab7c15e8a0 2023-11-18T23:41:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.758+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c09f0b0 con 0x7fab7c15e8a0 2023-11-18T23:41:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.758+0000 7fab79ffb640 1 -- 172.21.15.8:0/3692384588 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab6c003970 con 0x7fab7c15e8a0 2023-11-18T23:41:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.759+0000 7fab79ffb640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab6806ae40 0x7fab6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.759+0000 7fab79ffb640 1 -- 172.21.15.8:0/3692384588 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab6c088b30 con 0x7fab7c15e8a0 2023-11-18T23:41:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.759+0000 7fab81088640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab6806ae40 0x7fab6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.760+0000 7fab81088640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab6806ae40 0x7fab6806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab74035000 tx=0x7fab74030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.763+0000 7fab79ffb640 1 -- 172.21.15.8:0/3692384588 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab6c053be0 con 0x7fab7c15e8a0 2023-11-18T23:41:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.940+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab7c072710 con 0x7fab7c15e8a0 2023-11-18T23:41:24.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.941+0000 7fab79ffb640 1 -- 172.21.15.8:0/3692384588 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab6c017020 con 0x7fab7c15e8a0 2023-11-18T23:41:24.942 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab6806ae40 msgr2=0x7fab6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab6806ae40 0x7fab6806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab74035000 tx=0x7fab74030000 comp rx=0 tx=0).stop 2023-11-18T23:41:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 msgr2=0x7fab7c155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c155e60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c390 tx=0x7fab6c00c850 comp rx=0 tx=0).stop 2023-11-18T23:41:24.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 shutdown_connections 2023-11-18T23:41:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab6806ae40 0x7fab6806d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab7c15e8a0 0x7fab7c155e60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab7c0ceb70 0x7fab7c0ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 --2- 172.21.15.8:0/3692384588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab7c0cccd0 0x7fab7c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 >> 172.21.15.8:0/3692384588 conn(0x7fab7c0b2a90 msgr2=0x7fab7c0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 shutdown_connections 2023-11-18T23:41:24.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:24.943+0000 7fab832ec640 1 -- 172.21.15.8:0/3692384588 wait complete. 2023-11-18T23:41:24.955 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.063+0000 7f6c2170f640 1 Processor -- start 2023-11-18T23:41:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.063+0000 7f6c2170f640 1 -- start start 2023-11-18T23:41:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c2170f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6c1c15d7b0 0x7f6c1c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c2170f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c0ced50 0x7f6c1c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c2170f640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1c0b04d0 con 0x7f6c1c0d0050 2023-11-18T23:41:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c2170f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0d04d0 con 0x7f6c1c15d7b0 2023-11-18T23:41:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c2170f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0d1e40 con 0x7f6c1c0ced50 2023-11-18T23:41:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6c1c15d7b0 0x7f6c1c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6c1c15d7b0 0x7f6c1c0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48862/0 (socket says 172.21.15.8:48862) 2023-11-18T23:41:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1affd640 1 -- 172.21.15.8:0/1721281016 learned_addr learned my addr 172.21.15.8:0/1721281016 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1b7fe640 1 --2- 172.21.15.8:0/1721281016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c0ced50 0x7f6c1c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1affd640 1 -- 172.21.15.8:0/1721281016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c0ced50 msgr2=0x7f6c1c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1affd640 1 --2- 172.21.15.8:0/1721281016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c0ced50 0x7f6c1c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1affd640 1 -- 172.21.15.8:0/1721281016 >> v1:172.21.15.116:6789/0 conn(0x7f6c1c0d0050 legacy=0x7f6c1c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1affd640 1 -- 172.21.15.8:0/1721281016 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c0afe80 con 0x7f6c1c15d7b0 2023-11-18T23:41:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.064+0000 7f6c1b7fe640 1 --2- 172.21.15.8:0/1721281016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c0ced50 0x7f6c1c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.065+0000 7f6c1affd640 1 --2- 172.21.15.8:0/1721281016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c15d7b0 0x7f6c1c0cfb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009870 tx=0x7f6c0c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642845150eff660d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.065+0000 7f6c19ffb640 1 -- 172.21.15.8:0/1721281016 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c030840 con 0x7f6c1c15d7b0 2023-11-18T23:41:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.065+0000 7f6c19ffb640 1 -- 172.21.15.8:0/1721281016 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0309a0 con 0x7f6c1c15d7b0 2023-11-18T23:41:25.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.065+0000 7f6c19ffb640 1 -- 172.21.15.8:0/1721281016 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c030d30 con 0x7f6c1c15d7b0 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 -- 172.21.15.8:0/1721281016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c15d7b0 msgr2=0x7f6c1c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1721281016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c15d7b0 0x7f6c1c0cfb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009870 tx=0x7f6c0c02b980 comp rx=0 tx=0).stop 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 -- 172.21.15.8:0/1721281016 shutdown_connections 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1721281016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c0ced50 0x7f6c1c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1721281016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c15d7b0 0x7f6c1c0cfb10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 -- 172.21.15.8:0/1721281016 >> 172.21.15.8:0/1721281016 conn(0x7f6c1c09c480 msgr2=0x7f6c1c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 -- 172.21.15.8:0/1721281016 shutdown_connections 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.066+0000 7f6c2170f640 1 -- 172.21.15.8:0/1721281016 wait complete. 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.067+0000 7f6c2170f640 1 Processor -- start 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.067+0000 7f6c2170f640 1 -- start start 2023-11-18T23:41:25.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c2170f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c0ced50 0x7f6c1c157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c2170f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c1c0d0050 0x7f6c1c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c2170f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c15d7b0 0x7f6c1c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c2170f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0cb270 con 0x7f6c1c0ced50 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c2170f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f6970 con 0x7f6c1c0d0050 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c2170f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f6c50 con 0x7f6c1c15d7b0 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c0ced50 0x7f6c1c157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c0ced50 0x7f6c1c157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48866/0 (socket says 172.21.15.8:48866) 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 -- 172.21.15.8:0/1943145282 learned_addr learned my addr 172.21.15.8:0/1943145282 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1a7fc640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c1c0d0050 0x7f6c1c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1b7fe640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c15d7b0 0x7f6c1c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 -- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c15d7b0 msgr2=0x7f6c1c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c15d7b0 0x7f6c1c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 -- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c1c0d0050 msgr2=0x7f6c1c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c1c0d0050 0x7f6c1c15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1affd640 1 -- 172.21.15.8:0/1943145282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0094d0 con 0x7f6c1c0ced50 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.068+0000 7f6c1b7fe640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c15d7b0 0x7f6c1c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.069+0000 7f6c1affd640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c0ced50 0x7f6c1c157fc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000c00 tx=0x7f6c0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.069+0000 7f6c037fe640 1 -- 172.21.15.8:0/1943145282 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c039c90 con 0x7f6c1c0ced50 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.069+0000 7f6c037fe640 1 -- 172.21.15.8:0/1943145282 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c039df0 con 0x7f6c1c0ced50 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.069+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c1f6f30 con 0x7f6c1c0ced50 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.069+0000 7f6c037fe640 1 -- 172.21.15.8:0/1943145282 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c043640 con 0x7f6c1c0ced50 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.069+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c15ee80 con 0x7f6c1c0ced50 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.070+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c15f010 con 0x7f6c1c0ced50 2023-11-18T23:41:25.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.070+0000 7f6c037fe640 1 -- 172.21.15.8:0/1943145282 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c0c0437a0 con 0x7f6c1c0ced50 2023-11-18T23:41:25.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.070+0000 7f6c037fe640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c0806ae40 0x7f6c0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.071+0000 7f6c037fe640 1 -- 172.21.15.8:0/1943145282 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c0c03e070 con 0x7f6c1c0ced50 2023-11-18T23:41:25.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.071+0000 7f6c1a7fc640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c0806ae40 0x7f6c0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.071+0000 7f6c1a7fc640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c0806ae40 0x7f6c0806d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0c9a60 tx=0x7f6c10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.075+0000 7f6c037fe640 1 -- 172.21.15.8:0/1943145282 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c1c15f010 con 0x7f6c1c0ced50 2023-11-18T23:41:25.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.249+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c1c15f010 con 0x7f6c1c0ced50 2023-11-18T23:41:25.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.250+0000 7f6c037fe640 1 -- 172.21.15.8:0/1943145282 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c1c15f010 con 0x7f6c1c0ced50 2023-11-18T23:41:25.251 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:25.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c0806ae40 msgr2=0x7f6c0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c0806ae40 0x7f6c0806d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0c9a60 tx=0x7f6c10009040 comp rx=0 tx=0).stop 2023-11-18T23:41:25.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c0ced50 msgr2=0x7f6c1c157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c0ced50 0x7f6c1c157fc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000c00 tx=0x7f6c0c004730 comp rx=0 tx=0).stop 2023-11-18T23:41:25.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 shutdown_connections 2023-11-18T23:41:25.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c0806ae40 0x7f6c0806d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c1c15d7b0 0x7f6c1c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c1c0d0050 0x7f6c1c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 --2- 172.21.15.8:0/1943145282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c1c0ced50 0x7f6c1c157fc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 >> 172.21.15.8:0/1943145282 conn(0x7f6c1c09c480 msgr2=0x7f6c1c0d3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:25.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 shutdown_connections 2023-11-18T23:41:25.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.252+0000 7f6c2170f640 1 -- 172.21.15.8:0/1943145282 wait complete. 2023-11-18T23:41:25.264 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.369+0000 7fe1c5c1f640 1 Processor -- start 2023-11-18T23:41:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.369+0000 7fe1c5c1f640 1 -- start start 2023-11-18T23:41:25.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.369+0000 7fe1c5c1f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe1c00d1720 0x7fe1c00d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.369+0000 7fe1c5c1f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1c00b3db0 0x7fe1c00b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.369+0000 7fe1c5c1f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c00b5f90 con 0x7fe1c015d3e0 2023-11-18T23:41:25.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.369+0000 7fe1c5c1f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00d20a0 con 0x7fe1c00b3db0 2023-11-18T23:41:25.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.369+0000 7fe1c5c1f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00b61e0 con 0x7fe1c00d1720 2023-11-18T23:41:25.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1c00b3db0 0x7fe1c00b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1c00b3db0 0x7fe1c00b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48870/0 (socket says 172.21.15.8:48870) 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bf7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe1c015d3e0 0x7fe1c00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47852/0 (socket says 172.21.15.8:47852) 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bffff640 1 -- 172.21.15.8:0/2109719430 learned_addr learned my addr 172.21.15.8:0/2109719430 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1beffd640 1 --2- 172.21.15.8:0/2109719430 >> v2:172.21.15.116:3300/0 conn(0x7fe1c00d1720 0x7fe1c00d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bffff640 1 -- 172.21.15.8:0/2109719430 >> v2:172.21.15.116:3300/0 conn(0x7fe1c00d1720 msgr2=0x7fe1c00d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bffff640 1 --2- 172.21.15.8:0/2109719430 >> v2:172.21.15.116:3300/0 conn(0x7fe1c00d1720 0x7fe1c00d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bffff640 1 -- 172.21.15.8:0/2109719430 >> v1:172.21.15.8:6789/0 conn(0x7fe1c015d3e0 legacy=0x7fe1c00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1bffff640 1 -- 172.21.15.8:0/2109719430 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00b64c0 con 0x7fe1c00b3db0 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1be7fc640 1 -- 172.21.15.8:0/2109719430 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159912384 0 0) 0x7fe1c00b5f90 con 0x7fe1c015d3e0 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.370+0000 7fe1beffd640 1 --2- 172.21.15.8:0/2109719430 >> v2:172.21.15.116:3300/0 conn(0x7fe1c00d1720 0x7fe1c00d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1bffff640 1 --2- 172.21.15.8:0/2109719430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00b3db0 0x7fe1c00b4220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0073d50 tx=0x7fe1b802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a392b5c55b84162 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1be7fc640 1 -- 172.21.15.8:0/2109719430 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8030860 con 0x7fe1c00b3db0 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1be7fc640 1 -- 172.21.15.8:0/2109719430 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b80309c0 con 0x7fe1c00b3db0 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1be7fc640 1 -- 172.21.15.8:0/2109719430 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8030d50 con 0x7fe1c00b3db0 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2109719430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00b3db0 msgr2=0x7fe1c00b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2109719430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00b3db0 0x7fe1c00b4220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0073d50 tx=0x7fe1b802b9a0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2109719430 shutdown_connections 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2109719430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00b3db0 0x7fe1c00b4220 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2109719430 >> v2:172.21.15.116:3300/0 conn(0x7fe1c00d1720 0x7fe1c00d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2109719430 >> 172.21.15.8:0/2109719430 conn(0x7fe1c009c480 msgr2=0x7fe1c00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2109719430 shutdown_connections 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.371+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2109719430 wait complete. 2023-11-18T23:41:25.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 Processor -- start 2023-11-18T23:41:25.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 -- start start 2023-11-18T23:41:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1c00b3db0 0x7fe1c00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00d1720 0x7fe1c015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c015d3e0 0x7fe1c00b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00cbd50 con 0x7fe1c00d1720 2023-11-18T23:41:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00caf90 con 0x7fe1c015d3e0 2023-11-18T23:41:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.373+0000 7fe1c5c1f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00cb270 con 0x7fe1c00b3db0 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00d1720 0x7fe1c015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00d1720 0x7fe1c015b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48872/0 (socket says 172.21.15.8:48872) 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 -- 172.21.15.8:0/2866060251 learned_addr learned my addr 172.21.15.8:0/2866060251 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1bffff640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c015d3e0 0x7fe1c00b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1bf7fe640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1c00b3db0 0x7fe1c00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 -- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1c00b3db0 msgr2=0x7fe1c00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1c00b3db0 0x7fe1c00b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 -- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c015d3e0 msgr2=0x7fe1c00b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c015d3e0 0x7fe1c00b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 -- 172.21.15.8:0/2866060251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b80094d0 con 0x7fe1c00d1720 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1bffff640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c015d3e0 0x7fe1c00b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:25.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1bf7fe640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1c00b3db0 0x7fe1c00b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1beffd640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00d1720 0x7fe1c015b3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400e7e0 tx=0x7fe1b400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1a7fff640 1 -- 172.21.15.8:0/2866060251 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4004030 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1a7fff640 1 -- 172.21.15.8:0/2866060251 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b4004190 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c00cb550 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1a7fff640 1 -- 172.21.15.8:0/2866060251 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4004520 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.374+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c00b1c90 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.375+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0067420 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.376+0000 7fe1a7fff640 1 -- 172.21.15.8:0/2866060251 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1b400c6d0 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.376+0000 7fe1a7fff640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe1ac06ae40 0x7fe1ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.376+0000 7fe1a7fff640 1 -- 172.21.15.8:0/2866060251 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1b4089220 con 0x7fe1c00d1720 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.376+0000 7fe1bf7fe640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe1ac06ae40 0x7fe1ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.377+0000 7fe1bf7fe640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe1ac06ae40 0x7fe1ac06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00012e0 tx=0x7fe1b0007f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.380+0000 7fe1a7fff640 1 -- 172.21.15.8:0/2866060251 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1b4054360 con 0x7fe1c00d1720 2023-11-18T23:41:25.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.597+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1c00d1500 con 0x7fe1c00d1720 2023-11-18T23:41:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.597+0000 7fe1a7fff640 1 -- 172.21.15.8:0/2866060251 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fe1b4057980 con 0x7fe1c00d1720 2023-11-18T23:41:25.599 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:25.599 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:25.600 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.599+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe1ac06ae40 msgr2=0x7fe1ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.599+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe1ac06ae40 0x7fe1ac06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00012e0 tx=0x7fe1b0007f90 comp rx=0 tx=0).stop 2023-11-18T23:41:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.599+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00d1720 msgr2=0x7fe1c015b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.599+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00d1720 0x7fe1c015b3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400e7e0 tx=0x7fe1b400eca0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 shutdown_connections 2023-11-18T23:41:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe1ac06ae40 0x7fe1ac06d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1c015d3e0 0x7fe1c00b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1c00d1720 0x7fe1c015b3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 --2- 172.21.15.8:0/2866060251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1c00b3db0 0x7fe1c00b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 >> 172.21.15.8:0/2866060251 conn(0x7fe1c009c480 msgr2=0x7fe1c00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 shutdown_connections 2023-11-18T23:41:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.600+0000 7fe1c5c1f640 1 -- 172.21.15.8:0/2866060251 wait complete. 2023-11-18T23:41:25.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:25.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.717+0000 7f06bdac9640 1 Processor -- start 2023-11-18T23:41:25.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.717+0000 7f06bdac9640 1 -- start start 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06bdac9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06b8099970 0x7f06b8099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06bdac9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f06b809a530 0x7f06b80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06bdac9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b80d0070 con 0x7f06b80cf890 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06bdac9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b80cbb50 con 0x7f06b8099970 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06bdac9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b809a290 con 0x7f06b809a530 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06b77fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06b8099970 0x7f06b8099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06b7fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f06b80cf890 0x7f06b80b0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47858/0 (socket says 172.21.15.8:47858) 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06b77fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06b8099970 0x7f06b8099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48880/0 (socket says 172.21.15.8:48880) 2023-11-18T23:41:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06b7fff640 1 -- 172.21.15.8:0/3496820062 learned_addr learned my addr 172.21.15.8:0/3496820062 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06b6ffd640 1 --2- 172.21.15.8:0/3496820062 >> v2:172.21.15.116:3300/0 conn(0x7f06b809a530 0x7f06b80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.718+0000 7f06b77fe640 1 -- 172.21.15.8:0/3496820062 >> v2:172.21.15.116:3300/0 conn(0x7f06b809a530 msgr2=0x7f06b80cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b77fe640 1 --2- 172.21.15.8:0/3496820062 >> v2:172.21.15.116:3300/0 conn(0x7f06b809a530 0x7f06b80cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b77fe640 1 -- 172.21.15.8:0/3496820062 >> v1:172.21.15.8:6789/0 conn(0x7f06b80cf890 legacy=0x7f06b80b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b77fe640 1 -- 172.21.15.8:0/3496820062 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80cfd90 con 0x7f06b8099970 2023-11-18T23:41:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b67fc640 1 -- 172.21.15.8:0/3496820062 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098882176 0 0) 0x7f06b0001490 con 0x7f06b80cf890 2023-11-18T23:41:25.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b77fe640 1 --2- 172.21.15.8:0/3496820062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b8099d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06b8160110 tx=0x7f06a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfca3b1f6cb90786 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b67fc640 1 -- 172.21.15.8:0/3496820062 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8031830 con 0x7f06b8099970 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b67fc640 1 -- 172.21.15.8:0/3496820062 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a8031990 con 0x7f06b8099970 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.719+0000 7f06b67fc640 1 -- 172.21.15.8:0/3496820062 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8031d20 con 0x7f06b8099970 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 -- 172.21.15.8:0/3496820062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 msgr2=0x7f06b8099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 --2- 172.21.15.8:0/3496820062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b8099d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06b8160110 tx=0x7f06a802b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 -- 172.21.15.8:0/3496820062 shutdown_connections 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 --2- 172.21.15.8:0/3496820062 >> v2:172.21.15.116:3300/0 conn(0x7f06b809a530 0x7f06b80cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 --2- 172.21.15.8:0/3496820062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b8099d50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 -- 172.21.15.8:0/3496820062 >> 172.21.15.8:0/3496820062 conn(0x7f06b80b2a70 msgr2=0x7f06b80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 -- 172.21.15.8:0/3496820062 shutdown_connections 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.720+0000 7f06bdac9640 1 -- 172.21.15.8:0/3496820062 wait complete. 2023-11-18T23:41:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.721+0000 7f06bdac9640 1 Processor -- start 2023-11-18T23:41:25.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.721+0000 7f06bdac9640 1 -- start start 2023-11-18T23:41:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06bdac9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b80b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06bdac9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06b809a530 0x7f06b8152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06bdac9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06b80cf890 0x7f06b815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06bdac9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8152740 con 0x7f06b8099970 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06bdac9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80b4f60 con 0x7f06b809a530 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06bdac9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80b5240 con 0x7f06b80cf890 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b80b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b80b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48890/0 (socket says 172.21.15.8:48890) 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 -- 172.21.15.8:0/2874943952 learned_addr learned my addr 172.21.15.8:0/2874943952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b7fff640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06b80cf890 0x7f06b815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b6ffd640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06b809a530 0x7f06b8152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 -- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06b80cf890 msgr2=0x7f06b815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06b80cf890 0x7f06b815a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 -- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06b809a530 msgr2=0x7f06b8152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06b809a530 0x7f06b8152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.722+0000 7f06b77fe640 1 -- 172.21.15.8:0/2874943952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8009400 con 0x7f06b8099970 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.723+0000 7f06b77fe640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b80b5d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009890 tx=0x7f06a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.723+0000 7f069ffff640 1 -- 172.21.15.8:0/2874943952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a803ba70 con 0x7f06b8099970 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.723+0000 7f069ffff640 1 -- 172.21.15.8:0/2874943952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a803bbf0 con 0x7f06b8099970 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.723+0000 7f069ffff640 1 -- 172.21.15.8:0/2874943952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8045400 con 0x7f06b8099970 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.723+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b80b5520 con 0x7f06b8099970 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.723+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b815a730 con 0x7f06b8099970 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.724+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b80b50a0 con 0x7f06b8099970 2023-11-18T23:41:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.724+0000 7f069ffff640 1 -- 172.21.15.8:0/2874943952 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06a804e440 con 0x7f06b8099970 2023-11-18T23:41:25.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.725+0000 7f069ffff640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06a406ae70 0x7f06a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:25.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.725+0000 7f069ffff640 1 -- 172.21.15.8:0/2874943952 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06a80ab9b0 con 0x7f06b8099970 2023-11-18T23:41:25.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.725+0000 7f06b6ffd640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06a406ae70 0x7f06a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:25.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.725+0000 7f06b6ffd640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06a406ae70 0x7f06a406d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06b8152ee0 tx=0x7f06ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:25.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.729+0000 7f069ffff640 1 -- 172.21.15.8:0/2874943952 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06b80b50a0 con 0x7f06b8099970 2023-11-18T23:41:25.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.906+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06b80b5a40 con 0x7f06b8099970 2023-11-18T23:41:25.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.907+0000 7f069ffff640 1 -- 172.21.15.8:0/2874943952 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f06b80b5a40 con 0x7f06b8099970 2023-11-18T23:41:25.908 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:25.908 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:25.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06a406ae70 msgr2=0x7f06a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06a406ae70 0x7f06a406d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06b8152ee0 tx=0x7f06ac008040 comp rx=0 tx=0).stop 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 msgr2=0x7f06b80b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b80b5d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009890 tx=0x7f06a80046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 shutdown_connections 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f06a406ae70 0x7f06a406d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06b80cf890 0x7f06b815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06b809a530 0x7f06b8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 --2- 172.21.15.8:0/2874943952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b8099970 0x7f06b80b5d20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 >> 172.21.15.8:0/2874943952 conn(0x7f06b80b2a70 msgr2=0x7f06b80ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 shutdown_connections 2023-11-18T23:41:25.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:25.909+0000 7f06bdac9640 1 -- 172.21.15.8:0/2874943952 wait complete. 2023-11-18T23:41:25.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:26.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.026+0000 7f479d9b0640 1 Processor -- start 2023-11-18T23:41:26.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.026+0000 7f479d9b0640 1 -- start start 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f479d9b0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4798161100 0x7f4798161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f479d9b0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47980b0ee0 0x7f47980b1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f479d9b0640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4798161eb0 con 0x7f479806bff0 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f479d9b0640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980cd8f0 con 0x7f47980b0ee0 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f479d9b0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980cdbd0 con 0x7f4798161100 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f47977fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47980b0ee0 0x7f47980b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f4796ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f479806bff0 0x7f479806c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47874/0 (socket says 172.21.15.8:47874) 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f4796ffd640 1 -- 172.21.15.8:0/223664324 learned_addr learned my addr 172.21.15.8:0/223664324 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f47967fc640 1 --2- 172.21.15.8:0/223664324 >> v2:172.21.15.116:3300/0 conn(0x7f4798161100 0x7f4798161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f47977fe640 1 -- 172.21.15.8:0/223664324 >> v2:172.21.15.116:3300/0 conn(0x7f4798161100 msgr2=0x7f4798161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f47977fe640 1 --2- 172.21.15.8:0/223664324 >> v2:172.21.15.116:3300/0 conn(0x7f4798161100 0x7f4798161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.027+0000 7f47977fe640 1 -- 172.21.15.8:0/223664324 >> v1:172.21.15.8:6789/0 conn(0x7f479806bff0 legacy=0x7f479806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.028+0000 7f47977fe640 1 -- 172.21.15.8:0/223664324 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980cdeb0 con 0x7f47980b0ee0 2023-11-18T23:41:26.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.028+0000 7f4795ffb640 1 -- 172.21.15.8:0/223664324 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228092795 0 0) 0x7f4798161eb0 con 0x7f479806bff0 2023-11-18T23:41:26.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.028+0000 7f47977fe640 1 --2- 172.21.15.8:0/223664324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47980b0ee0 0x7f47980b1390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47980b0a60 tx=0x7f478802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4ad6f20da1a0eb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.028+0000 7f4795ffb640 1 -- 172.21.15.8:0/223664324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478802cc80 con 0x7f47980b0ee0 2023-11-18T23:41:26.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.028+0000 7f4795ffb640 1 -- 172.21.15.8:0/223664324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478802cde0 con 0x7f47980b0ee0 2023-11-18T23:41:26.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.028+0000 7f4795ffb640 1 -- 172.21.15.8:0/223664324 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788034660 con 0x7f47980b0ee0 2023-11-18T23:41:26.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 -- 172.21.15.8:0/223664324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47980b0ee0 msgr2=0x7f47980b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 --2- 172.21.15.8:0/223664324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47980b0ee0 0x7f47980b1390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47980b0a60 tx=0x7f478802bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 -- 172.21.15.8:0/223664324 shutdown_connections 2023-11-18T23:41:26.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 --2- 172.21.15.8:0/223664324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47980b0ee0 0x7f47980b1390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 --2- 172.21.15.8:0/223664324 >> v2:172.21.15.116:3300/0 conn(0x7f4798161100 0x7f4798161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 -- 172.21.15.8:0/223664324 >> 172.21.15.8:0/223664324 conn(0x7f47980d0f60 msgr2=0x7f47980d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 -- 172.21.15.8:0/223664324 shutdown_connections 2023-11-18T23:41:26.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.029+0000 7f479d9b0640 1 -- 172.21.15.8:0/223664324 wait complete. 2023-11-18T23:41:26.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.030+0000 7f479d9b0640 1 Processor -- start 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.030+0000 7f479d9b0640 1 -- start start 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f479d9b0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f479806bff0 0x7f47980af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f479d9b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47980b0ee0 0x7f479814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f479d9b0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4798161100 0x7f479815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f479d9b0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980b3c20 con 0x7f479806bff0 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f479d9b0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980b3f00 con 0x7f47980b0ee0 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f479d9b0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47980b41e0 con 0x7f4798161100 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f479806bff0 0x7f47980af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f479806bff0 0x7f47980af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48912/0 (socket says 172.21.15.8:48912) 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 -- 172.21.15.8:0/189716571 learned_addr learned my addr 172.21.15.8:0/189716571 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f47977fe640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4798161100 0x7f479815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f47967fc640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47980b0ee0 0x7f479814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 -- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4798161100 msgr2=0x7f479815bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4798161100 0x7f479815bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 -- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47980b0ee0 msgr2=0x7f479814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47980b0ee0 0x7f479814e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.031+0000 7f4796ffd640 1 -- 172.21.15.8:0/189716571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788009a70 con 0x7f479806bff0 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.032+0000 7f4796ffd640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f479806bff0 0x7f47980af840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f479000c430 tx=0x7f479000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.032+0000 7f477ffff640 1 -- 172.21.15.8:0/189716571 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900074e0 con 0x7f479806bff0 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.032+0000 7f477ffff640 1 -- 172.21.15.8:0/189716571 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790007660 con 0x7f479806bff0 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.032+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47980ce830 con 0x7f479806bff0 2023-11-18T23:41:26.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.032+0000 7f477ffff640 1 -- 172.21.15.8:0/189716571 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790004a20 con 0x7f479806bff0 2023-11-18T23:41:26.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.032+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47980b47a0 con 0x7f479806bff0 2023-11-18T23:41:26.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.033+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4798068470 con 0x7f479806bff0 2023-11-18T23:41:26.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.033+0000 7f477ffff640 1 -- 172.21.15.8:0/189716571 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4790004b80 con 0x7f479806bff0 2023-11-18T23:41:26.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.034+0000 7f477ffff640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f478406ae40 0x7f478406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.034+0000 7f477ffff640 1 -- 172.21.15.8:0/189716571 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47900892f0 con 0x7f479806bff0 2023-11-18T23:41:26.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.034+0000 7f47967fc640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f478406ae40 0x7f478406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.034+0000 7f47967fc640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f478406ae40 0x7f478406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f47980b6f60 tx=0x7f478c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.038+0000 7f477ffff640 1 -- 172.21.15.8:0/189716571 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4790054450 con 0x7f479806bff0 2023-11-18T23:41:26.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.250+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f479806bdd0 con 0x7f479806bff0 2023-11-18T23:41:26.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.250+0000 7f477ffff640 1 -- 172.21.15.8:0/189716571 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f4790057a70 con 0x7f479806bff0 2023-11-18T23:41:26.252 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:26.252 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:26.252 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:26.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f478406ae40 msgr2=0x7f478406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f478406ae40 0x7f478406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f47980b6f60 tx=0x7f478c008040 comp rx=0 tx=0).stop 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f479806bff0 msgr2=0x7f47980af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f479806bff0 0x7f47980af840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f479000c430 tx=0x7f479000c8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 shutdown_connections 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f478406ae40 0x7f478406d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4798161100 0x7f479815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47980b0ee0 0x7f479814e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 --2- 172.21.15.8:0/189716571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f479806bff0 0x7f47980af840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 >> 172.21.15.8:0/189716571 conn(0x7f47980d0f60 msgr2=0x7f479806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 shutdown_connections 2023-11-18T23:41:26.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.252+0000 7f479d9b0640 1 -- 172.21.15.8:0/189716571 wait complete. 2023-11-18T23:41:26.666 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T23:41:11.303324+0000', 'modified': '2023-11-18T23:41:14.320612+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.116:6837/362949934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6835', 'nonce': 362949934}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 362949934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T23:41:26.667 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T23:41:26.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-18T23:41:26.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.778+0000 7f26ee244640 1 Processor -- start 2023-11-18T23:41:26.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.778+0000 7f26ee244640 1 -- start start 2023-11-18T23:41:26.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26ee244640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f26e806e460 0x7f26e815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26ee244640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e809a720 con 0x7f26e806ec60 2023-11-18T23:41:26.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26ee244640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e8099b10 con 0x7f26e815d690 2023-11-18T23:41:26.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26ee244640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e815e9d0 con 0x7f26e806e460 2023-11-18T23:41:26.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26e7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f26e806e460 0x7f26e815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26e77fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f26e806ec60 0x7f26e806f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47888/0 (socket says 172.21.15.8:47888) 2023-11-18T23:41:26.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26e7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f26e806e460 0x7f26e815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48928/0 (socket says 172.21.15.8:48928) 2023-11-18T23:41:26.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.779+0000 7f26e77fe640 1 -- 172.21.15.8:0/722554294 learned_addr learned my addr 172.21.15.8:0/722554294 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:26.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.780+0000 7f26e7fff640 1 -- 172.21.15.8:0/722554294 >> v1:172.21.15.116:6789/0 conn(0x7f26e815d690 legacy=0x7f26e80cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.780+0000 7f26e7fff640 1 -- 172.21.15.8:0/722554294 >> v1:172.21.15.8:6789/0 conn(0x7f26e806ec60 legacy=0x7f26e806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.780+0000 7f26e7fff640 1 -- 172.21.15.8:0/722554294 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e8099df0 con 0x7f26e806e460 2023-11-18T23:41:26.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.780+0000 7f26e7fff640 1 --2- 172.21.15.8:0/722554294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e806e460 0x7f26e815e490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009d90 tx=0x7f26e002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3731e109fa93e6ce server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26e67fc640 1 -- 172.21.15.8:0/722554294 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e002cc60 con 0x7f26e806e460 2023-11-18T23:41:26.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26e67fc640 1 -- 172.21.15.8:0/722554294 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e002cdc0 con 0x7f26e806e460 2023-11-18T23:41:26.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26e67fc640 1 -- 172.21.15.8:0/722554294 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0034660 con 0x7f26e806e460 2023-11-18T23:41:26.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26ee244640 1 -- 172.21.15.8:0/722554294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e806e460 msgr2=0x7f26e815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26ee244640 1 --2- 172.21.15.8:0/722554294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e806e460 0x7f26e815e490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009d90 tx=0x7f26e002beb0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26ee244640 1 -- 172.21.15.8:0/722554294 shutdown_connections 2023-11-18T23:41:26.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26ee244640 1 --2- 172.21.15.8:0/722554294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e806e460 0x7f26e815e490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26ee244640 1 -- 172.21.15.8:0/722554294 >> 172.21.15.8:0/722554294 conn(0x7f26e80b2a20 msgr2=0x7f26e80b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26ee244640 1 -- 172.21.15.8:0/722554294 shutdown_connections 2023-11-18T23:41:26.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.781+0000 7f26ee244640 1 -- 172.21.15.8:0/722554294 wait complete. 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.782+0000 7f26ee244640 1 Processor -- start 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26ee244640 1 -- start start 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26ee244640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26e806e460 0x7f26e81f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26ee244640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26e806ec60 0x7f26e81e7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26ee244640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e815fe70 0x7f26e80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26ee244640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e8160f20 con 0x7f26e815fe70 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26ee244640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e8148bb0 con 0x7f26e806e460 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26ee244640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e81e79d0 con 0x7f26e806ec60 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e815fe70 0x7f26e80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e815fe70 0x7f26e80b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48932/0 (socket says 172.21.15.8:48932) 2023-11-18T23:41:26.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.783+0000 7f26e7fff640 1 -- 172.21.15.8:0/3409437030 learned_addr learned my addr 172.21.15.8:0/3409437030 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26e806e460 0x7f26e81f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26e806ec60 0x7f26e81e7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e7fff640 1 -- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26e806ec60 msgr2=0x7f26e81e7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e7fff640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26e806ec60 0x7f26e81e7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e7fff640 1 -- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26e806e460 msgr2=0x7f26e81f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e7fff640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26e806e460 0x7f26e81f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e7fff640 1 -- 172.21.15.8:0/3409437030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0009a70 con 0x7f26e815fe70 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26e7fff640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e815fe70 0x7f26e80b3b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009eb0 tx=0x7f26e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26cffff640 1 -- 172.21.15.8:0/3409437030 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0040650 con 0x7f26e815fe70 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26cffff640 1 -- 172.21.15.8:0/3409437030 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e00407d0 con 0x7f26e815fe70 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26cffff640 1 -- 172.21.15.8:0/3409437030 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0040b80 con 0x7f26e815fe70 2023-11-18T23:41:26.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e8160310 con 0x7f26e815fe70 2023-11-18T23:41:26.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.784+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e81608d0 con 0x7f26e815fe70 2023-11-18T23:41:26.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.785+0000 7f26cffff640 1 -- 172.21.15.8:0/3409437030 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26e0040ce0 con 0x7f26e815fe70 2023-11-18T23:41:26.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.786+0000 7f26cffff640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f26d406ae40 0x7f26d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.786+0000 7f26cffff640 1 -- 172.21.15.8:0/3409437030 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26e00ac5b0 con 0x7f26e815fe70 2023-11-18T23:41:26.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.786+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f26d406ae40 0x7f26d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.787+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f26d406ae40 0x7f26d406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f26d8005880 tx=0x7f26d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.787+0000 7f26f0dd2740 1 Processor -- start 2023-11-18T23:41:26.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.787+0000 7f26f0dd2740 1 -- start start 2023-11-18T23:41:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a354b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a384920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a355070 0x56456a384e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a3158c0 con 0x56456a381b90 2023-11-18T23:41:26.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a2c7b90 con 0x56456a381f70 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456a2c5280 con 0x56456a355070 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a354b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a354b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48946/0 (socket says 172.21.15.8:48946) 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 -- 172.21.15.8:0/1981398176 learned_addr learned my addr 172.21.15.8:0/1981398176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e7fff640 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a355070 0x56456a384e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a384920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 -- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a355070 msgr2=0x56456a384e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a355070 0x56456a384e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 -- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 msgr2=0x56456a384920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a384920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.788+0000 7f26e77fe640 1 -- 172.21.15.8:0/1981398176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56456a286500 con 0x56456a381b90 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26e77fe640 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a354b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f26d80058b0 tx=0x7f26d8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccb71652dd78018 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26cd7fa640 1 -- 172.21.15.8:0/1981398176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8005e30 con 0x56456a381b90 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26cd7fa640 1 -- 172.21.15.8:0/1981398176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800e7b0 con 0x56456a381b90 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26cd7fa640 1 -- 172.21.15.8:0/1981398176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800eb20 con 0x56456a381b90 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 -- 172.21.15.8:0/1981398176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 msgr2=0x56456a354b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a354b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f26d80058b0 tx=0x7f26d8011000 comp rx=0 tx=0).stop 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 -- 172.21.15.8:0/1981398176 shutdown_connections 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a355070 0x56456a384e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a384920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/1981398176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a354b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 -- 172.21.15.8:0/1981398176 >> 172.21.15.8:0/1981398176 conn(0x56456a356da0 msgr2=0x56456a39f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 -- 172.21.15.8:0/1981398176 shutdown_connections 2023-11-18T23:41:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.789+0000 7f26f0dd2740 1 -- 172.21.15.8:0/1981398176 wait complete. 2023-11-18T23:41:26.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.790+0000 7f26f0dd2740 1 -- start start 2023-11-18T23:41:26.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.790+0000 7f26f0dd2740 1 Processor -- start 2023-11-18T23:41:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a370190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a39a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a3877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a2c0b70 con 0x56456a381b90 2023-11-18T23:41:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a27ae00 con 0x56456a381f70 2023-11-18T23:41:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456a27aaa0 con 0x56456a387320 2023-11-18T23:41:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26f0dd2740 10 client.0 _ll_register_callbacks cb 0x564569fd2ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a370190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a370190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48956/0 (socket says 172.21.15.8:48956) 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 -- 172.21.15.8:0/3949332646 learned_addr learned my addr 172.21.15.8:0/3949332646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a39a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e7fff640 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a3877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 -- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 msgr2=0x56456a3877a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a3877a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 -- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 msgr2=0x56456a39a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a39a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 -- 172.21.15.8:0/3949332646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d800f040 con 0x56456a381b90 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a370190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26d800ebe0 tx=0x7f26d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14658e09dd34503 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.791+0000 7f26c67fc640 1 -- 172.21.15.8:0/3949332646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8005e30 con 0x56456a381b90 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26c67fc640 1 -- 172.21.15.8:0/3949332646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26d8028070 con 0x56456a381b90 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56456a2b9b50 con 0x56456a381b90 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26c67fc640 1 -- 172.21.15.8:0/3949332646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26d8021450 con 0x56456a381b90 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 10 client.4698 fetch_fsmap learned FSMap version 8 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56456a2bf1f0 con 0x56456a381b90 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26c67fc640 1 -- 172.21.15.8:0/3949332646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56456a2b9b50 con 0x56456a381b90 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26c67fc640 1 -- 172.21.15.8:0/3949332646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f26d802c420 con 0x56456a381b90 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 10 client.4698 fetch_fsmap finished waiting for FSMap version 8 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 10 client.4698 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 20 client.4698 populate_metadata read hostname 'smithi008' 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a372240 0x56456a396420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 4 client.4698 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 --> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56456a2b9870 con 0x56456a372240 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.792+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a372240 0x56456a396420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26c67fc640 10 client.4698 ms_handle_connect on v2:172.21.15.116:6835/362949934 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a372240 0x56456a396420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5ff78119673ce8 server_cookie=10a9ba07ab41ef69 in_seq=0 out_seq=0 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26c67fc640 1 -- 172.21.15.8:0/3949332646 <== mds.0 v2:172.21.15.116:6835/362949934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56456a2b9870 con 0x56456a372240 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26c67fc640 10 client.4698 handle_command_reply: tid=0 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 client.4698 shutdown 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 msgr2=0x56456a370190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a370190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26d800ebe0 tx=0x7f26d8000ed0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 shutdown_connections 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a372240 0x56456a396420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a3877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a39a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3949332646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a370190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26c67fc640 0 client.4698 ms_handle_reset on v2:172.21.15.116:6835/362949934 2023-11-18T23:41:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.793+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 >> 172.21.15.8:0/3949332646 conn(0x56456a355070 msgr2=0x56456a358ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.794+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 shutdown_connections 2023-11-18T23:41:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.794+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3949332646 wait complete. 2023-11-18T23:41:26.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.794+0000 7f26f0dd2740 20 client.4698 trim_cache size 0 max 16384 2023-11-18T23:41:26.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.809+0000 7f26f0dd2740 1 Processor -- start 2023-11-18T23:41:26.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.809+0000 7f26f0dd2740 1 -- start start 2023-11-18T23:41:26.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a385030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a3a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a36f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a240270 con 0x56456a381b90 2023-11-18T23:41:26.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a3b3050 con 0x56456a381f70 2023-11-18T23:41:26.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456a3c2880 con 0x56456a387320 2023-11-18T23:41:26.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a385030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a385030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48962/0 (socket says 172.21.15.8:48962) 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 -- 172.21.15.8:0/3372994270 learned_addr learned my addr 172.21.15.8:0/3372994270 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a3a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e7fff640 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a36f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 -- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 msgr2=0x56456a36f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a36f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 -- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 msgr2=0x56456a3a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a3a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.810+0000 7f26e77fe640 1 -- 172.21.15.8:0/3372994270 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56456a25cd00 con 0x56456a381b90 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26e77fe640 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a385030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f26d8007bb0 tx=0x7f26d8028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2c5ce658604076 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26cdffb640 1 -- 172.21.15.8:0/3372994270 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d803b070 con 0x56456a381b90 2023-11-18T23:41:26.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26cdffb640 1 -- 172.21.15.8:0/3372994270 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8019070 con 0x56456a381b90 2023-11-18T23:41:26.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26cdffb640 1 -- 172.21.15.8:0/3372994270 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800ec10 con 0x56456a381b90 2023-11-18T23:41:26.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3372994270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 msgr2=0x56456a385030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a385030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f26d8007bb0 tx=0x7f26d8028000 comp rx=0 tx=0).stop 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3372994270 shutdown_connections 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a387320 0x56456a36f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381f70 0x56456a3a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/3372994270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a381b90 0x56456a385030 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3372994270 >> 172.21.15.8:0/3372994270 conn(0x56456a355070 msgr2=0x56456a358ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3372994270 shutdown_connections 2023-11-18T23:41:26.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.811+0000 7f26f0dd2740 1 -- 172.21.15.8:0/3372994270 wait complete. 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.812+0000 7f26f0dd2740 1 -- start start 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.812+0000 7f26f0dd2740 1 Processor -- start 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381b90 0x56456a409bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a381f70 0x56456a353c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26f0dd2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a387320 0x56456a3541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a40a6e0 con 0x56456a387320 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456a40d710 con 0x56456a381b90 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26f0dd2740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456a40d960 con 0x56456a381f70 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26f0dd2740 10 client.0 _ll_register_callbacks cb 0x7f26d8007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T23:41:26.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a387320 0x56456a3541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a387320 0x56456a3541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48978/0 (socket says 172.21.15.8:48978) 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 -- 172.21.15.8:0/2315174272 learned_addr learned my addr 172.21.15.8:0/2315174272 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e77fe640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381b90 0x56456a409bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a381f70 0x56456a353c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 -- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a381f70 msgr2=0x56456a353c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a381f70 0x56456a353c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 -- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381b90 msgr2=0x56456a409bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381b90 0x56456a409bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 -- 172.21.15.8:0/2315174272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56456a2bf1f0 con 0x56456a387320 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e6ffd640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a381f70 0x56456a353c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:26.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26e7fff640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a387320 0x56456a3541a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f26e00aaad0 tx=0x7f26e007b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6ddebc46bd4630 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26c67fc640 1 -- 172.21.15.8:0/2315174272 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e007b4f0 con 0x56456a387320 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.813+0000 7f26c67fc640 1 -- 172.21.15.8:0/2315174272 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26e007b650 con 0x56456a387320 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26d800e7b0 con 0x56456a387320 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26c67fc640 1 -- 172.21.15.8:0/2315174272 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26e007a780 con 0x56456a387320 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 10 client.4704 fetch_fsmap learned FSMap version 8 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56456a2824f0 con 0x56456a387320 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26c67fc640 1 -- 172.21.15.8:0/2315174272 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800e7b0 con 0x56456a387320 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26c67fc640 1 -- 172.21.15.8:0/2315174272 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f26e0050020 con 0x56456a387320 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 10 client.4704 fetch_fsmap finished waiting for FSMap version 8 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 10 client.4704 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T23:41:26.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 20 client.4704 populate_metadata read hostname 'smithi008' 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a3b9910 0x56456a3b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 4 client.4704 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 --> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564569fc16c0 con 0x56456a3b9910 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26e77fe640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a3b9910 0x56456a3b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26c67fc640 10 client.4704 ms_handle_connect on v2:172.21.15.116:6835/362949934 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.814+0000 7f26e77fe640 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a3b9910 0x56456a3b9cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6983a1b45bcdd027 server_cookie=f12b456edb0da89a in_seq=0 out_seq=0 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26c67fc640 1 -- 172.21.15.8:0/2315174272 <== mds.0 v2:172.21.15.116:6835/362949934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564569fc16c0 con 0x56456a3b9910 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26c67fc640 10 client.4704 handle_command_reply: tid=0 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 client.4704 shutdown 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a387320 msgr2=0x56456a3541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a387320 0x56456a3541a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f26e00aaad0 tx=0x7f26e007b3e0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 shutdown_connections 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:6835/362949934,v1:172.21.15.116:6837/362949934] conn(0x56456a3b9910 0x56456a3b9cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56456a387320 0x56456a3541a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56456a381f70 0x56456a353c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 --2- 172.21.15.8:0/2315174272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56456a381b90 0x56456a409bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 >> 172.21.15.8:0/2315174272 conn(0x56456a355070 msgr2=0x56456a358ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26c67fc640 0 client.4704 ms_handle_reset on v2:172.21.15.116:6835/362949934 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 shutdown_connections 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 1 -- 172.21.15.8:0/2315174272 wait complete. 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26f0dd2740 20 client.4704 trim_cache size 0 max 16384 2023-11-18T23:41:26.825 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "45315d48-6a4a-4df1-b021-4a12da37b9ab", 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4288, 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 14.864440516, 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 8, 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 20, 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 20, 2023-11-18T23:41:26.826 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 21.911102550999999 2023-11-18T23:41:26.827 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-11-18T23:41:26.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f26d406ae40 msgr2=0x7f26d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26ee244640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f26d406ae40 0x7f26d406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f26d8005880 tx=0x7f26d8009040 comp rx=0 tx=0).stop 2023-11-18T23:41:26.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e815fe70 msgr2=0x7f26e80b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26ee244640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e815fe70 0x7f26e80b3b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009eb0 tx=0x7f26e0004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 shutdown_connections 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26ee244640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f26d406ae40 0x7f26d406d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.815+0000 7f26ee244640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26e815fe70 0x7f26e80b3b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.816+0000 7f26ee244640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26e806ec60 0x7f26e81e7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.816+0000 7f26ee244640 1 --2- 172.21.15.8:0/3409437030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26e806e460 0x7f26e81f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.816+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 >> 172.21.15.8:0/3409437030 conn(0x7f26e80b2a20 msgr2=0x7f26e80adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.816+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 shutdown_connections 2023-11-18T23:41:26.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:26.816+0000 7f26ee244640 1 -- 172.21.15.8:0/3409437030 wait complete. 2023-11-18T23:41:26.829 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-18T23:41:26.850 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-18T23:41:26.851 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-18T23:41:26.851 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-18T23:41:26.851 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T23:41:26.851 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:26.851 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-18T23:41:26.851 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T23:41:26.851 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:26.851 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-18T23:41:26.851 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T23:41:26.852 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:26.852 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-18T23:41:26.852 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T23:41:26.852 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:26.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:26.852 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-11-18T23:41:26.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:26.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2023-11-18T23:41:26.945 INFO:teuthology.orchestra.run.smithi116.stderr:Cannot find device "ceph-brx" 2023-11-18T23:41:26.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T23:41:26.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:26.947 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-11-18T23:41:26.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:26.963 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-11-18T23:41:27.036 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-11-18T23:41:27.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T23:41:27.038 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-18T23:41:27.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T23:41:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.182+0000 7f821836c640 1 Processor -- start 2023-11-18T23:41:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.182+0000 7f821836c640 1 -- start start 2023-11-18T23:41:27.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f821836c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82100af340 0x7f8210071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:27.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f821836c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8210071870 0x7f821006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:27.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f821836c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82100af7a0 con 0x7f82100cbaa0 2023-11-18T23:41:27.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f821836c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821006f230 con 0x7f82100af340 2023-11-18T23:41:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f821836c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8210071d00 con 0x7f8210071870 2023-11-18T23:41:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f8215907640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82100af340 0x7f8210071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f8216108640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f82100cbaa0 0x7f821006ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47898/0 (socket says 172.21.15.8:47898) 2023-11-18T23:41:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f8215907640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82100af340 0x7f8210071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48980/0 (socket says 172.21.15.8:48980) 2023-11-18T23:41:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.183+0000 7f8216108640 1 -- 172.21.15.8:0/297753109 learned_addr learned my addr 172.21.15.8:0/297753109 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.184+0000 7f8215907640 1 -- 172.21.15.8:0/297753109 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8210071870 msgr2=0x7f821006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.184+0000 7f8215907640 1 --2- 172.21.15.8:0/297753109 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8210071870 0x7f821006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.184+0000 7f8215907640 1 -- 172.21.15.8:0/297753109 >> v1:172.21.15.8:6789/0 conn(0x7f82100cbaa0 legacy=0x7f821006ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:27.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.184+0000 7f8215106640 1 -- 172.21.15.8:0/297753109 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481732123 0 0) 0x7f8208001110 con 0x7f82100cbaa0 2023-11-18T23:41:27.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.184+0000 7f8215907640 1 -- 172.21.15.8:0/297753109 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821006ec70 con 0x7f82100af340 2023-11-18T23:41:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f8215907640 1 --2- 172.21.15.8:0/297753109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100af340 0x7f8210071330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82040097d0 tx=0x7f820402b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c410eb73557ef3e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f8215106640 1 -- 172.21.15.8:0/297753109 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204031770 con 0x7f82100af340 2023-11-18T23:41:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f8215106640 1 -- 172.21.15.8:0/297753109 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82040318d0 con 0x7f82100af340 2023-11-18T23:41:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f8215106640 1 -- 172.21.15.8:0/297753109 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204031c60 con 0x7f82100af340 2023-11-18T23:41:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 -- 172.21.15.8:0/297753109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100af340 msgr2=0x7f8210071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 --2- 172.21.15.8:0/297753109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100af340 0x7f8210071330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82040097d0 tx=0x7f820402b810 comp rx=0 tx=0).stop 2023-11-18T23:41:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 -- 172.21.15.8:0/297753109 shutdown_connections 2023-11-18T23:41:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 --2- 172.21.15.8:0/297753109 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8210071870 0x7f821006d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 --2- 172.21.15.8:0/297753109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100af340 0x7f8210071330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 -- 172.21.15.8:0/297753109 >> 172.21.15.8:0/297753109 conn(0x7f82100cfe80 msgr2=0x7f82100d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 -- 172.21.15.8:0/297753109 shutdown_connections 2023-11-18T23:41:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.185+0000 7f821836c640 1 -- 172.21.15.8:0/297753109 wait complete. 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.186+0000 7f821836c640 1 Processor -- start 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.186+0000 7f821836c640 1 -- start start 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f821836c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8210071870 0x7f82100b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f821836c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82100af340 0x7f8210152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f821836c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100cbaa0 0x7f82100c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f821836c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8210154430 con 0x7f82100cbaa0 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f821836c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8210153820 con 0x7f8210071870 2023-11-18T23:41:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f821836c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8210153b00 con 0x7f82100af340 2023-11-18T23:41:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f8216909640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100cbaa0 0x7f82100c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f8216909640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100cbaa0 0x7f82100c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48996/0 (socket says 172.21.15.8:48996) 2023-11-18T23:41:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.187+0000 7f8216909640 1 -- 172.21.15.8:0/1834108181 learned_addr learned my addr 172.21.15.8:0/1834108181 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216108640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8210071870 0x7f82100b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8215907640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82100af340 0x7f8210152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216909640 1 -- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82100af340 msgr2=0x7f8210152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216909640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82100af340 0x7f8210152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216909640 1 -- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8210071870 msgr2=0x7f82100b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216909640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8210071870 0x7f82100b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216909640 1 -- 172.21.15.8:0/1834108181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009400 con 0x7f82100cbaa0 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216108640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8210071870 0x7f82100b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f8216909640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100cbaa0 0x7f82100c6f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f820000b970 tx=0x7f820000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f820effd640 1 -- 172.21.15.8:0/1834108181 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000cb40 con 0x7f82100cbaa0 2023-11-18T23:41:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f820effd640 1 -- 172.21.15.8:0/1834108181 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820000ccc0 con 0x7f82100cbaa0 2023-11-18T23:41:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8210153de0 con 0x7f82100cbaa0 2023-11-18T23:41:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f820effd640 1 -- 172.21.15.8:0/1834108181 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200014680 con 0x7f82100cbaa0 2023-11-18T23:41:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.188+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82100b5610 con 0x7f82100cbaa0 2023-11-18T23:41:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.189+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82100b5800 con 0x7f82100cbaa0 2023-11-18T23:41:27.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.189+0000 7f820effd640 1 -- 172.21.15.8:0/1834108181 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f820001d3b0 con 0x7f82100cbaa0 2023-11-18T23:41:27.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.190+0000 7f820effd640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f81fc06ae40 0x7f81fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:27.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.190+0000 7f820effd640 1 -- 172.21.15.8:0/1834108181 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8200089650 con 0x7f82100cbaa0 2023-11-18T23:41:27.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.190+0000 7f8216108640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f81fc06ae40 0x7f81fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:27.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.190+0000 7f8216108640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f81fc06ae40 0x7f81fc06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8208000f60 tx=0x7f8208009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:27.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.194+0000 7f820effd640 1 -- 172.21.15.8:0/1834108181 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8200054670 con 0x7f82100cbaa0 2023-11-18T23:41:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.411+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8210068470 con 0x7f82100cbaa0 2023-11-18T23:41:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.411+0000 7f820effd640 1 -- 172.21.15.8:0/1834108181 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8200019070 con 0x7f82100cbaa0 2023-11-18T23:41:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T23:41:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.413+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f81fc06ae40 msgr2=0x7f81fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.413+0000 7f821836c640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f81fc06ae40 0x7f81fc06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8208000f60 tx=0x7f8208009040 comp rx=0 tx=0).stop 2023-11-18T23:41:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.413+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100cbaa0 msgr2=0x7f82100c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.413+0000 7f821836c640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100cbaa0 0x7f82100c6f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f820000b970 tx=0x7f820000be30 comp rx=0 tx=0).stop 2023-11-18T23:41:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.413+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 shutdown_connections 2023-11-18T23:41:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.414+0000 7f821836c640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f81fc06ae40 0x7f81fc06d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.414+0000 7f821836c640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82100cbaa0 0x7f82100c6f50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.414+0000 7f821836c640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82100af340 0x7f8210152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.414+0000 7f821836c640 1 --2- 172.21.15.8:0/1834108181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8210071870 0x7f82100b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.414+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 >> 172.21.15.8:0/1834108181 conn(0x7f82100cfe80 msgr2=0x7f82100d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.414+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 shutdown_connections 2023-11-18T23:41:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:27.414+0000 7f821836c640 1 -- 172.21.15.8:0/1834108181 wait complete. 2023-11-18T23:41:27.426 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T23:41:27.426 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T23:41:27.427 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-11-18T23:41:27.427 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T23:41:27.427 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:27.427 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T23:41:27.427 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T23:41:27.427 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T23:41:27.427 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T23:41:27.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:27.428 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-11-18T23:41:27.443 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:27.444 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-11-18T23:41:27.444 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42676sec preferred_lft 42676sec 2023-11-18T23:41:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2023-11-18T23:41:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:27.446 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-11-18T23:41:27.447 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T23:41:27.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:27.447 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:27.447 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:27.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-11-18T23:41:27.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-11-18T23:41:27.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-11-18T23:41:27.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T23:41:27.448 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:27.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:27.621 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T23:41:27.651 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-11-18T23:41:27.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:27.653 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-11-18T23:41:27.724 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-11-18T23:41:27.725 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T23:41:27.725 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-18T23:41:27.725 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-18T23:41:27.725 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T23:41:27.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:27.726 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:27.726 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:27.726 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-18T23:41:27.726 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-18T23:41:27.726 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-18T23:41:27.726 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:28.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.012 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-11-18T23:41:28.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.028 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-11-18T23:41:28.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.084 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:28.084 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:28.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:28.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-18T23:41:28.084 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:28.173 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-18T23:41:28.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.173 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:28.174 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:28.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-18T23:41:28.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T23:41:28.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-18T23:41:28.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-18T23:41:28.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-18T23:41:28.174 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:28.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.289 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:28.289 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:28.290 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-11-18T23:41:28.290 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T23:41:28.290 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:28.339 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-18T23:41:28.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:28.339 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:28.367 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T23:41:28.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:28.367 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:28.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-11-18T23:41:28.495 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-11-18T23:41:28.552 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-11-18T23:41:28.553 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:28.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.555 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-11-18T23:41:28.607 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-18T23:41:28.608 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-18T23:41:28.651 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-11-18T23:41:28.681 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:28.737 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-11-18T23:41:28.737 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-11-18T23:41:28.737 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-11-18T23:41:28.737 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-11-18T23:41:28.737 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-11-18T23:41:28.737 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-11-18T23:41:28.737 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:28.738 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-11-18T23:41:28.739 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:28.740 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:28.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.740 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-11-18T23:41:28.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:2023-11-18T23:41:28.759+0000 7f0f7ac3c480 -1 init, newargv = 0x5647660f2730 newargc=15 2023-11-18T23:41:28.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[95426]: starting ceph client 2023-11-18T23:41:28.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[95426]: starting fuse 2023-11-18T23:41:28.776 INFO:teuthology.orchestra.run.smithi008.stdout:42 2023-11-18T23:41:28.777 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-18T23:41:28.777 DEBUG:teuthology.orchestra.run.smithi008:> sudo stdin-killer -- python3 -c ' 2023-11-18T23:41:28.777 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2023-11-18T23:41:28.777 DEBUG:teuthology.orchestra.run.smithi008:> import re 2023-11-18T23:41:28.777 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-11-18T23:41:28.777 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2023-11-18T23:41:28.777 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:28.777 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T23:41:28.778 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T23:41:28.779 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2023-11-18T23:41:28.779 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2023-11-18T23:41:28.779 DEBUG:teuthology.orchestra.run.smithi008:> return f 2023-11-18T23:41:28.779 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T23:41:28.779 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:28.779 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.0")) 2023-11-18T23:41:28.779 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-11-18T23:41:28.902 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.0.95426.asok 2023-11-18T23:41:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T23:41:28.913 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.95426.asok 2023-11-18T23:41:28.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:28.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.95426.asok status 2023-11-18T23:41:29.055 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "0", 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "95426", 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:29.056 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4719, 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4719 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2312298840 2023-11-18T23:41:29.057 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2312298840 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.4719 192.168.0.1:0/2312298840", 2023-11-18T23:41:29.058 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "192.168.0.1:0/2312298840", 2023-11-18T23:41:29.059 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2023-11-18T23:41:29.059 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 8, 2023-11-18T23:41:29.059 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 20, 2023-11-18T23:41:29.059 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2023-11-18T23:41:29.059 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2023-11-18T23:41:29.059 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2023-11-18T23:41:29.059 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-11-18T23:41:29.066 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T23:41:29.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.170+0000 7fdf9a3b0640 1 Processor -- start 2023-11-18T23:41:29.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9a3b0640 1 -- start start 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9a3b0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdf9415d3e0 0x7fdf940ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9a3b0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 0x7fdf940d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9a3b0640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940b5f90 con 0x7fdf940d1c60 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9a3b0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940cf170 con 0x7fdf9415d3e0 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9a3b0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940d20f0 con 0x7fdf940ced30 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9894d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdf940d1c60 0x7fdf940b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51498/0 (socket says 172.21.15.8:51498) 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.171+0000 7fdf9894d640 1 -- 172.21.15.8:0/2420870150 learned_addr learned my addr 172.21.15.8:0/2420870150 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf93fff640 1 --2- 172.21.15.8:0/2420870150 >> v2:172.21.15.116:3300/0 conn(0x7fdf9415d3e0 0x7fdf940ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf937fe640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 0x7fdf940d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578126159 0 0) 0x7fdf940b5f90 con 0x7fdf940d1c60 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c003520 con 0x7fdf940d1c60 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019557846 0 0) 0x7fdf7c003520 con 0x7fdf940d1c60 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 msgr2=0x7fdf940d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 0x7fdf940d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 >> v2:172.21.15.116:3300/0 conn(0x7fdf9415d3e0 msgr2=0x7fdf940ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 --2- 172.21.15.8:0/2420870150 >> v2:172.21.15.116:3300/0 conn(0x7fdf9415d3e0 0x7fdf940ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940b61e0 con 0x7fdf940d1c60 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fdf8c0019f0 con 0x7fdf940d1c60 2023-11-18T23:41:29.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 >> v1:172.21.15.8:6789/0 conn(0x7fdf940d1c60 legacy=0x7fdf940b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 0x7fdf7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf7c004d00 0x7fdf7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940cf170 con 0x7fdf7c003970 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940d20f0 con 0x7fdf7c004d00 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c00b980 con 0x7fdf940ced30 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf93fff640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf937fe640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 0x7fdf7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf9894d640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf7c004d00 0x7fdf7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf93fff640 1 -- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 msgr2=0x7fdf7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf93fff640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf940ced30 0x7fdf7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf93fff640 1 -- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf7c004d00 msgr2=0x7fdf7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf93fff640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf7c004d00 0x7fdf7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.172+0000 7fdf93fff640 1 -- 172.21.15.8:0/2420870150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c003520 con 0x7fdf7c003970 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.173+0000 7fdf93fff640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf7c003d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009ac0 tx=0x7fdf7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b788c12d8864e91a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.173+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8802c710 con 0x7fdf7c003970 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.173+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8802c870 con 0x7fdf7c003970 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.173+0000 7fdf92ffd640 1 -- 172.21.15.8:0/2420870150 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8802cc00 con 0x7fdf7c003970 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.174+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/2420870150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 msgr2=0x7fdf7c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.174+0000 7fdf9a3b0640 1 --2- 172.21.15.8:0/2420870150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf7c003d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009ac0 tx=0x7fdf7c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.174+0000 7fdf9894d640 1 -- 172.21.15.8:0/2420870150 reap_dead start 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.174+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/2420870150 shutdown_connections 2023-11-18T23:41:29.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.174+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/2420870150 >> 172.21.15.8:0/2420870150 conn(0x7fdf9409c480 msgr2=0x7fdf940d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:29.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.174+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/2420870150 shutdown_connections 2023-11-18T23:41:29.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.174+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/2420870150 wait complete. 2023-11-18T23:41:29.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.175+0000 7fdf9a3b0640 1 Processor -- start 2023-11-18T23:41:29.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.175+0000 7fdf9a3b0640 1 -- start start 2023-11-18T23:41:29.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf9a3b0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf9409d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf9a3b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf94151630 0x7fdf940cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf9a3b0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf9409f700 0x7fdf9409fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf9a3b0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940a00c0 con 0x7fdf7c003970 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf9a3b0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9409eec0 con 0x7fdf94151630 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf9a3b0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9409de20 con 0x7fdf9409f700 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf9409d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf9409d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34820/0 (socket says 172.21.15.8:34820) 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 -- 172.21.15.8:0/4203860633 learned_addr learned my addr 172.21.15.8:0/4203860633 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf937fe640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf94151630 0x7fdf940cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf9894d640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf9409f700 0x7fdf9409fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 -- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf9409f700 msgr2=0x7fdf9409fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf9409f700 0x7fdf9409fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 -- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf94151630 msgr2=0x7fdf940cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:29.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf94151630 0x7fdf940cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.176+0000 7fdf93fff640 1 -- 172.21.15.8:0/4203860633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9409e100 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.177+0000 7fdf93fff640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf9409d840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf8802c2b0 tx=0x7fdf88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.177+0000 7fdf90ff9640 1 -- 172.21.15.8:0/4203860633 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88003810 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.177+0000 7fdf90ff9640 1 -- 172.21.15.8:0/4203860633 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8802de90 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.177+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9409e3e0 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.177+0000 7fdf90ff9640 1 -- 172.21.15.8:0/4203860633 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88003b70 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.177+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9409e9a0 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.178+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9409eb30 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.178+0000 7fdf90ff9640 1 -- 172.21.15.8:0/4203860633 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf88003cd0 con 0x7fdf7c003970 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.179+0000 7fdf90ff9640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdf8006ae70 0x7fdf8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:29.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.179+0000 7fdf90ff9640 1 -- 172.21.15.8:0/4203860633 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf880ab230 con 0x7fdf7c003970 2023-11-18T23:41:29.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.179+0000 7fdf937fe640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdf8006ae70 0x7fdf8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:29.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.179+0000 7fdf937fe640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdf8006ae70 0x7fdf8006d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf9415b170 tx=0x7fdf84009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:29.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.183+0000 7fdf90ff9640 1 -- 172.21.15.8:0/4203860633 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf880764c0 con 0x7fdf7c003970 2023-11-18T23:41:29.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.397+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf94067420 con 0x7fdf7c003970 2023-11-18T23:41:29.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.397+0000 7fdf90ff9640 1 -- 172.21.15.8:0/4203860633 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdf88079ae0 con 0x7fdf7c003970 2023-11-18T23:41:29.400 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdf8006ae70 msgr2=0x7fdf8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdf8006ae70 0x7fdf8006d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf9415b170 tx=0x7fdf84009190 comp rx=0 tx=0).stop 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 msgr2=0x7fdf9409d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf9409d840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf8802c2b0 tx=0x7fdf88004730 comp rx=0 tx=0).stop 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 shutdown_connections 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdf8006ae70 0x7fdf8006d330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf9409f700 0x7fdf9409fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf94151630 0x7fdf940cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 --2- 172.21.15.8:0/4203860633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf7c003970 0x7fdf9409d840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:29.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 >> 172.21.15.8:0/4203860633 conn(0x7fdf9409c480 msgr2=0x7fdf940ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:29.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 shutdown_connections 2023-11-18T23:41:29.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:29.399+0000 7fdf9a3b0640 1 -- 172.21.15.8:0/4203860633 wait complete. 2023-11-18T23:41:29.412 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T23:41:29.412 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T23:41:29.412 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-11-18T23:41:29.412 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-18T23:41:29.412 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:29.412 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T23:41:29.413 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T23:41:29.413 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T23:41:29.413 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-18T23:41:29.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.413 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:29.429 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42674sec preferred_lft 42674sec 2023-11-18T23:41:29.430 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 9e:71:02:ce:29:b9 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::6034:e4ff:feb6:ecb/64 scope link 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T23:41:29.431 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 9e:71:02:ce:29:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:29.432 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::9c71:2ff:fece:29b9/64 scope link 2023-11-18T23:41:29.432 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.432 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T23:41:29.498 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-11-18T23:41:29.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.500 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-11-18T23:41:29.556 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-11-18T23:41:29.557 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T23:41:29.557 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-18T23:41:29.557 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-18T23:41:29.557 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T23:41:29.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.557 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:29.557 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:29.557 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-18T23:41:29.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-18T23:41:29.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-18T23:41:29.558 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:29.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.663 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-11-18T23:41:29.678 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T23:41:29.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.679 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-11-18T23:41:29.733 INFO:teuthology.orchestra.run.smithi008.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-18T23:41:29.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.734 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:29.734 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:29.734 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:41:29.734 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-18T23:41:29.734 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:29.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.822 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-18T23:41:29.851 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 4a:d0:8f:e7:bc:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-18T23:41:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::48d0:8fff:fee7:bc6e/64 scope link 2023-11-18T23:41:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-18T23:41:29.924 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 4a:d0:8f:e7:bc:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::48d0:8fff:fee7:bc6e/64 scope link 2023-11-18T23:41:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:29.926 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-18T23:41:29.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-18T23:41:29.927 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:30.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:30.068 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:41:30.069 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:41:30.069 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.1 up 2023-11-18T23:41:30.069 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.1 master ceph-brx 2023-11-18T23:41:30.069 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:41:30.118 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-18T23:41:30.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:30.118 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:30.132 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-18T23:41:30.133 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:30.133 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:30.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-11-18T23:41:30.260 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:30.317 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-11-18T23:41:30.318 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-11-18T23:41:30.319 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:41:30.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:30.321 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-11-18T23:41:30.373 INFO:teuthology.orchestra.run.smithi008.stdout:42 2023-11-18T23:41:30.373 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-11-18T23:41:30.373 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-18T23:41:30.415 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-11-18T23:41:30.446 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-11-18T23:41:30.505 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-11-18T23:41:30.506 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:30.507 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:41:30.508 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:41:30.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:30.508 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-11-18T23:41:30.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi008.stderr:2023-11-18T23:41:30.511+0000 7fa7b743c480 -1 init, newargv = 0x555b475e94b0 newargc=15 2023-11-18T23:41:30.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi008.stderr:ceph-fuse[95904]: starting ceph client 2023-11-18T23:41:30.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi008.stderr:ceph-fuse[95904]: starting fuse 2023-11-18T23:41:30.528 INFO:teuthology.orchestra.run.smithi008.stdout:42 2023-11-18T23:41:30.528 INFO:teuthology.orchestra.run.smithi008.stdout:44 2023-11-18T23:41:30.528 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-11-18T23:41:30.528 DEBUG:teuthology.orchestra.run.smithi008:> sudo stdin-killer -- python3 -c ' 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> import re 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2023-11-18T23:41:30.529 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> return f 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.2")) 2023-11-18T23:41:30.530 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-11-18T23:41:30.657 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.2.95904.asok 2023-11-18T23:41:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T23:41:30.668 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.95904.asok 2023-11-18T23:41:30.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:30.668 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.95904.asok status 2023-11-18T23:41:30.810 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "2", 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "95904", 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2023-11-18T23:41:30.811 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4734, 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4734 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.2:0", 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 4279955788 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:41:30.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.2:0", 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 4279955788 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.4734 192.168.0.2:0/4279955788", 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "192.168.0.2:0/4279955788", 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 8, 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 20, 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2023-11-18T23:41:30.813 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2023-11-18T23:41:30.814 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2023-11-18T23:41:30.814 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-11-18T23:41:30.819 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T23:41:30.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.924+0000 7fd228c94640 1 Processor -- start 2023-11-18T23:41:30.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.924+0000 7fd228c94640 1 -- start start 2023-11-18T23:41:30.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd228c94640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd224142d20 0x7fd224071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:30.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd228c94640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd2240b1df0 0x7fd22406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd228c94640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2240b3130 con 0x7fd22406da60 2023-11-18T23:41:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd228c94640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22406ded0 con 0x7fd2240b1df0 2023-11-18T23:41:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd228c94640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd224143100 con 0x7fd224142d20 2023-11-18T23:41:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd221d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd2240b1df0 0x7fd22406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd221d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd2240b1df0 0x7fd22406d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34834/0 (socket says 172.21.15.8:34834) 2023-11-18T23:41:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.925+0000 7fd221d9b640 1 -- 172.21.15.8:0/3189790934 learned_addr learned my addr 172.21.15.8:0/3189790934 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.926+0000 7fd221d9b640 1 -- 172.21.15.8:0/3189790934 >> v2:172.21.15.116:3300/0 conn(0x7fd224142d20 msgr2=0x7fd224071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.926+0000 7fd221d9b640 1 --2- 172.21.15.8:0/3189790934 >> v2:172.21.15.116:3300/0 conn(0x7fd224142d20 0x7fd224071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.926+0000 7fd221d9b640 1 -- 172.21.15.8:0/3189790934 >> v1:172.21.15.116:6789/0 conn(0x7fd22406da60 legacy=0x7fd2240b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.926+0000 7fd221d9b640 1 -- 172.21.15.8:0/3189790934 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240b2250 con 0x7fd2240b1df0 2023-11-18T23:41:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.926+0000 7fd221d9b640 1 --2- 172.21.15.8:0/3189790934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2240b1df0 0x7fd22406d520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd22406ba70 tx=0x7fd20c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e40a176314f64f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd22159a640 1 -- 172.21.15.8:0/3189790934 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c031870 con 0x7fd2240b1df0 2023-11-18T23:41:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd22159a640 1 -- 172.21.15.8:0/3189790934 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0319d0 con 0x7fd2240b1df0 2023-11-18T23:41:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd22159a640 1 -- 172.21.15.8:0/3189790934 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c031d60 con 0x7fd2240b1df0 2023-11-18T23:41:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 -- 172.21.15.8:0/3189790934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2240b1df0 msgr2=0x7fd22406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 --2- 172.21.15.8:0/3189790934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2240b1df0 0x7fd22406d520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd22406ba70 tx=0x7fd20c02b910 comp rx=0 tx=0).stop 2023-11-18T23:41:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 -- 172.21.15.8:0/3189790934 shutdown_connections 2023-11-18T23:41:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 --2- 172.21.15.8:0/3189790934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2240b1df0 0x7fd22406d520 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 --2- 172.21.15.8:0/3189790934 >> v2:172.21.15.116:3300/0 conn(0x7fd224142d20 0x7fd224071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 -- 172.21.15.8:0/3189790934 >> 172.21.15.8:0/3189790934 conn(0x7fd2240b0af0 msgr2=0x7fd2240b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 -- 172.21.15.8:0/3189790934 shutdown_connections 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.927+0000 7fd228c94640 1 -- 172.21.15.8:0/3189790934 wait complete. 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 Processor -- start 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 -- start start 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd22406da60 0x7fd2240a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2240b1df0 0x7fd22413e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd224142d20 0x7fd22413ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22413f5f0 con 0x7fd224142d20 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2241e7390 con 0x7fd22406da60 2023-11-18T23:41:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.929+0000 7fd228c94640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2241e62f0 con 0x7fd2240b1df0 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd224142d20 0x7fd22413ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd224142d20 0x7fd22413ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34840/0 (socket says 172.21.15.8:34840) 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 -- 172.21.15.8:0/232373683 learned_addr learned my addr 172.21.15.8:0/232373683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd221d9b640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2240b1df0 0x7fd22413e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd22259c640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd22406da60 0x7fd2240a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 -- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2240b1df0 msgr2=0x7fd22413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2240b1df0 0x7fd22413e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 -- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd22406da60 msgr2=0x7fd2240a8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd22406da60 0x7fd2240a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 -- 172.21.15.8:0/232373683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0094d0 con 0x7fd224142d20 2023-11-18T23:41:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd222d9d640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd224142d20 0x7fd22413ec10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c390 tx=0x7fd21c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd21affd640 1 -- 172.21.15.8:0/232373683 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0035f0 con 0x7fd224142d20 2023-11-18T23:41:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd21affd640 1 -- 172.21.15.8:0/232373683 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c003750 con 0x7fd224142d20 2023-11-18T23:41:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2241e65d0 con 0x7fd224142d20 2023-11-18T23:41:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd21affd640 1 -- 172.21.15.8:0/232373683 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c003b00 con 0x7fd224142d20 2023-11-18T23:41:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.930+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2241e6b90 con 0x7fd224142d20 2023-11-18T23:41:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.931+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd224067420 con 0x7fd224142d20 2023-11-18T23:41:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.932+0000 7fd21affd640 1 -- 172.21.15.8:0/232373683 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd21c003c60 con 0x7fd224142d20 2023-11-18T23:41:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.932+0000 7fd21affd640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd20406ae40 0x7fd20406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.932+0000 7fd21affd640 1 -- 172.21.15.8:0/232373683 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd21c088b20 con 0x7fd224142d20 2023-11-18T23:41:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.932+0000 7fd22259c640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd20406ae40 0x7fd20406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.933+0000 7fd22259c640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd20406ae40 0x7fd20406d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd21400a400 tx=0x7fd21400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:30.937+0000 7fd21affd640 1 -- 172.21.15.8:0/232373683 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd21c053c80 con 0x7fd224142d20 2023-11-18T23:41:31.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.150+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd224071620 con 0x7fd224142d20 2023-11-18T23:41:31.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.150+0000 7fd21affd640 1 -- 172.21.15.8:0/232373683 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd21c017020 con 0x7fd224142d20 2023-11-18T23:41:31.153 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd20406ae40 msgr2=0x7fd20406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd20406ae40 0x7fd20406d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd21400a400 tx=0x7fd21400d040 comp rx=0 tx=0).stop 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd224142d20 msgr2=0x7fd22413ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd224142d20 0x7fd22413ec10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c390 tx=0x7fd21c00c850 comp rx=0 tx=0).stop 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 shutdown_connections 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd20406ae40 0x7fd20406d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd224142d20 0x7fd22413ec10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2240b1df0 0x7fd22413e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:31.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 --2- 172.21.15.8:0/232373683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd22406da60 0x7fd2240a8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:31.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 >> 172.21.15.8:0/232373683 conn(0x7fd2240b0af0 msgr2=0x7fd224140180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:31.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.152+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 shutdown_connections 2023-11-18T23:41:31.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:31.153+0000 7fd228c94640 1 -- 172.21.15.8:0/232373683 wait complete. 2023-11-18T23:41:31.165 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T23:41:31.165 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T23:41:31.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2023-11-18T23:41:31.165 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T23:41:31.165 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:31.165 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T23:41:31.166 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T23:41:31.166 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T23:41:31.166 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T23:41:31.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.166 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:31.185 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42685sec preferred_lft 42685sec 2023-11-18T23:41:31.186 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2023-11-18T23:41:31.187 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:31.187 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T23:41:31.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.187 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:31.187 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:31.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2023-11-18T23:41:31.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2023-11-18T23:41:31.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2023-11-18T23:41:31.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T23:41:31.187 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:31.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.355 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T23:41:31.383 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-11-18T23:41:31.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.384 DEBUG:teuthology.orchestra.run.smithi116:> route 2023-11-18T23:41:31.451 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2023-11-18T23:41:31.451 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T23:41:31.451 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T23:41:31.451 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T23:41:31.451 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T23:41:31.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.452 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:31.452 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:31.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T23:41:31.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T23:41:31.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T23:41:31.452 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:31.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.767 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-11-18T23:41:31.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.781 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2023-11-18T23:41:31.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.836 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:31.836 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:31.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:31.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-18T23:41:31.836 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:31.921 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-18T23:41:31.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-18T23:41:31.922 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:32.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:32.022 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:32.023 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:32.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2023-11-18T23:41:32.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T23:41:32.023 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:32.064 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-18T23:41:32.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:32.065 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:32.123 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T23:41:32.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:32.123 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:32.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-11-18T23:41:32.245 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:32.300 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2023-11-18T23:41:32.301 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/selinux 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:32.302 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-4 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-5 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-6 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-7 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:32.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:32.304 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-11-18T23:41:32.356 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-18T23:41:32.356 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-18T23:41:32.398 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-11-18T23:41:32.425 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2023-11-18T23:41:32.480 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/selinux 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:32.481 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-4 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-5 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-6 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-7 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:32.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:32.483 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-11-18T23:41:32.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi116.stderr:2023-11-18T23:41:32.500+0000 7fe0c5a3f480 -1 init, newargv = 0x561d1bd32860 newargc=15 2023-11-18T23:41:32.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi116.stderr:ceph-fuse[93759]: starting ceph client 2023-11-18T23:41:32.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi116.stderr:ceph-fuse[93759]: starting fuse 2023-11-18T23:41:32.517 INFO:teuthology.orchestra.run.smithi116.stdout:41 2023-11-18T23:41:32.517 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-18T23:41:32.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo stdin-killer -- python3 -c ' 2023-11-18T23:41:32.517 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2023-11-18T23:41:32.517 DEBUG:teuthology.orchestra.run.smithi116:> import re 2023-11-18T23:41:32.517 DEBUG:teuthology.orchestra.run.smithi116:> import os 2023-11-18T23:41:32.517 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:32.518 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> return f 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.1")) 2023-11-18T23:41:32.519 DEBUG:teuthology.orchestra.run.smithi116:> ' 2023-11-18T23:41:32.637 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.1.93759.asok 2023-11-18T23:41:32.640 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T23:41:32.647 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.93759.asok 2023-11-18T23:41:32.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:32.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.93759.asok status 2023-11-18T23:41:32.782 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-11-18T23:41:32.782 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2023-11-18T23:41:32.782 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T23:41:32.782 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T23:41:32.782 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "1", 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "93759", 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4517, 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2023-11-18T23:41:32.783 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 4517 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 690853692 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-11-18T23:41:32.784 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.1:0", 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 690853692 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.4517 192.168.0.1:0/690853692", 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "192.168.0.1:0/690853692", 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 8, 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 20, 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2023-11-18T23:41:32.785 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-11-18T23:41:32.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T23:41:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.907+0000 7f023634e640 1 Processor -- start 2023-11-18T23:41:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.907+0000 7f023634e640 1 -- start start 2023-11-18T23:41:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.908+0000 7f023634e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f023006dc30 0x7f0230071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.908+0000 7f023634e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300b3130 con 0x7f0230142d20 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.908+0000 7f023634e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0230143100 con 0x7f02300b1df0 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.908+0000 7f023634e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300b2520 con 0x7f023006dc30 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.908+0000 7f022f7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f023006dc30 0x7f0230071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.908+0000 7f022ffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0230142d20 0x7f023006d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51500/0 (socket says 172.21.15.8:51500) 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.908+0000 7f022ffff640 1 -- 172.21.15.8:0/655412848 learned_addr learned my addr 172.21.15.8:0/655412848 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.909+0000 7f022f7fe640 1 -- 172.21.15.8:0/655412848 >> v1:172.21.15.116:6789/0 conn(0x7f02300b1df0 legacy=0x7f02300cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.909+0000 7f022f7fe640 1 -- 172.21.15.8:0/655412848 >> v1:172.21.15.8:6789/0 conn(0x7f0230142d20 legacy=0x7f023006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.909+0000 7f022f7fe640 1 -- 172.21.15.8:0/655412848 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300b2800 con 0x7f023006dc30 2023-11-18T23:41:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.909+0000 7f022f7fe640 1 --2- 172.21.15.8:0/655412848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f023006dc30 0x7f0230071f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f02240097a0 tx=0x7f022402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bdb80cf2073b5b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.909+0000 7f022effd640 1 -- 172.21.15.8:0/655412848 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224030610 con 0x7f023006dc30 2023-11-18T23:41:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f022effd640 1 -- 172.21.15.8:0/655412848 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224030770 con 0x7f023006dc30 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f022effd640 1 -- 172.21.15.8:0/655412848 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224030b00 con 0x7f023006dc30 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f023634e640 1 -- 172.21.15.8:0/655412848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f023006dc30 msgr2=0x7f0230071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f023634e640 1 --2- 172.21.15.8:0/655412848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f023006dc30 0x7f0230071f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f02240097a0 tx=0x7f022402b960 comp rx=0 tx=0).stop 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f023634e640 1 -- 172.21.15.8:0/655412848 shutdown_connections 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f023634e640 1 --2- 172.21.15.8:0/655412848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f023006dc30 0x7f0230071f00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f023634e640 1 -- 172.21.15.8:0/655412848 >> 172.21.15.8:0/655412848 conn(0x7f02300b0af0 msgr2=0x7f02300b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f023634e640 1 -- 172.21.15.8:0/655412848 shutdown_connections 2023-11-18T23:41:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.910+0000 7f023634e640 1 -- 172.21.15.8:0/655412848 wait complete. 2023-11-18T23:41:32.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.911+0000 7f023634e640 1 Processor -- start 2023-11-18T23:41:32.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f023634e640 1 -- start start 2023-11-18T23:41:32.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f023634e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f023006dc30 0x7f02301f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f023634e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02300b1df0 0x7f02301e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f023634e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0230142d20 0x7f02301f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f023634e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023015b300 con 0x7f02300b1df0 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f023634e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023015a730 con 0x7f0230142d20 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f023634e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023015a9d0 con 0x7f023006dc30 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.912+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02300b1df0 0x7f02301e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02300b1df0 0x7f02301e6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34858/0 (socket says 172.21.15.8:34858) 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 -- 172.21.15.8:0/4020402494 learned_addr learned my addr 172.21.15.8:0/4020402494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f02348eb640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0230142d20 0x7f02301f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022ffff640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f023006dc30 0x7f02301f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 -- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f023006dc30 msgr2=0x7f02301f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f023006dc30 0x7f02301f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 -- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0230142d20 msgr2=0x7f02301f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0230142d20 0x7f02301f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 -- 172.21.15.8:0/4020402494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224009400 con 0x7f02300b1df0 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f02348eb640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0230142d20 0x7f02301f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022f7fe640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02300b1df0 0x7f02301e6e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f02240098c0 tx=0x7f0224004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022cff9640 1 -- 172.21.15.8:0/4020402494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022403e040 con 0x7f02300b1df0 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022cff9640 1 -- 172.21.15.8:0/4020402494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224039cb0 con 0x7f02300b1df0 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023015acb0 con 0x7f02300b1df0 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f022cff9640 1 -- 172.21.15.8:0/4020402494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224044630 con 0x7f02300b1df0 2023-11-18T23:41:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.913+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02301e7360 con 0x7f02300b1df0 2023-11-18T23:41:32.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.914+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023015d350 con 0x7f02300b1df0 2023-11-18T23:41:32.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.915+0000 7f022cff9640 1 -- 172.21.15.8:0/4020402494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f022404d3b0 con 0x7f02300b1df0 2023-11-18T23:41:32.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.915+0000 7f022cff9640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f021c06ae70 0x7f021c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:32.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.915+0000 7f022cff9640 1 -- 172.21.15.8:0/4020402494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02240abb80 con 0x7f02300b1df0 2023-11-18T23:41:32.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.915+0000 7f022ffff640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f021c06ae70 0x7f021c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:32.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.916+0000 7f022ffff640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f021c06ae70 0x7f021c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0220005880 tx=0x7f0220009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:32.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:32.920+0000 7f022cff9640 1 -- 172.21.15.8:0/4020402494 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0224076c30 con 0x7f02300b1df0 2023-11-18T23:41:33.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.133+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0230067420 con 0x7f02300b1df0 2023-11-18T23:41:33.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.133+0000 7f022cff9640 1 -- 172.21.15.8:0/4020402494 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f022407a250 con 0x7f02300b1df0 2023-11-18T23:41:33.135 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T23:41:33.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f021c06ae70 msgr2=0x7f021c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:33.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f021c06ae70 0x7f021c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0220005880 tx=0x7f0220009040 comp rx=0 tx=0).stop 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02300b1df0 msgr2=0x7f02301e6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02300b1df0 0x7f02301e6e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f02240098c0 tx=0x7f0224004730 comp rx=0 tx=0).stop 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 shutdown_connections 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f021c06ae70 0x7f021c06d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0230142d20 0x7f02301f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02300b1df0 0x7f02301e6e20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 --2- 172.21.15.8:0/4020402494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f023006dc30 0x7f02301f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 >> 172.21.15.8:0/4020402494 conn(0x7f02300b0af0 msgr2=0x7f02300b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 shutdown_connections 2023-11-18T23:41:33.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:33.135+0000 7f023634e640 1 -- 172.21.15.8:0/4020402494 wait complete. 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T23:41:33.148 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-18T23:41:33.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.149 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2023-11-18T23:41:33.165 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:33.165 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:33.165 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:33.165 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.165 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:33.165 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:41:33.166 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42683sec preferred_lft 42683sec 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether ae:65:fa:61:ab:d6 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.167 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::4ccd:12ff:fe89:8a0e/64 scope link 2023-11-18T23:41:33.168 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.168 INFO:teuthology.orchestra.run.smithi116.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T23:41:33.168 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether ae:65:fa:61:ab:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:33.168 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ac65:faff:fe61:abd6/64 scope link tentative 2023-11-18T23:41:33.168 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.169 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T23:41:33.232 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-11-18T23:41:33.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.233 DEBUG:teuthology.orchestra.run.smithi116:> route 2023-11-18T23:41:33.289 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2023-11-18T23:41:33.289 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T23:41:33.289 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T23:41:33.290 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T23:41:33.290 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T23:41:33.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.290 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:33.290 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:33.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T23:41:33.291 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T23:41:33.291 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T23:41:33.291 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:33.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.385 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2023-11-18T23:41:33.400 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T23:41:33.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.400 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2023-11-18T23:41:33.455 INFO:teuthology.orchestra.run.smithi116.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-18T23:41:33.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.455 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:33.455 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:33.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-18T23:41:33.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-18T23:41:33.455 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:33.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-18T23:41:33.604 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:33.604 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:33.604 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:33.604 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.604 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:33.605 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.605 INFO:teuthology.orchestra.run.smithi116.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T23:41:33.605 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 4a:35:87:37:af:e0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-18T23:41:33.605 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-18T23:41:33.605 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.605 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::4835:87ff:fe37:afe0/64 scope link tentative 2023-11-18T23:41:33.605 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T23:41:33.673 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 4a:35:87:37:af:e0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-18T23:41:33.674 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-18T23:41:33.674 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.674 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::4835:87ff:fe37:afe0/64 scope link tentative 2023-11-18T23:41:33.674 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:41:33.675 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-18T23:41:33.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-18T23:41:33.675 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:33.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:33.800 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2023-11-18T23:41:33.800 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2023-11-18T23:41:33.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.1 up 2023-11-18T23:41:33.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.1 master ceph-brx 2023-11-18T23:41:33.800 DEBUG:teuthology.orchestra.run.smithi116:> ') 2023-11-18T23:41:33.841 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-18T23:41:33.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:33.841 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:33.900 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-18T23:41:33.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:41:33.900 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:33.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-11-18T23:41:34.022 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:34.077 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2023-11-18T23:41:34.077 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2023-11-18T23:41:34.077 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/selinux 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2023-11-18T23:41:34.078 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-4 2023-11-18T23:41:34.079 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-5 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-6 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-7 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-18T23:41:34.080 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-18T23:41:34.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.081 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-11-18T23:41:34.136 INFO:teuthology.orchestra.run.smithi116.stdout:41 2023-11-18T23:41:34.136 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-18T23:41:34.136 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-18T23:41:34.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2023-11-18T23:41:34.205 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:41:34.260 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2023-11-18T23:41:34.260 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/selinux 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2023-11-18T23:41:34.261 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-4 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-5 2023-11-18T23:41:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-6 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph/osd/ceph-7 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run.smithi116.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-18T23:41:34.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.263 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2023-11-18T23:41:34.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi116.stderr:2023-11-18T23:41:34.262+0000 7f0655846480 -1 init, newargv = 0x55b7ca4ceb90 newargc=15 2023-11-18T23:41:34.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi116.stderr:ceph-fuse[94194]: starting ceph client 2023-11-18T23:41:34.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi116.stderr:ceph-fuse[94194]: starting fuse 2023-11-18T23:41:34.278 INFO:teuthology.orchestra.run.smithi116.stdout:41 2023-11-18T23:41:34.278 INFO:teuthology.orchestra.run.smithi116.stdout:44 2023-11-18T23:41:34.278 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-18T23:41:34.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo stdin-killer -- python3 -c ' 2023-11-18T23:41:34.278 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2023-11-18T23:41:34.278 DEBUG:teuthology.orchestra.run.smithi116:> import re 2023-11-18T23:41:34.278 DEBUG:teuthology.orchestra.run.smithi116:> import os 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:34.279 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> return f 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.3")) 2023-11-18T23:41:34.280 DEBUG:teuthology.orchestra.run.smithi116:> ' 2023-11-18T23:41:34.397 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.3.94194.asok 2023-11-18T23:41:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2023-11-18T23:41:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T23:41:34.407 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94194.asok 2023-11-18T23:41:34.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.94194.asok status 2023-11-18T23:41:34.543 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-11-18T23:41:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2023-11-18T23:41:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T23:41:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T23:41:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "3", 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "94194", 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4526, 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 4526 2023-11-18T23:41:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.2:0", 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 4016898460 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "192.168.0.2:0", 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 4016898460 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-11-18T23:41:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.4526 192.168.0.2:0/4016898460", 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "192.168.0.2:0/4016898460", 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 8, 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 20, 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2023-11-18T23:41:34.546 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-11-18T23:41:34.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.552 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2023-11-18T23:41:34.552 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:34.571 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2023-11-18T23:41:34.571 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:34.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.572 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:34.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.650 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2023-11-18T23:41:34.650 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:34.708 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2023-11-18T23:41:34.708 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:34.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.709 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:34.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.787 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2023-11-18T23:41:34.787 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:34.802 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2023-11-18T23:41:34.802 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:34.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:34.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.871 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2023-11-18T23:41:34.871 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:34.926 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2023-11-18T23:41:34.927 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:34.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:34.927 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:34.994 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-18T23:41:35.010 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:35.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.129+0000 7f63720af640 1 Processor -- start 2023-11-18T23:41:35.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.129+0000 7f63720af640 1 -- start start 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f63720af640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f636c099970 0x7f636c099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f63720af640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f636c0cf890 0x7f636c0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f63720af640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c0d0070 con 0x7f636c09a530 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f63720af640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c0cbb50 con 0x7f636c099970 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f63720af640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c09a290 con 0x7f636c0cf890 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f636b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f636c099970 0x7f636c099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f636b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f636c099970 0x7f636c099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34864/0 (socket says 172.21.15.8:34864) 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f636b7fe640 1 -- 172.21.15.8:0/2530045249 learned_addr learned my addr 172.21.15.8:0/2530045249 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f636b7fe640 1 -- 172.21.15.8:0/2530045249 >> v2:172.21.15.116:3300/0 conn(0x7f636c0cf890 msgr2=0x7f636c0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.130+0000 7f636bfff640 1 --2- 172.21.15.8:0/2530045249 >> v2:172.21.15.116:3300/0 conn(0x7f636c0cf890 0x7f636c0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.131+0000 7f636b7fe640 1 --2- 172.21.15.8:0/2530045249 >> v2:172.21.15.116:3300/0 conn(0x7f636c0cf890 0x7f636c0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.131+0000 7f636b7fe640 1 -- 172.21.15.8:0/2530045249 >> v1:172.21.15.116:6789/0 conn(0x7f636c09a530 legacy=0x7f636c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.131+0000 7f636b7fe640 1 -- 172.21.15.8:0/2530045249 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c0cfd90 con 0x7f636c099970 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.131+0000 7f636bfff640 1 --2- 172.21.15.8:0/2530045249 >> v2:172.21.15.116:3300/0 conn(0x7f636c0cf890 0x7f636c0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.131+0000 7f636b7fe640 1 --2- 172.21.15.8:0/2530045249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c099d50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f636c071dc0 tx=0x7f635c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116905a74640ac6e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f636a7fc640 1 -- 172.21.15.8:0/2530045249 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c031870 con 0x7f636c099970 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f636a7fc640 1 -- 172.21.15.8:0/2530045249 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c0319d0 con 0x7f636c099970 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f636a7fc640 1 -- 172.21.15.8:0/2530045249 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c031d60 con 0x7f636c099970 2023-11-18T23:41:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 -- 172.21.15.8:0/2530045249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 msgr2=0x7f636c099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 --2- 172.21.15.8:0/2530045249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c099d50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f636c071dc0 tx=0x7f635c02b910 comp rx=0 tx=0).stop 2023-11-18T23:41:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 -- 172.21.15.8:0/2530045249 shutdown_connections 2023-11-18T23:41:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 --2- 172.21.15.8:0/2530045249 >> v2:172.21.15.116:3300/0 conn(0x7f636c0cf890 0x7f636c0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 --2- 172.21.15.8:0/2530045249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c099d50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 -- 172.21.15.8:0/2530045249 >> 172.21.15.8:0/2530045249 conn(0x7f636c0b2a70 msgr2=0x7f636c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 -- 172.21.15.8:0/2530045249 shutdown_connections 2023-11-18T23:41:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.132+0000 7f63720af640 1 -- 172.21.15.8:0/2530045249 wait complete. 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.133+0000 7f63720af640 1 Processor -- start 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f63720af640 1 -- start start 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f63720af640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f63720af640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f636c09a530 0x7f636c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f63720af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f636c0cf890 0x7f636c158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f63720af640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0c8f70 con 0x7f636c099970 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f63720af640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c1538f0 con 0x7f636c0cf890 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f63720af640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0c8360 con 0x7f636c09a530 2023-11-18T23:41:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f636b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f636b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c1533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34870/0 (socket says 172.21.15.8:34870) 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.134+0000 7f636b7fe640 1 -- 172.21.15.8:0/2061978494 learned_addr learned my addr 172.21.15.8:0/2061978494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636bfff640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f636c0cf890 0x7f636c158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636affd640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f636c09a530 0x7f636c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636b7fe640 1 -- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f636c09a530 msgr2=0x7f636c0c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636b7fe640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f636c09a530 0x7f636c0c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636b7fe640 1 -- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f636c0cf890 msgr2=0x7f636c158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636b7fe640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f636c0cf890 0x7f636c158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636b7fe640 1 -- 172.21.15.8:0/2061978494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c0094d0 con 0x7f636c099970 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636bfff640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f636c0cf890 0x7f636c158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f636b7fe640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c1533b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f6353fff640 1 -- 172.21.15.8:0/2061978494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c031840 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f6353fff640 1 -- 172.21.15.8:0/2061978494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c0443f0 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c0c8640 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f6353fff640 1 -- 172.21.15.8:0/2061978494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0447a0 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.135+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c0c8c00 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.136+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c067420 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.137+0000 7f6353fff640 1 -- 172.21.15.8:0/2061978494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f635c04d450 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.137+0000 7f6353fff640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f635806ae40 0x7f635806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.137+0000 7f6353fff640 1 -- 172.21.15.8:0/2061978494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f635c02d040 con 0x7f636c099970 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.137+0000 7f636affd640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f635806ae40 0x7f635806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.138+0000 7f636affd640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f635806ae40 0x7f635806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f636c1f4860 tx=0x7f6360009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.142+0000 7f6353fff640 1 -- 172.21.15.8:0/2061978494 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f635c076d20 con 0x7f636c099970 2023-11-18T23:41:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.318+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f636c0d0070 con 0x7f636c099970 2023-11-18T23:41:35.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.319+0000 7f6353fff640 1 -- 172.21.15.8:0/2061978494 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f636c0d0070 con 0x7f636c099970 2023-11-18T23:41:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:35.321 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f635806ae40 msgr2=0x7f635806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f635806ae40 0x7f635806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f636c1f4860 tx=0x7f6360009040 comp rx=0 tx=0).stop 2023-11-18T23:41:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 msgr2=0x7f636c1533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c1533b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c0046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 shutdown_connections 2023-11-18T23:41:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f635806ae40 0x7f635806d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f636c0cf890 0x7f636c158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f636c09a530 0x7f636c0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 --2- 172.21.15.8:0/2061978494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f636c099970 0x7f636c1533b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 >> 172.21.15.8:0/2061978494 conn(0x7f636c0b2a70 msgr2=0x7f636c0ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:35.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 shutdown_connections 2023-11-18T23:41:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.321+0000 7f63720af640 1 -- 172.21.15.8:0/2061978494 wait complete. 2023-11-18T23:41:35.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:35.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.442+0000 7ff505583640 1 Processor -- start 2023-11-18T23:41:35.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.442+0000 7ff505583640 1 -- start start 2023-11-18T23:41:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff505583640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5000cfdb0 0x7ff5000c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff505583640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff5000c67c0 0x7ff5000cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff505583640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000b4b20 con 0x7ff5000d2110 2023-11-18T23:41:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff505583640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000d0c30 con 0x7ff5000cfdb0 2023-11-18T23:41:35.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff505583640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000d3da0 con 0x7ff5000c67c0 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff4feffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5000cfdb0 0x7ff5000c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff4fe7fc640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff5000d2110 0x7ff5000d0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51506/0 (socket says 172.21.15.8:51506) 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.443+0000 7ff4fe7fc640 1 -- 172.21.15.8:0/545685283 learned_addr learned my addr 172.21.15.8:0/545685283 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.444+0000 7ff4ff7fe640 1 --2- 172.21.15.8:0/545685283 >> v2:172.21.15.116:3300/0 conn(0x7ff5000c67c0 0x7ff5000cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.444+0000 7ff4feffd640 1 -- 172.21.15.8:0/545685283 >> v2:172.21.15.116:3300/0 conn(0x7ff5000c67c0 msgr2=0x7ff5000cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.444+0000 7ff4feffd640 1 --2- 172.21.15.8:0/545685283 >> v2:172.21.15.116:3300/0 conn(0x7ff5000c67c0 0x7ff5000cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.444+0000 7ff4feffd640 1 -- 172.21.15.8:0/545685283 >> v1:172.21.15.8:6789/0 conn(0x7ff5000d2110 legacy=0x7ff5000d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.444+0000 7ff4feffd640 1 -- 172.21.15.8:0/545685283 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000b7030 con 0x7ff5000cfdb0 2023-11-18T23:41:35.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.444+0000 7ff4fdffb640 1 -- 172.21.15.8:0/545685283 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301542478 0 0) 0x7ff4e8001110 con 0x7ff5000d2110 2023-11-18T23:41:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff4feffd640 1 --2- 172.21.15.8:0/545685283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c5e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5000c63f0 tx=0x7ff4f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf8dd844f4cef46 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff4fdffb640 1 -- 172.21.15.8:0/545685283 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8031830 con 0x7ff5000cfdb0 2023-11-18T23:41:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff4fdffb640 1 -- 172.21.15.8:0/545685283 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8031990 con 0x7ff5000cfdb0 2023-11-18T23:41:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff4fdffb640 1 -- 172.21.15.8:0/545685283 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8031d20 con 0x7ff5000cfdb0 2023-11-18T23:41:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 -- 172.21.15.8:0/545685283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 msgr2=0x7ff5000c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 --2- 172.21.15.8:0/545685283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c5e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5000c63f0 tx=0x7ff4f802b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 -- 172.21.15.8:0/545685283 shutdown_connections 2023-11-18T23:41:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 --2- 172.21.15.8:0/545685283 >> v2:172.21.15.116:3300/0 conn(0x7ff5000c67c0 0x7ff5000cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 --2- 172.21.15.8:0/545685283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c5e80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 -- 172.21.15.8:0/545685283 >> 172.21.15.8:0/545685283 conn(0x7ff50009c500 msgr2=0x7ff5000d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 -- 172.21.15.8:0/545685283 shutdown_connections 2023-11-18T23:41:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.445+0000 7ff505583640 1 -- 172.21.15.8:0/545685283 wait complete. 2023-11-18T23:41:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 Processor -- start 2023-11-18T23:41:35.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 -- start start 2023-11-18T23:41:35.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c67c0 0x7ff50015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000d2110 0x7ff5000cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000c8830 con 0x7ff5000cfdb0 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000c8b10 con 0x7ff5000c67c0 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff505583640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000c8df0 con 0x7ff5000d2110 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.447+0000 7ff4fe7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34878/0 (socket says 172.21.15.8:34878) 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 -- 172.21.15.8:0/1121522628 learned_addr learned my addr 172.21.15.8:0/1121522628 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4ff7fe640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000d2110 0x7ff5000cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4feffd640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c67c0 0x7ff50015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 -- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000d2110 msgr2=0x7ff5000cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000d2110 0x7ff5000cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 -- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c67c0 msgr2=0x7ff50015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c67c0 0x7ff50015e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 -- 172.21.15.8:0/1121522628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8009400 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4fe7fc640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c81c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c3e0 tx=0x7ff4e800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4f77fe640 1 -- 172.21.15.8:0/1121522628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80074e0 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4f77fe640 1 -- 172.21.15.8:0/1121522628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8007660 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5000c90d0 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff4f77fe640 1 -- 172.21.15.8:0/1121522628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8004a20 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.448+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5000cb9e0 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.449+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5000c95f0 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.450+0000 7ff4f77fe640 1 -- 172.21.15.8:0/1121522628 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4e8004b80 con 0x7ff5000cfdb0 2023-11-18T23:41:35.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.450+0000 7ff4f77fe640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4e006ae40 0x7ff4e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.450+0000 7ff4f77fe640 1 -- 172.21.15.8:0/1121522628 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4e8089060 con 0x7ff5000cfdb0 2023-11-18T23:41:35.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.450+0000 7ff4feffd640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4e006ae40 0x7ff4e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.451+0000 7ff4feffd640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4e006ae40 0x7ff4e006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8036000 tx=0x7ff4f803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.455+0000 7ff4f77fe640 1 -- 172.21.15.8:0/1121522628 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5000c95f0 con 0x7ff5000cfdb0 2023-11-18T23:41:35.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.628+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5000b4b20 con 0x7ff5000cfdb0 2023-11-18T23:41:35.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.629+0000 7ff4f77fe640 1 -- 172.21.15.8:0/1121522628 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5000b4b20 con 0x7ff5000cfdb0 2023-11-18T23:41:35.630 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:35.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4e006ae40 msgr2=0x7ff4e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4e006ae40 0x7ff4e006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8036000 tx=0x7ff4f803c040 comp rx=0 tx=0).stop 2023-11-18T23:41:35.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 msgr2=0x7ff5000c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c81c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c3e0 tx=0x7ff4e800c8a0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 shutdown_connections 2023-11-18T23:41:35.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4e006ae40 0x7ff4e006d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000d2110 0x7ff5000cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5000cfdb0 0x7ff5000c81c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 --2- 172.21.15.8:0/1121522628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c67c0 0x7ff50015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 >> 172.21.15.8:0/1121522628 conn(0x7ff50009c500 msgr2=0x7ff500164c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:35.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 shutdown_connections 2023-11-18T23:41:35.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.631+0000 7ff505583640 1 -- 172.21.15.8:0/1121522628 wait complete. 2023-11-18T23:41:35.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:35.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.751+0000 7f7f01a09640 1 Processor -- start 2023-11-18T23:41:35.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.751+0000 7f7f01a09640 1 -- start start 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7f01a09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc144310 0x7f7efc144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7f01a09640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7efc0ce7e0 0x7f7efc0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7f01a09640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc1446f0 con 0x7f7efc06c890 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7f01a09640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0b3980 con 0x7f7efc0ce7e0 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7f01a09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0cec60 con 0x7f7efc144310 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7efb7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7efc06c890 0x7f7efc15ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51516/0 (socket says 172.21.15.8:51516) 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7efb7fe640 1 -- 172.21.15.8:0/2998883074 learned_addr learned my addr 172.21.15.8:0/2998883074 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7efaffd640 1 --2- 172.21.15.8:0/2998883074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc144310 0x7f7efc144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7efa7fc640 1 --2- 172.21.15.8:0/2998883074 >> v2:172.21.15.116:3300/0 conn(0x7f7efc0ce7e0 0x7f7efc0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7ef9ffb640 1 -- 172.21.15.8:0/2998883074 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188622653 0 0) 0x7f7efc1446f0 con 0x7f7efc06c890 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.752+0000 7f7ef9ffb640 1 -- 172.21.15.8:0/2998883074 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee8003520 con 0x7f7efc06c890 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.753+0000 7f7efaffd640 1 -- 172.21.15.8:0/2998883074 >> v2:172.21.15.116:3300/0 conn(0x7f7efc0ce7e0 msgr2=0x7f7efc0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.753+0000 7f7efaffd640 1 --2- 172.21.15.8:0/2998883074 >> v2:172.21.15.116:3300/0 conn(0x7f7efc0ce7e0 0x7f7efc0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.753+0000 7f7efaffd640 1 -- 172.21.15.8:0/2998883074 >> v1:172.21.15.8:6789/0 conn(0x7f7efc06c890 legacy=0x7f7efc15ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.753+0000 7f7efaffd640 1 -- 172.21.15.8:0/2998883074 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc15ba80 con 0x7f7efc144310 2023-11-18T23:41:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.753+0000 7f7efa7fc640 1 --2- 172.21.15.8:0/2998883074 >> v2:172.21.15.116:3300/0 conn(0x7f7efc0ce7e0 0x7f7efc0b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.753+0000 7f7efaffd640 1 --2- 172.21.15.8:0/2998883074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc144310 0x7f7efc144950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40097a0 tx=0x7f7ef402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e543fcaa8ff60617 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7ef9ffb640 1 -- 172.21.15.8:0/2998883074 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031830 con 0x7f7efc144310 2023-11-18T23:41:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7ef9ffb640 1 -- 172.21.15.8:0/2998883074 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4031990 con 0x7f7efc144310 2023-11-18T23:41:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7ef9ffb640 1 -- 172.21.15.8:0/2998883074 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031d00 con 0x7f7efc144310 2023-11-18T23:41:35.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 -- 172.21.15.8:0/2998883074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc144310 msgr2=0x7f7efc144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 --2- 172.21.15.8:0/2998883074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc144310 0x7f7efc144950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40097a0 tx=0x7f7ef402b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 -- 172.21.15.8:0/2998883074 shutdown_connections 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 --2- 172.21.15.8:0/2998883074 >> v2:172.21.15.116:3300/0 conn(0x7f7efc0ce7e0 0x7f7efc0b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 --2- 172.21.15.8:0/2998883074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc144310 0x7f7efc144950 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 -- 172.21.15.8:0/2998883074 >> 172.21.15.8:0/2998883074 conn(0x7f7efc06a8f0 msgr2=0x7f7efc06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 -- 172.21.15.8:0/2998883074 shutdown_connections 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.754+0000 7f7f01a09640 1 -- 172.21.15.8:0/2998883074 wait complete. 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.755+0000 7f7f01a09640 1 Processor -- start 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.755+0000 7f7f01a09640 1 -- start start 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7f01a09640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7efc06c890 0x7f7efc1333b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7f01a09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc0ce7e0 0x7f7efc0a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7f01a09640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7efc144310 0x7f7efc0a8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7f01a09640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc141f30 con 0x7f7efc06c890 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7f01a09640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc142180 con 0x7f7efc144310 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7f01a09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc142460 con 0x7f7efc0ce7e0 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7efaffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7efc06c890 0x7f7efc1333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7efaffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7efc06c890 0x7f7efc1333b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34886/0 (socket says 172.21.15.8:34886) 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.756+0000 7f7efaffd640 1 -- 172.21.15.8:0/3959511088 learned_addr learned my addr 172.21.15.8:0/3959511088 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efb7fe640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7efc144310 0x7f7efc0a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efa7fc640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc0ce7e0 0x7f7efc0a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efaffd640 1 -- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc0ce7e0 msgr2=0x7f7efc0a83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efaffd640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc0ce7e0 0x7f7efc0a83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efaffd640 1 -- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7efc144310 msgr2=0x7f7efc0a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efaffd640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7efc144310 0x7f7efc0a8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efaffd640 1 -- 172.21.15.8:0/3959511088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4009400 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7efaffd640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7efc06c890 0x7f7efc1333b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000c00 tx=0x7f7ef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7ef3fff640 1 -- 172.21.15.8:0/3959511088 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef403a830 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7ef3fff640 1 -- 172.21.15.8:0/3959511088 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef403a990 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef4009400 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7ef3fff640 1 -- 172.21.15.8:0/3959511088 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef403ad20 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.757+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc142a20 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.758+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc072ae0 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.759+0000 7f7ef3fff640 1 -- 172.21.15.8:0/3959511088 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ef404d450 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.759+0000 7f7ef3fff640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7edc06ae40 0x7f7edc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.759+0000 7f7ef3fff640 1 -- 172.21.15.8:0/3959511088 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ef40ab730 con 0x7f7efc06c890 2023-11-18T23:41:35.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.759+0000 7f7efa7fc640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7edc06ae40 0x7f7edc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:35.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.760+0000 7f7efa7fc640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7edc06ae40 0x7f7edc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7efc143970 tx=0x7f7ee4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:35.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.763+0000 7f7ef3fff640 1 -- 172.21.15.8:0/3959511088 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ef4076750 con 0x7f7efc06c890 2023-11-18T23:41:35.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.940+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7efc04e920 con 0x7f7efc06c890 2023-11-18T23:41:35.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.941+0000 7f7ef3fff640 1 -- 172.21.15.8:0/3959511088 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ef4035020 con 0x7f7efc06c890 2023-11-18T23:41:35.942 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7edc06ae40 msgr2=0x7f7edc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7edc06ae40 0x7f7edc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7efc143970 tx=0x7f7ee4008040 comp rx=0 tx=0).stop 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7efc06c890 msgr2=0x7f7efc1333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7efc06c890 0x7f7efc1333b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000c00 tx=0x7f7ef40046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 shutdown_connections 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7edc06ae40 0x7f7edc06d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7efc144310 0x7f7efc0a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7efc0ce7e0 0x7f7efc0a83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 --2- 172.21.15.8:0/3959511088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7efc06c890 0x7f7efc1333b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 >> 172.21.15.8:0/3959511088 conn(0x7f7efc06a8f0 msgr2=0x7f7efc0afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 shutdown_connections 2023-11-18T23:41:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:35.943+0000 7f7f01a09640 1 -- 172.21.15.8:0/3959511088 wait complete. 2023-11-18T23:41:35.955 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:36.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.064+0000 7f322b105640 1 Processor -- start 2023-11-18T23:41:36.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.064+0000 7f322b105640 1 -- start start 2023-11-18T23:41:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.064+0000 7f322b105640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f32240d1570 0x7f32240b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.064+0000 7f322b105640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32240ce360 con 0x7f32240cef00 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.064+0000 7f322b105640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32240d19f0 con 0x7f3224160b70 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.064+0000 7f322b105640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240cdd50 con 0x7f32240d1570 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32296a2640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f32240cef00 0x7f3224161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51528/0 (socket says 172.21.15.8:51528) 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32296a2640 1 -- 172.21.15.8:0/3977244543 learned_addr learned my addr 172.21.15.8:0/3977244543 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f3223fff640 1 --2- 172.21.15.8:0/3977244543 >> v2:172.21.15.116:3300/0 conn(0x7f32240d1570 0x7f32240b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410385020 0 0) 0x7f32240ce360 con 0x7f32240cef00 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f320c003520 con 0x7f32240cef00 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707069610 0 0) 0x7f320c003520 con 0x7f32240cef00 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 >> v2:172.21.15.116:3300/0 conn(0x7f32240d1570 msgr2=0x7f32240b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:36.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 --2- 172.21.15.8:0/3977244543 >> v2:172.21.15.116:3300/0 conn(0x7f32240d1570 0x7f32240b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 >> v1:172.21.15.116:6789/0 conn(0x7f3224160b70 legacy=0x7f32240ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240d1c70 con 0x7f32240cef00 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f321c0019f0 con 0x7f32240cef00 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 >> v1:172.21.15.8:6789/0 conn(0x7f32240cef00 legacy=0x7f3224161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f320c003970 0x7f320c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c0047c0 0x7f320c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320c005180 0x7f320c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240cdd50 con 0x7f320c005180 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c00c020 con 0x7f320c0047c0 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320c00c1e0 con 0x7f320c003970 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f32296a2640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320c005180 0x7f320c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f3223fff640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c0047c0 0x7f320c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.065+0000 7f3228ea1640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f320c003970 0x7f320c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.066+0000 7f32296a2640 1 -- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f320c003970 msgr2=0x7f320c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.066+0000 7f32296a2640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f320c003970 0x7f320c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.066+0000 7f32296a2640 1 -- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c0047c0 msgr2=0x7f320c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.066+0000 7f32296a2640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c0047c0 0x7f320c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.066+0000 7f32296a2640 1 -- 172.21.15.8:0/3977244543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c003520 con 0x7f320c005180 2023-11-18T23:41:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.066+0000 7f32296a2640 1 -- 172.21.15.8:0/3977244543 reap_dead start 2023-11-18T23:41:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.066+0000 7f32296a2640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320c005180 0x7f320c00b980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f321c00a830 tx=0x7f320c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2f26cd707ebc44 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c0072d0 con 0x7f320c005180 2023-11-18T23:41:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c02f070 con 0x7f320c005180 2023-11-18T23:41:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f32237fe640 1 -- 172.21.15.8:0/3977244543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c0076b0 con 0x7f320c005180 2023-11-18T23:41:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f322b105640 1 -- 172.21.15.8:0/3977244543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320c005180 msgr2=0x7f320c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f322b105640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320c005180 0x7f320c00b980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f321c00a830 tx=0x7f320c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f322b105640 1 -- 172.21.15.8:0/3977244543 shutdown_connections 2023-11-18T23:41:36.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f322b105640 1 --2- 172.21.15.8:0/3977244543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320c005180 0x7f320c00b980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f322b105640 1 -- 172.21.15.8:0/3977244543 >> 172.21.15.8:0/3977244543 conn(0x7f322409c470 msgr2=0x7f32240d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:36.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f322b105640 1 -- 172.21.15.8:0/3977244543 shutdown_connections 2023-11-18T23:41:36.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.067+0000 7f322b105640 1 -- 172.21.15.8:0/3977244543 wait complete. 2023-11-18T23:41:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.068+0000 7f322b105640 1 Processor -- start 2023-11-18T23:41:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.068+0000 7f322b105640 1 -- start start 2023-11-18T23:41:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f322b105640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c005180 0x7f322414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f322b105640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32240b5cf0 0x7f32240b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f322b105640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32240c86d0 0x7f32240c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f322b105640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240c9670 con 0x7f32240b5cf0 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f322b105640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240b66b0 con 0x7f320c005180 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f322b105640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32240c9390 con 0x7f32240c86d0 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f3223fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32240b5cf0 0x7f32240b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f3223fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32240b5cf0 0x7f32240b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34904/0 (socket says 172.21.15.8:34904) 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.069+0000 7f3223fff640 1 -- 172.21.15.8:0/156155209 learned_addr learned my addr 172.21.15.8:0/156155209 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f32296a2640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32240c86d0 0x7f32240c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f3228ea1640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c005180 0x7f322414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f3223fff640 1 -- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32240c86d0 msgr2=0x7f32240c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f3223fff640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32240c86d0 0x7f32240c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f3223fff640 1 -- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c005180 msgr2=0x7f322414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f3223fff640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c005180 0x7f322414d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f3223fff640 1 -- 172.21.15.8:0/156155209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240cb000 con 0x7f32240b5cf0 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f3223fff640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32240b5cf0 0x7f32240b6170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32180118e0 tx=0x7f3218011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f32217fa640 1 -- 172.21.15.8:0/156155209 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800faf0 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f32217fa640 1 -- 172.21.15.8:0/156155209 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321800fc50 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32240cb2e0 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f32217fa640 1 -- 172.21.15.8:0/156155209 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218014440 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.070+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32240c9070 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.071+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32240cae60 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.072+0000 7f32217fa640 1 -- 172.21.15.8:0/156155209 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32180145a0 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.072+0000 7f32217fa640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f321006ae40 0x7f321006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.072+0000 7f32217fa640 1 -- 172.21.15.8:0/156155209 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3218089e40 con 0x7f32240b5cf0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.072+0000 7f3228ea1640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f321006ae40 0x7f321006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.073+0000 7f3228ea1640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f321006ae40 0x7f321006d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3214000c00 tx=0x7f3214009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.076+0000 7f32217fa640 1 -- 172.21.15.8:0/156155209 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32240cae60 con 0x7f32240b5cf0 2023-11-18T23:41:36.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.252+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32240cae60 con 0x7f32240b5cf0 2023-11-18T23:41:36.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.252+0000 7f32217fa640 1 -- 172.21.15.8:0/156155209 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32240cae60 con 0x7f32240b5cf0 2023-11-18T23:41:36.254 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:36.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f321006ae40 msgr2=0x7f321006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f321006ae40 0x7f321006d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3214000c00 tx=0x7f3214009040 comp rx=0 tx=0).stop 2023-11-18T23:41:36.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32240b5cf0 msgr2=0x7f32240b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32240b5cf0 0x7f32240b6170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32180118e0 tx=0x7f3218011da0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 shutdown_connections 2023-11-18T23:41:36.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f321006ae40 0x7f321006d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32240c86d0 0x7f32240c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32240b5cf0 0x7f32240b6170 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 --2- 172.21.15.8:0/156155209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f320c005180 0x7f322414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 >> 172.21.15.8:0/156155209 conn(0x7f322409c470 msgr2=0x7f32240d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:36.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 shutdown_connections 2023-11-18T23:41:36.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.254+0000 7f322b105640 1 -- 172.21.15.8:0/156155209 wait complete. 2023-11-18T23:41:36.266 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:36.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.371+0000 7fd78ce51640 1 Processor -- start 2023-11-18T23:41:36.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.371+0000 7fd78ce51640 1 -- start start 2023-11-18T23:41:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd78ce51640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd78815d3e0 0x7fd7880ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd78ce51640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd7880d1e30 0x7fd7880b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd78ce51640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7880b5f90 con 0x7fd7880ced30 2023-11-18T23:41:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd78ce51640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880cf170 con 0x7fd78815d3e0 2023-11-18T23:41:36.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd78ce51640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880b61e0 con 0x7fd7880d1e30 2023-11-18T23:41:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd78659c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd78815d3e0 0x7fd7880ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd785d9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd7880ced30 0x7fd7880d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51532/0 (socket says 172.21.15.8:51532) 2023-11-18T23:41:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.372+0000 7fd785d9b640 1 -- 172.21.15.8:0/3044213628 learned_addr learned my addr 172.21.15.8:0/3044213628 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.373+0000 7fd786d9d640 1 --2- 172.21.15.8:0/3044213628 >> v2:172.21.15.116:3300/0 conn(0x7fd7880d1e30 0x7fd7880b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.373+0000 7fd78659c640 1 -- 172.21.15.8:0/3044213628 >> v2:172.21.15.116:3300/0 conn(0x7fd7880d1e30 msgr2=0x7fd7880b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.373+0000 7fd78659c640 1 --2- 172.21.15.8:0/3044213628 >> v2:172.21.15.116:3300/0 conn(0x7fd7880d1e30 0x7fd7880b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.373+0000 7fd78659c640 1 -- 172.21.15.8:0/3044213628 >> v1:172.21.15.8:6789/0 conn(0x7fd7880ced30 legacy=0x7fd7880d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.373+0000 7fd78659c640 1 -- 172.21.15.8:0/3044213628 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880b64c0 con 0x7fd78815d3e0 2023-11-18T23:41:36.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.373+0000 7fd786d9d640 1 --2- 172.21.15.8:0/3044213628 >> v2:172.21.15.116:3300/0 conn(0x7fd7880d1e30 0x7fd7880b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:36.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78659c640 1 --2- 172.21.15.8:0/3044213628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7880ce7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7880cdc30 tx=0x7fd77802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a0dde0aa0aba99 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78559a640 1 -- 172.21.15.8:0/3044213628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77802cd00 con 0x7fd78815d3e0 2023-11-18T23:41:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78559a640 1 -- 172.21.15.8:0/3044213628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77802ce60 con 0x7fd78815d3e0 2023-11-18T23:41:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78559a640 1 -- 172.21.15.8:0/3044213628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778034660 con 0x7fd78815d3e0 2023-11-18T23:41:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 -- 172.21.15.8:0/3044213628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 msgr2=0x7fd7880ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 --2- 172.21.15.8:0/3044213628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7880ce7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7880cdc30 tx=0x7fd77802bf50 comp rx=0 tx=0).stop 2023-11-18T23:41:36.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 -- 172.21.15.8:0/3044213628 shutdown_connections 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 --2- 172.21.15.8:0/3044213628 >> v2:172.21.15.116:3300/0 conn(0x7fd7880d1e30 0x7fd7880b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 --2- 172.21.15.8:0/3044213628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7880ce7f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 -- 172.21.15.8:0/3044213628 >> 172.21.15.8:0/3044213628 conn(0x7fd78809c480 msgr2=0x7fd7880d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 -- 172.21.15.8:0/3044213628 shutdown_connections 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.374+0000 7fd78ce51640 1 -- 172.21.15.8:0/3044213628 wait complete. 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 Processor -- start 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 -- start start 2023-11-18T23:41:36.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7880ced30 0x7fd78815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7880d1e30 0x7fd78809d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7881515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78809dd40 con 0x7fd78815d3e0 2023-11-18T23:41:36.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788151ae0 con 0x7fd7880ced30 2023-11-18T23:41:36.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd78ce51640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78809df50 con 0x7fd7880d1e30 2023-11-18T23:41:36.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd786d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7881515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd786d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7881515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34928/0 (socket says 172.21.15.8:34928) 2023-11-18T23:41:36.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.376+0000 7fd786d9d640 1 -- 172.21.15.8:0/4040213875 learned_addr learned my addr 172.21.15.8:0/4040213875 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:36.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd78659c640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7880ced30 0x7fd78815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd785d9b640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7880d1e30 0x7fd78809d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd786d9d640 1 -- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7880d1e30 msgr2=0x7fd78809d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd786d9d640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7880d1e30 0x7fd78809d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd786d9d640 1 -- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7880ced30 msgr2=0x7fd78815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd786d9d640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7880ced30 0x7fd78815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd786d9d640 1 -- 172.21.15.8:0/4040213875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778009a70 con 0x7fd78815d3e0 2023-11-18T23:41:36.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd78659c640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7880ced30 0x7fd78815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:36.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd785d9b640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7880d1e30 0x7fd78809d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:36.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd786d9d640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7881515a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c7f0 tx=0x7fd78000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd77effd640 1 -- 172.21.15.8:0/4040213875 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780007820 con 0x7fd78815d3e0 2023-11-18T23:41:36.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd77effd640 1 -- 172.21.15.8:0/4040213875 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780007980 con 0x7fd78815d3e0 2023-11-18T23:41:36.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78809e230 con 0x7fd78815d3e0 2023-11-18T23:41:36.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd77effd640 1 -- 172.21.15.8:0/4040213875 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780007d70 con 0x7fd78815d3e0 2023-11-18T23:41:36.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.377+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78809e7f0 con 0x7fd78815d3e0 2023-11-18T23:41:36.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.378+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd788067420 con 0x7fd78815d3e0 2023-11-18T23:41:36.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.379+0000 7fd77effd640 1 -- 172.21.15.8:0/4040213875 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7800113f0 con 0x7fd78815d3e0 2023-11-18T23:41:36.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.379+0000 7fd77effd640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd76806ae40 0x7fd76806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.379+0000 7fd77effd640 1 -- 172.21.15.8:0/4040213875 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7800898b0 con 0x7fd78815d3e0 2023-11-18T23:41:36.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.379+0000 7fd78659c640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd76806ae40 0x7fd76806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.380+0000 7fd78659c640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd76806ae40 0x7fd76806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd778036000 tx=0x7fd778030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.384+0000 7fd77effd640 1 -- 172.21.15.8:0/4040213875 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7800549f0 con 0x7fd78815d3e0 2023-11-18T23:41:36.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.560+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7880d1500 con 0x7fd78815d3e0 2023-11-18T23:41:36.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.561+0000 7fd77effd640 1 -- 172.21.15.8:0/4040213875 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fd78001f090 con 0x7fd78815d3e0 2023-11-18T23:41:36.563 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:36.563 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd76806ae40 msgr2=0x7fd76806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd76806ae40 0x7fd76806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd778036000 tx=0x7fd778030000 comp rx=0 tx=0).stop 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 msgr2=0x7fd7881515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7881515a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c7f0 tx=0x7fd78000ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 shutdown_connections 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd76806ae40 0x7fd76806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd78815d3e0 0x7fd7881515a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7880d1e30 0x7fd78809d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 --2- 172.21.15.8:0/4040213875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7880ced30 0x7fd78815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 >> 172.21.15.8:0/4040213875 conn(0x7fd78809c480 msgr2=0x7fd7880d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:36.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 shutdown_connections 2023-11-18T23:41:36.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.563+0000 7fd78ce51640 1 -- 172.21.15.8:0/4040213875 wait complete. 2023-11-18T23:41:36.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:36.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:36.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.684+0000 7fc64697c640 1 Processor -- start 2023-11-18T23:41:36.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.684+0000 7fc64697c640 1 -- start start 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc64697c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc640144950 0x7fc6400ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc64697c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6401446f0 con 0x7fc640144310 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc64697c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64015ba80 con 0x7fc64006cfa0 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc64697c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64015bd60 con 0x7fc640144950 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc644f19640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc640144950 0x7fc6400ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc63ffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc640144310 0x7fc64006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51540/0 (socket says 172.21.15.8:51540) 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc63ffff640 1 -- 172.21.15.8:0/4202216253 learned_addr learned my addr 172.21.15.8:0/4202216253 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc644f19640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc640144950 0x7fc6400ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34934/0 (socket says 172.21.15.8:34934) 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc644f19640 1 -- 172.21.15.8:0/4202216253 >> v1:172.21.15.116:6789/0 conn(0x7fc64006cfa0 legacy=0x7fc64015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc644f19640 1 -- 172.21.15.8:0/4202216253 >> v1:172.21.15.8:6789/0 conn(0x7fc640144310 legacy=0x7fc64006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.685+0000 7fc644f19640 1 -- 172.21.15.8:0/4202216253 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64015c040 con 0x7fc640144950 2023-11-18T23:41:36.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.686+0000 7fc644f19640 1 --2- 172.21.15.8:0/4202216253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc640144950 0x7fc6400ce7e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc638009d90 tx=0x7fc63802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645f3cd5bfaa856a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.686+0000 7fc63effd640 1 -- 172.21.15.8:0/4202216253 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63802cd00 con 0x7fc640144950 2023-11-18T23:41:36.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.686+0000 7fc63effd640 1 -- 172.21.15.8:0/4202216253 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63802ce60 con 0x7fc640144950 2023-11-18T23:41:36.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.686+0000 7fc63effd640 1 -- 172.21.15.8:0/4202216253 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638034660 con 0x7fc640144950 2023-11-18T23:41:36.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.687+0000 7fc64697c640 1 -- 172.21.15.8:0/4202216253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc640144950 msgr2=0x7fc6400ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.687+0000 7fc64697c640 1 --2- 172.21.15.8:0/4202216253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc640144950 0x7fc6400ce7e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc638009d90 tx=0x7fc63802bf50 comp rx=0 tx=0).stop 2023-11-18T23:41:36.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.687+0000 7fc64697c640 1 -- 172.21.15.8:0/4202216253 shutdown_connections 2023-11-18T23:41:36.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.687+0000 7fc64697c640 1 --2- 172.21.15.8:0/4202216253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc640144950 0x7fc6400ce7e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.687+0000 7fc64697c640 1 -- 172.21.15.8:0/4202216253 >> 172.21.15.8:0/4202216253 conn(0x7fc64006a8f0 msgr2=0x7fc64006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:36.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.687+0000 7fc64697c640 1 -- 172.21.15.8:0/4202216253 shutdown_connections 2023-11-18T23:41:36.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.687+0000 7fc64697c640 1 -- 172.21.15.8:0/4202216253 wait complete. 2023-11-18T23:41:36.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.688+0000 7fc64697c640 1 Processor -- start 2023-11-18T23:41:36.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.688+0000 7fc64697c640 1 -- start start 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc64697c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc64006cfa0 0x7fc64013a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc64697c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc640144310 0x7fc64013ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc64697c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640144950 0x7fc640150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc64697c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc640070620 con 0x7fc64006cfa0 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc64697c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc640071480 con 0x7fc640144950 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc64697c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc640070870 con 0x7fc640144310 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc64006cfa0 0x7fc64013a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc64006cfa0 0x7fc64013a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34938/0 (socket says 172.21.15.8:34938) 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 -- 172.21.15.8:0/1118893640 learned_addr learned my addr 172.21.15.8:0/1118893640 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:36.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc644f19640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640144950 0x7fc640150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63f7fe640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc640144310 0x7fc64013ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 -- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc640144310 msgr2=0x7fc64013ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc640144310 0x7fc64013ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 -- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640144950 msgr2=0x7fc640150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640144950 0x7fc640150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 -- 172.21.15.8:0/1118893640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc638009a70 con 0x7fc64006cfa0 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63f7fe640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc640144310 0x7fc64013ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63ffff640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc64006cfa0 0x7fc64013a650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c4a0 tx=0x7fc63400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.689+0000 7fc63cff9640 1 -- 172.21.15.8:0/1118893640 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634005ce0 con 0x7fc64006cfa0 2023-11-18T23:41:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.690+0000 7fc63cff9640 1 -- 172.21.15.8:0/1118893640 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634005e40 con 0x7fc64006cfa0 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.690+0000 7fc63cff9640 1 -- 172.21.15.8:0/1118893640 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634007270 con 0x7fc64006cfa0 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.690+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc640070b50 con 0x7fc64006cfa0 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.690+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc640071110 con 0x7fc64006cfa0 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.691+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400ce140 con 0x7fc64006cfa0 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.691+0000 7fc63cff9640 1 -- 172.21.15.8:0/1118893640 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc634007490 con 0x7fc64006cfa0 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.691+0000 7fc63cff9640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc62c06ae40 0x7fc62c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.692+0000 7fc63cff9640 1 -- 172.21.15.8:0/1118893640 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc634088990 con 0x7fc64006cfa0 2023-11-18T23:41:36.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.692+0000 7fc63f7fe640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc62c06ae40 0x7fc62c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.692+0000 7fc63f7fe640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc62c06ae40 0x7fc62c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6401f6b50 tx=0x7fc630009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:36.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.696+0000 7fc63cff9640 1 -- 172.21.15.8:0/1118893640 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc634053b80 con 0x7fc64006cfa0 2023-11-18T23:41:36.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.872+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc640072ae0 con 0x7fc64006cfa0 2023-11-18T23:41:36.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.873+0000 7fc63cff9640 1 -- 172.21.15.8:0/1118893640 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc634017020 con 0x7fc64006cfa0 2023-11-18T23:41:36.874 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc62c06ae40 msgr2=0x7fc62c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc62c06ae40 0x7fc62c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6401f6b50 tx=0x7fc630009040 comp rx=0 tx=0).stop 2023-11-18T23:41:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc64006cfa0 msgr2=0x7fc64013a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc64006cfa0 0x7fc64013a650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c4a0 tx=0x7fc63400c960 comp rx=0 tx=0).stop 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 shutdown_connections 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc62c06ae40 0x7fc62c06d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640144950 0x7fc640150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc640144310 0x7fc64013ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 --2- 172.21.15.8:0/1118893640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc64006cfa0 0x7fc64013a650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 >> 172.21.15.8:0/1118893640 conn(0x7fc64006a8f0 msgr2=0x7fc6400b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 shutdown_connections 2023-11-18T23:41:36.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.875+0000 7fc64697c640 1 -- 172.21.15.8:0/1118893640 wait complete. 2023-11-18T23:41:36.887 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.995+0000 7fd94247c640 1 Processor -- start 2023-11-18T23:41:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.995+0000 7fd94247c640 1 -- start start 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd94247c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd93c0b1970 0x7fd93c168360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd94247c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0b04d0 con 0x7fd93c0d0220 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd94247c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0d1e40 con 0x7fd93c15d7b0 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd94247c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93c0afe80 con 0x7fd93c0b1970 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd940a19640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd93c0b1970 0x7fd93c168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd93b7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd93c0d0220 0x7fd93c0cdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51554/0 (socket says 172.21.15.8:51554) 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd93b7fe640 1 -- 172.21.15.8:0/3547325511 learned_addr learned my addr 172.21.15.8:0/3547325511 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd940a19640 1 -- 172.21.15.8:0/3547325511 >> v1:172.21.15.116:6789/0 conn(0x7fd93c15d7b0 legacy=0x7fd93c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.996+0000 7fd940a19640 1 -- 172.21.15.8:0/3547325511 >> v1:172.21.15.8:6789/0 conn(0x7fd93c0d0220 legacy=0x7fd93c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.997+0000 7fd940a19640 1 -- 172.21.15.8:0/3547325511 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0b0160 con 0x7fd93c0b1970 2023-11-18T23:41:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.997+0000 7fd940a19640 1 --2- 172.21.15.8:0/3547325511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c0b1970 0x7fd93c168360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd934009d90 tx=0x7fd93402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448fe2f872be1242 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.997+0000 7fd93affd640 1 -- 172.21.15.8:0/3547325511 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93402cd00 con 0x7fd93c0b1970 2023-11-18T23:41:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.997+0000 7fd93affd640 1 -- 172.21.15.8:0/3547325511 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93402ce60 con 0x7fd93c0b1970 2023-11-18T23:41:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.997+0000 7fd93affd640 1 -- 172.21.15.8:0/3547325511 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934034660 con 0x7fd93c0b1970 2023-11-18T23:41:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.998+0000 7fd94247c640 1 -- 172.21.15.8:0/3547325511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c0b1970 msgr2=0x7fd93c168360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.998+0000 7fd94247c640 1 --2- 172.21.15.8:0/3547325511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c0b1970 0x7fd93c168360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd934009d90 tx=0x7fd93402bf50 comp rx=0 tx=0).stop 2023-11-18T23:41:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.998+0000 7fd94247c640 1 -- 172.21.15.8:0/3547325511 shutdown_connections 2023-11-18T23:41:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.998+0000 7fd94247c640 1 --2- 172.21.15.8:0/3547325511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c0b1970 0x7fd93c168360 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.998+0000 7fd94247c640 1 -- 172.21.15.8:0/3547325511 >> 172.21.15.8:0/3547325511 conn(0x7fd93c09c480 msgr2=0x7fd93c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.998+0000 7fd94247c640 1 -- 172.21.15.8:0/3547325511 shutdown_connections 2023-11-18T23:41:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.998+0000 7fd94247c640 1 -- 172.21.15.8:0/3547325511 wait complete. 2023-11-18T23:41:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.999+0000 7fd94247c640 1 Processor -- start 2023-11-18T23:41:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:36.999+0000 7fd94247c640 1 -- start start 2023-11-18T23:41:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd94247c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd93c0b1970 0x7fd93c149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd94247c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd93c0d0220 0x7fd93c0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd94247c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c15d7b0 0x7fd93c0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd94247c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c15f3b0 con 0x7fd93c15d7b0 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd94247c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c15f690 con 0x7fd93c0d0220 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd94247c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c15f970 con 0x7fd93c0b1970 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd940a19640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c15d7b0 0x7fd93c0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd940a19640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c15d7b0 0x7fd93c0c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34954/0 (socket says 172.21.15.8:34954) 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.000+0000 7fd940a19640 1 -- 172.21.15.8:0/2868471333 learned_addr learned my addr 172.21.15.8:0/2868471333 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd93b7fe640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd93c0d0220 0x7fd93c0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd93bfff640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd93c0b1970 0x7fd93c149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd940a19640 1 -- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd93c0b1970 msgr2=0x7fd93c149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd940a19640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd93c0b1970 0x7fd93c149c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd940a19640 1 -- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd93c0d0220 msgr2=0x7fd93c0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd940a19640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd93c0d0220 0x7fd93c0c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd940a19640 1 -- 172.21.15.8:0/2868471333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934009a70 con 0x7fd93c15d7b0 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd940a19640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c15d7b0 0x7fd93c0c6c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd934009d90 tx=0x7fd934004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd938ff9640 1 -- 172.21.15.8:0/2868471333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93403e670 con 0x7fd93c15d7b0 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd938ff9640 1 -- 172.21.15.8:0/2868471333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93403e7f0 con 0x7fd93c15d7b0 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c15fc50 con 0x7fd93c15d7b0 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd938ff9640 1 -- 172.21.15.8:0/2868471333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93403eba0 con 0x7fd93c15d7b0 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.001+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c14a1b0 con 0x7fd93c15d7b0 2023-11-18T23:41:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.002+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c160170 con 0x7fd93c15d7b0 2023-11-18T23:41:37.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.002+0000 7fd938ff9640 1 -- 172.21.15.8:0/2868471333 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd93403b040 con 0x7fd93c15d7b0 2023-11-18T23:41:37.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.003+0000 7fd938ff9640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd92806ae40 0x7fd92806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.003+0000 7fd938ff9640 1 -- 172.21.15.8:0/2868471333 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9340ac270 con 0x7fd93c15d7b0 2023-11-18T23:41:37.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.003+0000 7fd93bfff640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd92806ae40 0x7fd92806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.003+0000 7fd93bfff640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd92806ae40 0x7fd92806d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd930000f60 tx=0x7fd930009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.007+0000 7fd938ff9640 1 -- 172.21.15.8:0/2868471333 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd93c160170 con 0x7fd93c15d7b0 2023-11-18T23:41:37.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.184+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd93c160170 con 0x7fd93c15d7b0 2023-11-18T23:41:37.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.184+0000 7fd938ff9640 1 -- 172.21.15.8:0/2868471333 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd93c160170 con 0x7fd93c15d7b0 2023-11-18T23:41:37.186 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.186+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd92806ae40 msgr2=0x7fd92806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.186+0000 7fd94247c640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd92806ae40 0x7fd92806d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd930000f60 tx=0x7fd930009040 comp rx=0 tx=0).stop 2023-11-18T23:41:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.186+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c15d7b0 msgr2=0x7fd93c0c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.186+0000 7fd94247c640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c15d7b0 0x7fd93c0c6c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd934009d90 tx=0x7fd934004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 shutdown_connections 2023-11-18T23:41:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd92806ae40 0x7fd92806d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd93c15d7b0 0x7fd93c0c6c80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd93c0d0220 0x7fd93c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 --2- 172.21.15.8:0/2868471333 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd93c0b1970 0x7fd93c149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 >> 172.21.15.8:0/2868471333 conn(0x7fd93c09c480 msgr2=0x7fd93c06c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:37.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 shutdown_connections 2023-11-18T23:41:37.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.187+0000 7fd94247c640 1 -- 172.21.15.8:0/2868471333 wait complete. 2023-11-18T23:41:37.199 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.306+0000 7faaed77c640 1 Processor -- start 2023-11-18T23:41:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.307+0000 7faaed77c640 1 -- start start 2023-11-18T23:41:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.307+0000 7faaed77c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faae8071c60 0x7faae80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.307+0000 7faaed77c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faae813d650 0x7faae813daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.307+0000 7faaed77c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae80cd730 con 0x7faae813cf00 2023-11-18T23:41:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.307+0000 7faaed77c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae8072630 con 0x7faae8071c60 2023-11-18T23:41:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.307+0000 7faaed77c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae80cebc0 con 0x7faae813d650 2023-11-18T23:41:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.307+0000 7faae67fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faae8071c60 0x7faae80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.308+0000 7faae67fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faae8071c60 0x7faae80720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34958/0 (socket says 172.21.15.8:34958) 2023-11-18T23:41:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.308+0000 7faae67fc640 1 -- 172.21.15.8:0/2496974514 learned_addr learned my addr 172.21.15.8:0/2496974514 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.308+0000 7faae77fe640 1 --2- 172.21.15.8:0/2496974514 >> v2:172.21.15.116:3300/0 conn(0x7faae813d650 0x7faae813daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.308+0000 7faae67fc640 1 -- 172.21.15.8:0/2496974514 >> v2:172.21.15.116:3300/0 conn(0x7faae813d650 msgr2=0x7faae813daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.308+0000 7faae67fc640 1 --2- 172.21.15.8:0/2496974514 >> v2:172.21.15.116:3300/0 conn(0x7faae813d650 0x7faae813daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.308+0000 7faae67fc640 1 -- 172.21.15.8:0/2496974514 >> v1:172.21.15.116:6789/0 conn(0x7faae813cf00 legacy=0x7faae80ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.308+0000 7faae67fc640 1 -- 172.21.15.8:0/2496974514 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae815b2a0 con 0x7faae8071c60 2023-11-18T23:41:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faae67fc640 1 --2- 172.21.15.8:0/2496974514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae8071c60 0x7faae80720f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faad0009870 tx=0x7faad002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a232aafed070f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faae5ffb640 1 -- 172.21.15.8:0/2496974514 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0031870 con 0x7faae8071c60 2023-11-18T23:41:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faae5ffb640 1 -- 172.21.15.8:0/2496974514 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad00319d0 con 0x7faae8071c60 2023-11-18T23:41:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faae5ffb640 1 -- 172.21.15.8:0/2496974514 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0031d60 con 0x7faae8071c60 2023-11-18T23:41:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 -- 172.21.15.8:0/2496974514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae8071c60 msgr2=0x7faae80720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 --2- 172.21.15.8:0/2496974514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae8071c60 0x7faae80720f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faad0009870 tx=0x7faad002b910 comp rx=0 tx=0).stop 2023-11-18T23:41:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 -- 172.21.15.8:0/2496974514 shutdown_connections 2023-11-18T23:41:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 --2- 172.21.15.8:0/2496974514 >> v2:172.21.15.116:3300/0 conn(0x7faae813d650 0x7faae813daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 --2- 172.21.15.8:0/2496974514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae8071c60 0x7faae80720f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 -- 172.21.15.8:0/2496974514 >> 172.21.15.8:0/2496974514 conn(0x7faae806c510 msgr2=0x7faae806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 -- 172.21.15.8:0/2496974514 shutdown_connections 2023-11-18T23:41:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.309+0000 7faaed77c640 1 -- 172.21.15.8:0/2496974514 wait complete. 2023-11-18T23:41:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 Processor -- start 2023-11-18T23:41:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 -- start start 2023-11-18T23:41:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae8071c60 0x7faae8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faae813cf00 0x7faae81330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae813d650 0x7faae8150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8133f50 con 0x7faae813d650 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8136230 con 0x7faae8071c60 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.311+0000 7faaed77c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae815cee0 con 0x7faae813cf00 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae813d650 0x7faae8150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae813d650 0x7faae8150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34968/0 (socket says 172.21.15.8:34968) 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 -- 172.21.15.8:0/1781717090 learned_addr learned my addr 172.21.15.8:0/1781717090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae67fc640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faae813cf00 0x7faae81330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae6ffd640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae8071c60 0x7faae8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 -- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faae813cf00 msgr2=0x7faae81330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faae813cf00 0x7faae81330b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 -- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae8071c60 msgr2=0x7faae8135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae8071c60 0x7faae8135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 -- 172.21.15.8:0/1781717090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00094d0 con 0x7faae813d650 2023-11-18T23:41:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faae77fe640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae813d650 0x7faae8150680 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faad8007e90 tx=0x7faad800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faadf7fe640 1 -- 172.21.15.8:0/1781717090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8014420 con 0x7faae813d650 2023-11-18T23:41:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faadf7fe640 1 -- 172.21.15.8:0/1781717090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad8014580 con 0x7faae813d650 2023-11-18T23:41:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae81335f0 con 0x7faae813d650 2023-11-18T23:41:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faadf7fe640 1 -- 172.21.15.8:0/1781717090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8014930 con 0x7faae813d650 2023-11-18T23:41:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.312+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae815d130 con 0x7faae813d650 2023-11-18T23:41:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.313+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae8134090 con 0x7faae813d650 2023-11-18T23:41:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.314+0000 7faadf7fe640 1 -- 172.21.15.8:0/1781717090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faad8014a90 con 0x7faae813d650 2023-11-18T23:41:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.314+0000 7faadf7fe640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faac806ae70 0x7faac806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.314+0000 7faadf7fe640 1 -- 172.21.15.8:0/1781717090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faad8089e90 con 0x7faae813d650 2023-11-18T23:41:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.314+0000 7faae6ffd640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faac806ae70 0x7faac806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.315+0000 7faae6ffd640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faac806ae70 0x7faac806d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faae0004f60 tx=0x7faae0007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.319+0000 7faadf7fe640 1 -- 172.21.15.8:0/1781717090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faae8134090 con 0x7faae813d650 2023-11-18T23:41:37.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.494+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faae8134090 con 0x7faae813d650 2023-11-18T23:41:37.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.494+0000 7faadf7fe640 1 -- 172.21.15.8:0/1781717090 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faae8134090 con 0x7faae813d650 2023-11-18T23:41:37.496 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:37.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faac806ae70 msgr2=0x7faac806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faac806ae70 0x7faac806d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faae0004f60 tx=0x7faae0007e30 comp rx=0 tx=0).stop 2023-11-18T23:41:37.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae813d650 msgr2=0x7faae8150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae813d650 0x7faae8150680 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faad8007e90 tx=0x7faad800e4b0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 shutdown_connections 2023-11-18T23:41:37.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faac806ae70 0x7faac806d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faae813d650 0x7faae8150680 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faae813cf00 0x7faae81330b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 --2- 172.21.15.8:0/1781717090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae8071c60 0x7faae8135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 >> 172.21.15.8:0/1781717090 conn(0x7faae806c510 msgr2=0x7faae80af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:37.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 shutdown_connections 2023-11-18T23:41:37.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.496+0000 7faaed77c640 1 -- 172.21.15.8:0/1781717090 wait complete. 2023-11-18T23:41:37.508 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:37.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.613+0000 7fd44b383640 1 Processor -- start 2023-11-18T23:41:37.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.613+0000 7fd44b383640 1 -- start start 2023-11-18T23:41:37.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.614+0000 7fd44b383640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd4440d1720 0x7fd4440d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.614+0000 7fd44b383640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440b3db0 0x7fd4440b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.614+0000 7fd44b383640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4440b5f90 con 0x7fd44415d3e0 2023-11-18T23:41:37.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.614+0000 7fd44b383640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440d20a0 con 0x7fd4440d1720 2023-11-18T23:41:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.614+0000 7fd44b383640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440b61e0 con 0x7fd4440b3db0 2023-11-18T23:41:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd449920640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440b3db0 0x7fd4440b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd44891e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd4440d1720 0x7fd4440d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd44911f640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd44415d3e0 0x7fd4440ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:39740/0 (socket says 172.21.15.8:39740) 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd44911f640 1 -- 172.21.15.8:0/4111153001 learned_addr learned my addr 172.21.15.8:0/4111153001 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd443fff640 1 -- 172.21.15.8:0/4111153001 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095530967 0 0) 0x7fd4440b5f90 con 0x7fd44415d3e0 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd443fff640 1 -- 172.21.15.8:0/4111153001 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd42c003520 con 0x7fd44415d3e0 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd44891e640 1 -- 172.21.15.8:0/4111153001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440b3db0 msgr2=0x7fd4440b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd44891e640 1 --2- 172.21.15.8:0/4111153001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440b3db0 0x7fd4440b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd44891e640 1 -- 172.21.15.8:0/4111153001 >> v1:172.21.15.116:6789/0 conn(0x7fd44415d3e0 legacy=0x7fd4440ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.615+0000 7fd44891e640 1 -- 172.21.15.8:0/4111153001 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440b64c0 con 0x7fd4440d1720 2023-11-18T23:41:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.616+0000 7fd44891e640 1 --2- 172.21.15.8:0/4111153001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440d1720 0x7fd4440d1b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4380097a0 tx=0x7fd43802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7ec139c387aa65 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.616+0000 7fd443fff640 1 -- 172.21.15.8:0/4111153001 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438030610 con 0x7fd4440d1720 2023-11-18T23:41:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.616+0000 7fd443fff640 1 -- 172.21.15.8:0/4111153001 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd438030770 con 0x7fd4440d1720 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.616+0000 7fd443fff640 1 -- 172.21.15.8:0/4111153001 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438030ae0 con 0x7fd4440d1720 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 -- 172.21.15.8:0/4111153001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440d1720 msgr2=0x7fd4440d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 --2- 172.21.15.8:0/4111153001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440d1720 0x7fd4440d1b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4380097a0 tx=0x7fd43802b960 comp rx=0 tx=0).stop 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 -- 172.21.15.8:0/4111153001 shutdown_connections 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 --2- 172.21.15.8:0/4111153001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440b3db0 0x7fd4440b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 --2- 172.21.15.8:0/4111153001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440d1720 0x7fd4440d1b60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 -- 172.21.15.8:0/4111153001 >> 172.21.15.8:0/4111153001 conn(0x7fd44409c480 msgr2=0x7fd4440d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 -- 172.21.15.8:0/4111153001 shutdown_connections 2023-11-18T23:41:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.617+0000 7fd44b383640 1 -- 172.21.15.8:0/4111153001 wait complete. 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.618+0000 7fd44b383640 1 Processor -- start 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.618+0000 7fd44b383640 1 -- start start 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44b383640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440b3db0 0x7fd44414e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44b383640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440d1720 0x7fd4440ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44b383640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd44415d3e0 0x7fd4440b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44b383640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44414eb20 con 0x7fd44415d3e0 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44b383640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441f3c80 con 0x7fd4440b3db0 2023-11-18T23:41:37.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44b383640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441f3f60 con 0x7fd4440d1720 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd44415d3e0 0x7fd4440b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd44415d3e0 0x7fd4440b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60180/0 (socket says 172.21.15.8:60180) 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 -- 172.21.15.8:0/1389135861 learned_addr learned my addr 172.21.15.8:0/1389135861 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44891e640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440d1720 0x7fd4440ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd44911f640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440b3db0 0x7fd44414e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 -- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440d1720 msgr2=0x7fd4440ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440d1720 0x7fd4440ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 -- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440b3db0 msgr2=0x7fd44414e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440b3db0 0x7fd44414e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.619+0000 7fd449920640 1 -- 172.21.15.8:0/1389135861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd438009400 con 0x7fd44415d3e0 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.620+0000 7fd449920640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd44415d3e0 0x7fd4440b0850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00e930 tx=0x7fd43c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.620+0000 7fd441ffb640 1 -- 172.21.15.8:0/1389135861 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c009690 con 0x7fd44415d3e0 2023-11-18T23:41:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.620+0000 7fd441ffb640 1 -- 172.21.15.8:0/1389135861 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c00c980 con 0x7fd44415d3e0 2023-11-18T23:41:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.620+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4440afd70 con 0x7fd44415d3e0 2023-11-18T23:41:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.620+0000 7fd441ffb640 1 -- 172.21.15.8:0/1389135861 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00cd30 con 0x7fd44415d3e0 2023-11-18T23:41:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.620+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4440b0330 con 0x7fd44415d3e0 2023-11-18T23:41:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.621+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4440b0520 con 0x7fd44415d3e0 2023-11-18T23:41:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.621+0000 7fd441ffb640 1 -- 172.21.15.8:0/1389135861 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd43c013470 con 0x7fd44415d3e0 2023-11-18T23:41:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.622+0000 7fd441ffb640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd43006ae40 0x7fd43006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.622+0000 7fd441ffb640 1 -- 172.21.15.8:0/1389135861 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd43c089860 con 0x7fd44415d3e0 2023-11-18T23:41:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.622+0000 7fd44911f640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd43006ae40 0x7fd43006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.623+0000 7fd44911f640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd43006ae40 0x7fd43006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd434005c00 tx=0x7fd434009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.626+0000 7fd441ffb640 1 -- 172.21.15.8:0/1389135861 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd43c0549f0 con 0x7fd44415d3e0 2023-11-18T23:41:37.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.803+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd444067420 con 0x7fd44415d3e0 2023-11-18T23:41:37.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.804+0000 7fd441ffb640 1 -- 172.21.15.8:0/1389135861 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fd43c058010 con 0x7fd44415d3e0 2023-11-18T23:41:37.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:37.805 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:37.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd43006ae40 msgr2=0x7fd43006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd43006ae40 0x7fd43006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd434005c00 tx=0x7fd434009040 comp rx=0 tx=0).stop 2023-11-18T23:41:37.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd44415d3e0 msgr2=0x7fd4440b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd44415d3e0 0x7fd4440b0850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00e930 tx=0x7fd43c00edf0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 shutdown_connections 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd43006ae40 0x7fd43006d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd44415d3e0 0x7fd4440b0850 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4440d1720 0x7fd4440ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 --2- 172.21.15.8:0/1389135861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4440b3db0 0x7fd44414e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 >> 172.21.15.8:0/1389135861 conn(0x7fd44409c480 msgr2=0x7fd4440d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 shutdown_connections 2023-11-18T23:41:37.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.806+0000 7fd44b383640 1 -- 172.21.15.8:0/1389135861 wait complete. 2023-11-18T23:41:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:37.818 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:37.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.927+0000 7f3147e09640 1 Processor -- start 2023-11-18T23:41:37.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.927+0000 7f3147e09640 1 -- start start 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f3147e09640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f314015a6b0 0x7f31400b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f3147e09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31400b36e0 0x7f314014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f3147e09640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400cebe0 con 0x7f31400ce800 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f3147e09640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3140070da0 con 0x7f314015a6b0 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f3147e09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140071080 con 0x7f31400b36e0 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31453a4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f314015a6b0 0x7f31400b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31453a4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f314015a6b0 0x7f31400b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60192/0 (socket says 172.21.15.8:60192) 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31453a4640 1 -- 172.21.15.8:0/297137221 learned_addr learned my addr 172.21.15.8:0/297137221 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31463a6640 1 --2- 172.21.15.8:0/297137221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31400b36e0 0x7f314014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31453a4640 1 -- 172.21.15.8:0/297137221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31400b36e0 msgr2=0x7f314014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31453a4640 1 --2- 172.21.15.8:0/297137221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31400b36e0 0x7f314014fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31453a4640 1 -- 172.21.15.8:0/297137221 >> v1:172.21.15.116:6789/0 conn(0x7f31400ce800 legacy=0x7f31400702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:37.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.928+0000 7f31453a4640 1 -- 172.21.15.8:0/297137221 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140159eb0 con 0x7f314015a6b0 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f31453a4640 1 --2- 172.21.15.8:0/297137221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f314015a6b0 0x7f31400b31a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3130009870 tx=0x7f313002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4d832c4e8b8446 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3144ba3640 1 -- 172.21.15.8:0/297137221 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300317c0 con 0x7f314015a6b0 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3144ba3640 1 -- 172.21.15.8:0/297137221 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130031920 con 0x7f314015a6b0 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3144ba3640 1 -- 172.21.15.8:0/297137221 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130031cb0 con 0x7f314015a6b0 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3147e09640 1 -- 172.21.15.8:0/297137221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f314015a6b0 msgr2=0x7f31400b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3147e09640 1 --2- 172.21.15.8:0/297137221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f314015a6b0 0x7f31400b31a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3130009870 tx=0x7f313002b860 comp rx=0 tx=0).stop 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3147e09640 1 -- 172.21.15.8:0/297137221 shutdown_connections 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3147e09640 1 --2- 172.21.15.8:0/297137221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31400b36e0 0x7f314014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.929+0000 7f3147e09640 1 --2- 172.21.15.8:0/297137221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f314015a6b0 0x7f31400b31a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.930+0000 7f3147e09640 1 -- 172.21.15.8:0/297137221 >> 172.21.15.8:0/297137221 conn(0x7f314006a8f0 msgr2=0x7f314006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.930+0000 7f3147e09640 1 -- 172.21.15.8:0/297137221 shutdown_connections 2023-11-18T23:41:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.930+0000 7f3147e09640 1 -- 172.21.15.8:0/297137221 wait complete. 2023-11-18T23:41:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.931+0000 7f3147e09640 1 Processor -- start 2023-11-18T23:41:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.931+0000 7f3147e09640 1 -- start start 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.931+0000 7f3147e09640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31400b36e0 0x7f314014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3147e09640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31400ce800 0x7f314014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3147e09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f314015a6b0 0x7f314014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3147e09640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314014cfb0 con 0x7f31400b36e0 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3147e09640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314014f150 con 0x7f31400ce800 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3147e09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314014db70 con 0x7f314015a6b0 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31400b36e0 0x7f314014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31400b36e0 0x7f314014ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60200/0 (socket says 172.21.15.8:60200) 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 -- 172.21.15.8:0/2359292429 learned_addr learned my addr 172.21.15.8:0/2359292429 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f31453a4640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31400ce800 0x7f314014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f31463a6640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f314015a6b0 0x7f314014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 -- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f314015a6b0 msgr2=0x7f314014d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f314015a6b0 0x7f314014d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 -- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31400ce800 msgr2=0x7f314014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31400ce800 0x7f314014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 -- 172.21.15.8:0/2359292429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300094d0 con 0x7f31400b36e0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f31453a4640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31400ce800 0x7f314014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3145ba5640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31400b36e0 0x7f314014ca70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f313c00c430 tx=0x7f313c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f31367fc640 1 -- 172.21.15.8:0/2359292429 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c011790 con 0x7f31400b36e0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f31367fc640 1 -- 172.21.15.8:0/2359292429 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c0118f0 con 0x7f31400b36e0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314014de50 con 0x7f31400b36e0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f31367fc640 1 -- 172.21.15.8:0/2359292429 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c011ce0 con 0x7f31400b36e0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.932+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314014e410 con 0x7f31400b36e0 2023-11-18T23:41:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.933+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3140072ae0 con 0x7f31400b36e0 2023-11-18T23:41:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.934+0000 7f31367fc640 1 -- 172.21.15.8:0/2359292429 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f313c01c460 con 0x7f31400b36e0 2023-11-18T23:41:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.934+0000 7f31367fc640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f312406ae40 0x7f312406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.934+0000 7f31367fc640 1 -- 172.21.15.8:0/2359292429 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f313c089680 con 0x7f31400b36e0 2023-11-18T23:41:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.935+0000 7f31453a4640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f312406ae40 0x7f312406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.935+0000 7f31453a4640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f312406ae40 0x7f312406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3130036000 tx=0x7f313003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:37.939+0000 7f31367fc640 1 -- 172.21.15.8:0/2359292429 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f313c054690 con 0x7f31400b36e0 2023-11-18T23:41:38.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.117+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f314004e920 con 0x7f31400b36e0 2023-11-18T23:41:38.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.117+0000 7f31367fc640 1 -- 172.21.15.8:0/2359292429 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f313c057cb0 con 0x7f31400b36e0 2023-11-18T23:41:38.119 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f312406ae40 msgr2=0x7f312406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f312406ae40 0x7f312406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3130036000 tx=0x7f313003d040 comp rx=0 tx=0).stop 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31400b36e0 msgr2=0x7f314014ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31400b36e0 0x7f314014ca70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f313c00c430 tx=0x7f313c00c8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 shutdown_connections 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f312406ae40 0x7f312406d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f314015a6b0 0x7f314014d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31400ce800 0x7f314014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 --2- 172.21.15.8:0/2359292429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31400b36e0 0x7f314014ca70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 >> 172.21.15.8:0/2359292429 conn(0x7f314006a8f0 msgr2=0x7f314015e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 shutdown_connections 2023-11-18T23:41:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.119+0000 7f3147e09640 1 -- 172.21.15.8:0/2359292429 wait complete. 2023-11-18T23:41:38.131 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:38.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.239+0000 7fbc2b1d5640 1 Processor -- start 2023-11-18T23:41:38.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.239+0000 7fbc2b1d5640 1 -- start start 2023-11-18T23:41:38.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc2b1d5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 0x7fbc2409a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc2b1d5640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240b37b0 con 0x7fbc2415e810 2023-11-18T23:41:38.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc2b1d5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240cc720 con 0x7fbc240cd540 2023-11-18T23:41:38.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc2b1d5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240b2260 con 0x7fbc2415ebf0 2023-11-18T23:41:38.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc28f71640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbc2415e810 0x7fbc24099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39360/0 (socket says 172.21.15.8:39360) 2023-11-18T23:41:38.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc28f71640 1 -- 172.21.15.8:0/1547982113 learned_addr learned my addr 172.21.15.8:0/1547982113 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:38.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc23fff640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 0x7fbc2409a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869244247 0 0) 0x7fbc240b37b0 con 0x7fbc2415e810 2023-11-18T23:41:38.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc14003520 con 0x7fbc2415e810 2023-11-18T23:41:38.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 606974927 0 0) 0x7fbc14003520 con 0x7fbc2415e810 2023-11-18T23:41:38.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 msgr2=0x7fbc2409a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:38.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 0x7fbc2409a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 >> v1:172.21.15.116:6789/0 conn(0x7fbc240cd540 legacy=0x7fbc240b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2409a6f0 con 0x7fbc2415e810 2023-11-18T23:41:38.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fbc18001670 con 0x7fbc2415e810 2023-11-18T23:41:38.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc23fff640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 0x7fbc2409a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:38.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 >> v1:172.21.15.8:6789/0 conn(0x7fbc2415e810 legacy=0x7fbc24099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 0x7fbc140039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc14003f90 0x7fbc140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc14004d00 0x7fbc14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240b2260 con 0x7fbc14003f90 2023-11-18T23:41:38.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1400bae0 con 0x7fbc14004d00 2023-11-18T23:41:38.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.240+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1400bca0 con 0x7fbc2415ebf0 2023-11-18T23:41:38.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc23fff640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc14003f90 0x7fbc140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc28f71640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 0x7fbc140039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc29772640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc14004d00 0x7fbc14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc23fff640 1 -- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 msgr2=0x7fbc140039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:38.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc23fff640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc2415ebf0 0x7fbc140039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc23fff640 1 -- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc14004d00 msgr2=0x7fbc14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:38.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc23fff640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc14004d00 0x7fbc14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.241+0000 7fbc23fff640 1 -- 172.21.15.8:0/1547982113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14003520 con 0x7fbc14003f90 2023-11-18T23:41:38.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc23fff640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc14003f90 0x7fbc140047c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbc2415efd0 tx=0x7fbc140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4588edf52b81f3a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10004230 con 0x7fbc14003f90 2023-11-18T23:41:38.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10004390 con 0x7fbc14003f90 2023-11-18T23:41:38.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc237fe640 1 -- 172.21.15.8:0/1547982113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10003830 con 0x7fbc14003f90 2023-11-18T23:41:38.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/1547982113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc14003f90 msgr2=0x7fbc140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc2b1d5640 1 --2- 172.21.15.8:0/1547982113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc14003f90 0x7fbc140047c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbc2415efd0 tx=0x7fbc140057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc29772640 1 -- 172.21.15.8:0/1547982113 reap_dead start 2023-11-18T23:41:38.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/1547982113 shutdown_connections 2023-11-18T23:41:38.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/1547982113 >> 172.21.15.8:0/1547982113 conn(0x7fbc240b2a70 msgr2=0x7fbc240b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:38.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/1547982113 shutdown_connections 2023-11-18T23:41:38.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.242+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/1547982113 wait complete. 2023-11-18T23:41:38.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.243+0000 7fbc2b1d5640 1 Processor -- start 2023-11-18T23:41:38.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc2b1d5640 1 -- start start 2023-11-18T23:41:38.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc2b1d5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc14003f90 0x7fbc240ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc2b1d5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc240c7930 0x7fbc2414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc2b1d5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc241f0e40 0x7fbc241f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc2b1d5640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240b4ab0 con 0x7fbc240c7930 2023-11-18T23:41:38.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc2b1d5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240c4e80 con 0x7fbc241f0e40 2023-11-18T23:41:38.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc2b1d5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc241f1800 con 0x7fbc14003f90 2023-11-18T23:41:38.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.244+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc240c7930 0x7fbc2414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc240c7930 0x7fbc2414e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60204/0 (socket says 172.21.15.8:60204) 2023-11-18T23:41:38.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 -- 172.21.15.8:0/3767437229 learned_addr learned my addr 172.21.15.8:0/3767437229 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc29772640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc241f0e40 0x7fbc241f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc28f71640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc14003f90 0x7fbc240ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 -- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc14003f90 msgr2=0x7fbc240ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc14003f90 0x7fbc240ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 -- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc241f0e40 msgr2=0x7fbc241f12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc241f0e40 0x7fbc241f12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 -- 172.21.15.8:0/3767437229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240cad30 con 0x7fbc240c7930 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc29772640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc241f0e40 0x7fbc241f12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc23fff640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc240c7930 0x7fbc2414e2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc1002bdd0 tx=0x7fbc10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc217fa640 1 -- 172.21.15.8:0/3767437229 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10032680 con 0x7fbc240c7930 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc217fa640 1 -- 172.21.15.8:0/3767437229 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc100327e0 con 0x7fbc240c7930 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc240cb010 con 0x7fbc240c7930 2023-11-18T23:41:38.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc217fa640 1 -- 172.21.15.8:0/3767437229 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10032b50 con 0x7fbc240c7930 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.245+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc240b4fe0 con 0x7fbc240c7930 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.246+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc240b51a0 con 0x7fbc240c7930 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.247+0000 7fbc217fa640 1 -- 172.21.15.8:0/3767437229 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc10032cb0 con 0x7fbc240c7930 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.247+0000 7fbc217fa640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc0806ae70 0x7fbc0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.247+0000 7fbc217fa640 1 -- 172.21.15.8:0/3767437229 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc100abe50 con 0x7fbc240c7930 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.247+0000 7fbc28f71640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc0806ae70 0x7fbc0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.248+0000 7fbc28f71640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc0806ae70 0x7fbc0806d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc18001b40 tx=0x7fbc18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.251+0000 7fbc217fa640 1 -- 172.21.15.8:0/3767437229 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc10076f90 con 0x7fbc240c7930 2023-11-18T23:41:38.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.429+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc2409ef40 con 0x7fbc240c7930 2023-11-18T23:41:38.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.429+0000 7fbc217fa640 1 -- 172.21.15.8:0/3767437229 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc10044020 con 0x7fbc240c7930 2023-11-18T23:41:38.430 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc0806ae70 msgr2=0x7fbc0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc0806ae70 0x7fbc0806d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc18001b40 tx=0x7fbc18009040 comp rx=0 tx=0).stop 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc240c7930 msgr2=0x7fbc2414e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc240c7930 0x7fbc2414e2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc1002bdd0 tx=0x7fbc10004730 comp rx=0 tx=0).stop 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 shutdown_connections 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc0806ae70 0x7fbc0806d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc241f0e40 0x7fbc241f12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc240c7930 0x7fbc2414e2a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 --2- 172.21.15.8:0/3767437229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc14003f90 0x7fbc240ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 >> 172.21.15.8:0/3767437229 conn(0x7fbc240b2a70 msgr2=0x7fbc240b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 shutdown_connections 2023-11-18T23:41:38.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.431+0000 7fbc2b1d5640 1 -- 172.21.15.8:0/3767437229 wait complete. 2023-11-18T23:41:38.444 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.551+0000 7f282a90a640 1 Processor -- start 2023-11-18T23:41:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.551+0000 7f282a90a640 1 -- start start 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f282a90a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2824160b70 0x7f28240d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f282a90a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f28240b2aa0 0x7f28240ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f282a90a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28240ce360 con 0x7f28240ced30 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f282a90a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240b2f20 con 0x7f28240b2aa0 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f282a90a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28240cdd50 con 0x7f2824160b70 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f28237fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f28240b2aa0 0x7f28240ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f28237fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f28240b2aa0 0x7f28240ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60216/0 (socket says 172.21.15.8:60216) 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.552+0000 7f28237fe640 1 -- 172.21.15.8:0/1095276206 learned_addr learned my addr 172.21.15.8:0/1095276206 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.553+0000 7f2823fff640 1 --2- 172.21.15.8:0/1095276206 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2824160b70 0x7f28240d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.553+0000 7f28237fe640 1 -- 172.21.15.8:0/1095276206 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2824160b70 msgr2=0x7f28240d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.553+0000 7f28237fe640 1 --2- 172.21.15.8:0/1095276206 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2824160b70 0x7f28240d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.553+0000 7f28237fe640 1 -- 172.21.15.8:0/1095276206 >> v1:172.21.15.116:6789/0 conn(0x7f28240ced30 legacy=0x7f28240cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.553+0000 7f2822ffd640 1 -- 172.21.15.8:0/1095276206 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089883386 0 0) 0x7f28240ce360 con 0x7f28240ced30 2023-11-18T23:41:38.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.553+0000 7f28237fe640 1 -- 172.21.15.8:0/1095276206 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240d1c70 con 0x7f28240b2aa0 2023-11-18T23:41:38.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f28237fe640 1 --2- 172.21.15.8:0/1095276206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28240b2aa0 0x7f28240ce7f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f281802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2e726d9ffecf1d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f2822ffd640 1 -- 172.21.15.8:0/1095276206 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818030840 con 0x7f28240b2aa0 2023-11-18T23:41:38.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f2822ffd640 1 -- 172.21.15.8:0/1095276206 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28180309a0 con 0x7f28240b2aa0 2023-11-18T23:41:38.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f2822ffd640 1 -- 172.21.15.8:0/1095276206 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818030d30 con 0x7f28240b2aa0 2023-11-18T23:41:38.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 -- 172.21.15.8:0/1095276206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28240b2aa0 msgr2=0x7f28240ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 --2- 172.21.15.8:0/1095276206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28240b2aa0 0x7f28240ce7f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f281802b980 comp rx=0 tx=0).stop 2023-11-18T23:41:38.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 -- 172.21.15.8:0/1095276206 shutdown_connections 2023-11-18T23:41:38.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 --2- 172.21.15.8:0/1095276206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28240b2aa0 0x7f28240ce7f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 --2- 172.21.15.8:0/1095276206 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2824160b70 0x7f28240d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 -- 172.21.15.8:0/1095276206 >> 172.21.15.8:0/1095276206 conn(0x7f282409c470 msgr2=0x7f28240d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 -- 172.21.15.8:0/1095276206 shutdown_connections 2023-11-18T23:41:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.554+0000 7f282a90a640 1 -- 172.21.15.8:0/1095276206 wait complete. 2023-11-18T23:41:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.555+0000 7f282a90a640 1 Processor -- start 2023-11-18T23:41:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.556+0000 7f282a90a640 1 -- start start 2023-11-18T23:41:38.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.556+0000 7f282a90a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28240b2aa0 0x7f28241f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.556+0000 7f282a90a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28240ced30 0x7f282406b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.556+0000 7f282a90a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2824160b70 0x7f282414d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.556+0000 7f282a90a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28240cb410 con 0x7f2824160b70 2023-11-18T23:41:38.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.556+0000 7f282a90a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28240cb660 con 0x7f28240b2aa0 2023-11-18T23:41:38.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.556+0000 7f282a90a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28240cb940 con 0x7f28240ced30 2023-11-18T23:41:38.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2824160b70 0x7f282414d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2824160b70 0x7f282414d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60224/0 (socket says 172.21.15.8:60224) 2023-11-18T23:41:38.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 -- 172.21.15.8:0/2461509299 learned_addr learned my addr 172.21.15.8:0/2461509299 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:38.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f28237fe640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28240ced30 0x7f282406b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2823fff640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28240b2aa0 0x7f28241f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 -- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28240ced30 msgr2=0x7f282406b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28240ced30 0x7f282406b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 -- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28240b2aa0 msgr2=0x7f28241f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28240b2aa0 0x7f28241f3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 -- 172.21.15.8:0/2461509299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180094d0 con 0x7f2824160b70 2023-11-18T23:41:38.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f28237fe640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28240ced30 0x7f282406b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:38.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2828ea7640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2824160b70 0x7f282414d170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f281c001560 tx=0x7f281c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2820ff9640 1 -- 172.21.15.8:0/2461509299 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c003da0 con 0x7f2824160b70 2023-11-18T23:41:38.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2820ff9640 1 -- 172.21.15.8:0/2461509299 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c005070 con 0x7f2824160b70 2023-11-18T23:41:38.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28240cbc20 con 0x7f2824160b70 2023-11-18T23:41:38.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f2820ff9640 1 -- 172.21.15.8:0/2461509299 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c005420 con 0x7f2824160b70 2023-11-18T23:41:38.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.557+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282406b9f0 con 0x7f2824160b70 2023-11-18T23:41:38.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.558+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282406bbe0 con 0x7f2824160b70 2023-11-18T23:41:38.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.559+0000 7f2820ff9640 1 -- 172.21.15.8:0/2461509299 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f281c005580 con 0x7f2824160b70 2023-11-18T23:41:38.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.559+0000 7f2820ff9640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f281006ae40 0x7f281006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.559+0000 7f2820ff9640 1 -- 172.21.15.8:0/2461509299 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f281c088e10 con 0x7f2824160b70 2023-11-18T23:41:38.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.559+0000 7f2823fff640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f281006ae40 0x7f281006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.560+0000 7f2823fff640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f281006ae40 0x7f281006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2814009aa0 tx=0x7f2814009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.564+0000 7f2820ff9640 1 -- 172.21.15.8:0/2461509299 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f281c053f70 con 0x7f2824160b70 2023-11-18T23:41:38.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.738+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28240cc140 con 0x7f2824160b70 2023-11-18T23:41:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.739+0000 7f2820ff9640 1 -- 172.21.15.8:0/2461509299 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28240cc140 con 0x7f2824160b70 2023-11-18T23:41:38.740 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f281006ae40 msgr2=0x7f281006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f281006ae40 0x7f281006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2814009aa0 tx=0x7f2814009190 comp rx=0 tx=0).stop 2023-11-18T23:41:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2824160b70 msgr2=0x7f282414d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2824160b70 0x7f282414d170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f281c001560 tx=0x7f281c00cc70 comp rx=0 tx=0).stop 2023-11-18T23:41:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 shutdown_connections 2023-11-18T23:41:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f281006ae40 0x7f281006d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2824160b70 0x7f282414d170 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28240ced30 0x7f282406b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 --2- 172.21.15.8:0/2461509299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28240b2aa0 0x7f28241f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 >> 172.21.15.8:0/2461509299 conn(0x7f282409c470 msgr2=0x7f28240b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 shutdown_connections 2023-11-18T23:41:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.741+0000 7f282a90a640 1 -- 172.21.15.8:0/2461509299 wait complete. 2023-11-18T23:41:38.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:38.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.858+0000 7f8683abb640 1 Processor -- start 2023-11-18T23:41:38.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.858+0000 7f8683abb640 1 -- start start 2023-11-18T23:41:38.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8683abb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 0x7f867c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8683abb640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0b0660 con 0x7f867c15d900 2023-11-18T23:41:38.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8683abb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c06c900 con 0x7f867c0b2610 2023-11-18T23:41:38.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8683abb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c06cbe0 con 0x7f867c09a080 2023-11-18T23:41:38.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8681857640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f867c15d900 0x7f867c099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39366/0 (socket says 172.21.15.8:39366) 2023-11-18T23:41:38.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8681857640 1 -- 172.21.15.8:0/1939644308 learned_addr learned my addr 172.21.15.8:0/1939644308 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:38.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8681056640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 0x7f867c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74357671 0 0) 0x7f867c0b0660 con 0x7f867c15d900 2023-11-18T23:41:38.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8668003520 con 0x7f867c15d900 2023-11-18T23:41:38.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3566342639 0 0) 0x7f8668003520 con 0x7f867c15d900 2023-11-18T23:41:38.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 msgr2=0x7f867c0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8680855640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 0x7f867c0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 >> v1:172.21.15.116:6789/0 conn(0x7f867c0b2610 legacy=0x7f867c0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.859+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c06cec0 con 0x7f867c15d900 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f8678001670 con 0x7f867c15d900 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 >> v1:172.21.15.8:6789/0 conn(0x7f867c15d900 legacy=0x7f867c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86680039a0 0x7f8668003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8668004350 0x7f8668004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 0x7f8668005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c06cbe0 con 0x7f86680039a0 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866800b980 con 0x7f8668004350 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866800bb40 con 0x7f867c09a080 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8681857640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86680039a0 0x7f8668003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8682058640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 0x7f8668005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8681056640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8668004350 0x7f8668004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8681857640 1 -- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 msgr2=0x7f8668005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8681857640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c09a080 0x7f8668005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8681857640 1 -- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8668004350 msgr2=0x7f8668004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8681857640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8668004350 0x7f8668004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.860+0000 7f8681857640 1 -- 172.21.15.8:0/1939644308 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668003520 con 0x7f86680039a0 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8681857640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86680039a0 0x7f8668003d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f867800c190 tx=0x7f86680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6f4a1d371c05fd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678005ad0 con 0x7f86680039a0 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678005c50 con 0x7f86680039a0 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8680855640 1 -- 172.21.15.8:0/1939644308 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867802c850 con 0x7f86680039a0 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8683abb640 1 -- 172.21.15.8:0/1939644308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86680039a0 msgr2=0x7f8668003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8683abb640 1 --2- 172.21.15.8:0/1939644308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86680039a0 0x7f8668003d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f867800c190 tx=0x7f86680057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8682058640 1 -- 172.21.15.8:0/1939644308 reap_dead start 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8683abb640 1 -- 172.21.15.8:0/1939644308 shutdown_connections 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.861+0000 7f8683abb640 1 -- 172.21.15.8:0/1939644308 >> 172.21.15.8:0/1939644308 conn(0x7f867c0b2a70 msgr2=0x7f867c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.862+0000 7f8683abb640 1 -- 172.21.15.8:0/1939644308 shutdown_connections 2023-11-18T23:41:38.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.862+0000 7f8683abb640 1 -- 172.21.15.8:0/1939644308 wait complete. 2023-11-18T23:41:38.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 Processor -- start 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 -- start start 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86680039a0 0x7f867c0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0b3b40 0x7f867c0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c0b3fa0 0x7f867c0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0b4520 con 0x7f867c0b3b40 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0b4800 con 0x7f86680039a0 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.863+0000 7f8683abb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0b4ae0 con 0x7f867c0b3fa0 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0b3b40 0x7f867c0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0b3b40 0x7f867c0b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60252/0 (socket says 172.21.15.8:60252) 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 -- 172.21.15.8:0/3156509355 learned_addr learned my addr 172.21.15.8:0/3156509355 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681857640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86680039a0 0x7f867c0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8682058640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c0b3fa0 0x7f867c0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 -- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c0b3fa0 msgr2=0x7f867c0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c0b3fa0 0x7f867c0b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 -- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86680039a0 msgr2=0x7f867c0caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86680039a0 0x7f867c0caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 -- 172.21.15.8:0/3156509355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0b4dc0 con 0x7f867c0b3b40 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681857640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86680039a0 0x7f867c0caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8681056640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0b3b40 0x7f867c0b0cd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f866c0119a0 tx=0x7f866c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f86727fc640 1 -- 172.21.15.8:0/3156509355 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00faf0 con 0x7f867c0b3b40 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f86727fc640 1 -- 172.21.15.8:0/3156509355 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c00fc50 con 0x7f867c0b3b40 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f86727fc640 1 -- 172.21.15.8:0/3156509355 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c014440 con 0x7f867c0b3b40 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c0b50a0 con 0x7f867c0b3b40 2023-11-18T23:41:38.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.864+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0b1d00 con 0x7f867c0b3b40 2023-11-18T23:41:38.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.865+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c067420 con 0x7f867c0b3b40 2023-11-18T23:41:38.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.866+0000 7f86727fc640 1 -- 172.21.15.8:0/3156509355 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f866c0145a0 con 0x7f867c0b3b40 2023-11-18T23:41:38.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.866+0000 7f86727fc640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f866006ae40 0x7f866006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:38.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.866+0000 7f86727fc640 1 -- 172.21.15.8:0/3156509355 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f866c089d70 con 0x7f867c0b3b40 2023-11-18T23:41:38.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.866+0000 7f8681857640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f866006ae40 0x7f866006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:38.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.867+0000 7f8681857640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f866006ae40 0x7f866006d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f867800c190 tx=0x7f8678009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:38.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:38.870+0000 7f86727fc640 1 -- 172.21.15.8:0/3156509355 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f866c054e20 con 0x7f867c0b3b40 2023-11-18T23:41:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.048+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f867c0cba30 con 0x7f867c0b3b40 2023-11-18T23:41:39.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.049+0000 7f86727fc640 1 -- 172.21.15.8:0/3156509355 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f866c022020 con 0x7f867c0b3b40 2023-11-18T23:41:39.121 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:39.122 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:39.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f866006ae40 msgr2=0x7f866006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f866006ae40 0x7f866006d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f867800c190 tx=0x7f8678009030 comp rx=0 tx=0).stop 2023-11-18T23:41:39.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0b3b40 msgr2=0x7f867c0b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0b3b40 0x7f867c0b0cd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f866c0119a0 tx=0x7f866c011e60 comp rx=0 tx=0).stop 2023-11-18T23:41:39.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 shutdown_connections 2023-11-18T23:41:39.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f866006ae40 0x7f866006d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f867c0b3fa0 0x7f867c0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0b3b40 0x7f867c0b0cd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 --2- 172.21.15.8:0/3156509355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86680039a0 0x7f867c0caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 >> 172.21.15.8:0/3156509355 conn(0x7f867c0b2a70 msgr2=0x7f867c099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:39.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 shutdown_connections 2023-11-18T23:41:39.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.051+0000 7f8683abb640 1 -- 172.21.15.8:0/3156509355 wait complete. 2023-11-18T23:41:39.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:39.125 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.234+0000 7f27c6b6c640 1 Processor -- start 2023-11-18T23:41:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.234+0000 7f27c6b6c640 1 -- start start 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27c6b6c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 0x7f27c00cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27c6b6c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c00b3590 con 0x7f27c006bc50 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27c6b6c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c006b310 con 0x7f27c00b6b50 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27c6b6c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00cd3a0 con 0x7f27c009a080 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27c5109640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f27c006bc50 0x7f27c006c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39378/0 (socket says 172.21.15.8:39378) 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27c5109640 1 -- 172.21.15.8:0/3016743255 learned_addr learned my addr 172.21.15.8:0/3016743255 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bffff640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 0x7f27c00cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081404559 0 0) 0x7f27c00b3590 con 0x7f27c006bc50 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ac003520 con 0x7f27c006bc50 2023-11-18T23:41:39.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053130845 0 0) 0x7f27c006b310 con 0x7f27c00b6b50 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c00b3590 con 0x7f27c00b6b50 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2988633260 0 0) 0x7f27ac003520 con 0x7f27c006bc50 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 msgr2=0x7f27c00cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 0x7f27c00cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 >> v1:172.21.15.116:6789/0 conn(0x7f27c00b6b50 legacy=0x7f27c0099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00b37c0 con 0x7f27c006bc50 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f27b80019f0 con 0x7f27c006bc50 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 >> v1:172.21.15.8:6789/0 conn(0x7f27c006bc50 legacy=0x7f27c006c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27ac003b30 0x7f27ac003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.235+0000 7f27bf7fe640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 0x7f27ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27bf7fe640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00cd3a0 con 0x7f27ac004d00 2023-11-18T23:41:39.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac00ba30 con 0x7f27ac003b30 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac00bba0 con 0x7f27c009a080 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27c5109640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27c4908640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27ac003b30 0x7f27ac003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27bffff640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 0x7f27ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27c5109640 1 -- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 msgr2=0x7f27ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27c5109640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c009a080 0x7f27ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27c5109640 1 -- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27ac003b30 msgr2=0x7f27ac003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27c5109640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27ac003b30 0x7f27ac003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.236+0000 7f27c5109640 1 -- 172.21.15.8:0/3016743255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac003520 con 0x7f27ac004d00 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c5109640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27ac005180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f27b800a7a0 tx=0x7f27ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fac0988d0d80f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8034630 con 0x7f27ac004d00 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b802f070 con 0x7f27ac004d00 2023-11-18T23:41:39.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27bf7fe640 1 -- 172.21.15.8:0/3016743255 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b80349f0 con 0x7f27ac004d00 2023-11-18T23:41:39.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c6b6c640 1 -- 172.21.15.8:0/3016743255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 msgr2=0x7f27ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c6b6c640 1 --2- 172.21.15.8:0/3016743255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27ac005180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f27b800a7a0 tx=0x7f27ac0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c5109640 1 -- 172.21.15.8:0/3016743255 reap_dead start 2023-11-18T23:41:39.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c6b6c640 1 -- 172.21.15.8:0/3016743255 shutdown_connections 2023-11-18T23:41:39.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c6b6c640 1 -- 172.21.15.8:0/3016743255 >> 172.21.15.8:0/3016743255 conn(0x7f27c00b2a70 msgr2=0x7f27c00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:39.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c6b6c640 1 -- 172.21.15.8:0/3016743255 shutdown_connections 2023-11-18T23:41:39.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.237+0000 7f27c6b6c640 1 -- 172.21.15.8:0/3016743255 wait complete. 2023-11-18T23:41:39.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.238+0000 7f27c6b6c640 1 Processor -- start 2023-11-18T23:41:39.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.239+0000 7f27c6b6c640 1 -- start start 2023-11-18T23:41:39.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.239+0000 7f27c6b6c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27c0153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.239+0000 7f27c6b6c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c015e680 0x7f27c00c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.239+0000 7f27c6b6c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00c7860 0x7f27c00ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.239+0000 7f27c6b6c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c015e1f0 con 0x7f27ac004d00 2023-11-18T23:41:39.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.239+0000 7f27c6b6c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c015d5e0 con 0x7f27c00c7860 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.239+0000 7f27c6b6c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c015d8c0 con 0x7f27c015e680 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27c0153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27c0153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60268/0 (socket says 172.21.15.8:60268) 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 -- 172.21.15.8:0/1191720944 learned_addr learned my addr 172.21.15.8:0/1191720944 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c5109640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00c7860 0x7f27c00ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 -- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c015e680 msgr2=0x7f27c00c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c015e680 0x7f27c00c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 -- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00c7860 msgr2=0x7f27c00ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00c7860 0x7f27c00ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 -- 172.21.15.8:0/1191720944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c015dba0 con 0x7f27ac004d00 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c4908640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27c0153540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27b000f7a0 tx=0x7f27b000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27bd7fa640 1 -- 172.21.15.8:0/1191720944 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000fe50 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27bd7fa640 1 -- 172.21.15.8:0/1191720944 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00052e0 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c015de80 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27bd7fa640 1 -- 172.21.15.8:0/1191720944 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000d970 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.240+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c00ca5a0 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.241+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c009ef40 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.241+0000 7f27bd7fa640 1 -- 172.21.15.8:0/1191720944 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27b000dad0 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.242+0000 7f27bd7fa640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f27a006ae40 0x7f27a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.242+0000 7f27bd7fa640 1 -- 172.21.15.8:0/1191720944 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27b0089610 con 0x7f27ac004d00 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.242+0000 7f27bffff640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f27a006ae40 0x7f27a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.243+0000 7f27bffff640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f27a006ae40 0x7f27a006d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f27c006b2d0 tx=0x7f27a80095d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.246+0000 7f27bd7fa640 1 -- 172.21.15.8:0/1191720944 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27b0054750 con 0x7f27ac004d00 2023-11-18T23:41:39.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.423+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27c004e920 con 0x7f27ac004d00 2023-11-18T23:41:39.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.424+0000 7f27bd7fa640 1 -- 172.21.15.8:0/1191720944 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27b0057d70 con 0x7f27ac004d00 2023-11-18T23:41:39.425 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f27a006ae40 msgr2=0x7f27a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f27a006ae40 0x7f27a006d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f27c006b2d0 tx=0x7f27a80095d0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 msgr2=0x7f27c0153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27c0153540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27b000f7a0 tx=0x7f27b000fc60 comp rx=0 tx=0).stop 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 shutdown_connections 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f27a006ae40 0x7f27a006d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00c7860 0x7f27c00ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c015e680 0x7f27c00c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.425+0000 7f27c6b6c640 1 --2- 172.21.15.8:0/1191720944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27ac004d00 0x7f27c0153540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.426+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 >> 172.21.15.8:0/1191720944 conn(0x7f27c00b2a70 msgr2=0x7f27c00b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.426+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 shutdown_connections 2023-11-18T23:41:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.426+0000 7f27c6b6c640 1 -- 172.21.15.8:0/1191720944 wait complete. 2023-11-18T23:41:39.437 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:39.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.545+0000 7f6f92b90640 1 Processor -- start 2023-11-18T23:41:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.545+0000 7f6f92b90640 1 -- start start 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f92b90640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6f8c15b0d0 0x7f6f8c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f92b90640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f8c070630 0x7f6f8c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f92b90640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c15b530 con 0x7f6f8c13f750 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f92b90640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c0cec70 con 0x7f6f8c070630 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f92b90640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c0ce060 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f9112d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f8c070630 0x7f6f8c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f9112d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f8c070630 0x7f6f8c070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60274/0 (socket says 172.21.15.8:60274) 2023-11-18T23:41:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f9112d640 1 -- 172.21.15.8:0/3337324262 learned_addr learned my addr 172.21.15.8:0/3337324262 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f8bfff640 1 --2- 172.21.15.8:0/3337324262 >> v2:172.21.15.116:3300/0 conn(0x7f6f8c15b0d0 0x7f6f8c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f9112d640 1 -- 172.21.15.8:0/3337324262 >> v2:172.21.15.116:3300/0 conn(0x7f6f8c15b0d0 msgr2=0x7f6f8c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f9112d640 1 --2- 172.21.15.8:0/3337324262 >> v2:172.21.15.116:3300/0 conn(0x7f6f8c15b0d0 0x7f6f8c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.546+0000 7f6f9112d640 1 -- 172.21.15.8:0/3337324262 >> v1:172.21.15.116:6789/0 conn(0x7f6f8c13f750 legacy=0x7f6f8c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.547+0000 7f6f9112d640 1 -- 172.21.15.8:0/3337324262 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0ce340 con 0x7f6f8c070630 2023-11-18T23:41:39.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.547+0000 7f6f9112d640 1 --2- 172.21.15.8:0/3337324262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c070630 0x7f6f8c070ac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c15ec00 tx=0x7f6f7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70377e4b55acdfad server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.547+0000 7f6f8b7fe640 1 -- 172.21.15.8:0/3337324262 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c031870 con 0x7f6f8c070630 2023-11-18T23:41:39.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.547+0000 7f6f8b7fe640 1 -- 172.21.15.8:0/3337324262 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c0319d0 con 0x7f6f8c070630 2023-11-18T23:41:39.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.547+0000 7f6f8b7fe640 1 -- 172.21.15.8:0/3337324262 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c031d60 con 0x7f6f8c070630 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 -- 172.21.15.8:0/3337324262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c070630 msgr2=0x7f6f8c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3337324262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c070630 0x7f6f8c070ac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c15ec00 tx=0x7f6f7c02b910 comp rx=0 tx=0).stop 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 -- 172.21.15.8:0/3337324262 shutdown_connections 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3337324262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c070630 0x7f6f8c070ac0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3337324262 >> v2:172.21.15.116:3300/0 conn(0x7f6f8c15b0d0 0x7f6f8c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 -- 172.21.15.8:0/3337324262 >> 172.21.15.8:0/3337324262 conn(0x7f6f8c06a8f0 msgr2=0x7f6f8c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 -- 172.21.15.8:0/3337324262 shutdown_connections 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.548+0000 7f6f92b90640 1 -- 172.21.15.8:0/3337324262 wait complete. 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.549+0000 7f6f92b90640 1 Processor -- start 2023-11-18T23:41:39.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.549+0000 7f6f92b90640 1 -- start start 2023-11-18T23:41:39.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f92b90640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f8c070630 0x7f6f8c150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f92b90640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f8c13f750 0x7f6f8c0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f92b90640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c15b0d0 0x7f6f8c0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f92b90640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c135210 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f92b90640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c151270 con 0x7f6f8c070630 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f92b90640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0ae980 con 0x7f6f8c13f750 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f9112d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c15b0d0 0x7f6f8c0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f9112d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c15b0d0 0x7f6f8c0b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60280/0 (socket says 172.21.15.8:60280) 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f9112d640 1 -- 172.21.15.8:0/3618457918 learned_addr learned my addr 172.21.15.8:0/3618457918 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f8bfff640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f8c13f750 0x7f6f8c0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.550+0000 7f6f9092c640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f8c070630 0x7f6f8c150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f9112d640 1 -- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f8c13f750 msgr2=0x7f6f8c0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f9112d640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f8c13f750 0x7f6f8c0b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f9112d640 1 -- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f8c070630 msgr2=0x7f6f8c150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f9112d640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f8c070630 0x7f6f8c150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f9112d640 1 -- 172.21.15.8:0/3618457918 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0094d0 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f9092c640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f8c070630 0x7f6f8c150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f8bfff640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f8c13f750 0x7f6f8c0b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f9112d640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c15b0d0 0x7f6f8c0b15b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0090b0 tx=0x7f6f7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f897fa640 1 -- 172.21.15.8:0/3618457918 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c03ad20 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f897fa640 1 -- 172.21.15.8:0/3618457918 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c0443f0 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c0aec60 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f897fa640 1 -- 172.21.15.8:0/3618457918 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c03aea0 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.551+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c0af220 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.552+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c072ae0 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.552+0000 7f6f897fa640 1 -- 172.21.15.8:0/3618457918 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f7c04d450 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.553+0000 7f6f897fa640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6f6c06ae40 0x7f6f6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.553+0000 7f6f897fa640 1 -- 172.21.15.8:0/3618457918 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f7c02d040 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.553+0000 7f6f9092c640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6f6c06ae40 0x7f6f6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.554+0000 7f6f9092c640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6f6c06ae40 0x7f6f6c06d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f840045b0 tx=0x7f6f84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.557+0000 7f6f897fa640 1 -- 172.21.15.8:0/3618457918 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f7c076c60 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.735+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f8c04e920 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.735+0000 7f6f897fa640 1 -- 172.21.15.8:0/3618457918 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f7c07a280 con 0x7f6f8c15b0d0 2023-11-18T23:41:39.737 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:39.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.737+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6f6c06ae40 msgr2=0x7f6f6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.737+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6f6c06ae40 0x7f6f6c06d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f840045b0 tx=0x7f6f84009040 comp rx=0 tx=0).stop 2023-11-18T23:41:39.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.737+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c15b0d0 msgr2=0x7f6f8c0b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.737+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c15b0d0 0x7f6f8c0b15b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0090b0 tx=0x7f6f7c0046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 shutdown_connections 2023-11-18T23:41:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6f6c06ae40 0x7f6f6c06d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f8c15b0d0 0x7f6f8c0b15b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f8c13f750 0x7f6f8c0b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 --2- 172.21.15.8:0/3618457918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f8c070630 0x7f6f8c150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 >> 172.21.15.8:0/3618457918 conn(0x7f6f8c06a8f0 msgr2=0x7f6f8c06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 shutdown_connections 2023-11-18T23:41:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.738+0000 7f6f92b90640 1 -- 172.21.15.8:0/3618457918 wait complete. 2023-11-18T23:41:39.750 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.859+0000 7fe4b02bb640 1 Processor -- start 2023-11-18T23:41:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.859+0000 7fe4b02bb640 1 -- start start 2023-11-18T23:41:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.859+0000 7fe4b02bb640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4a815d650 0x7fe4a80cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.859+0000 7fe4b02bb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe4a8072190 0x7fe4a80c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4b02bb640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a80cd3a0 con 0x7fe4a815da30 2023-11-18T23:41:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4b02bb640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a80cf080 con 0x7fe4a815d650 2023-11-18T23:41:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4b02bb640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a80ae710 con 0x7fe4a8072190 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ae057640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4a815d650 0x7fe4a80cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ad856640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe4a815da30 0x7fe4a8071a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39388/0 (socket says 172.21.15.8:39388) 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ad856640 1 -- 172.21.15.8:0/394029746 learned_addr learned my addr 172.21.15.8:0/394029746 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ae858640 1 --2- 172.21.15.8:0/394029746 >> v2:172.21.15.116:3300/0 conn(0x7fe4a8072190 0x7fe4a80c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ae057640 1 -- 172.21.15.8:0/394029746 >> v2:172.21.15.116:3300/0 conn(0x7fe4a8072190 msgr2=0x7fe4a80c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ae057640 1 --2- 172.21.15.8:0/394029746 >> v2:172.21.15.116:3300/0 conn(0x7fe4a8072190 0x7fe4a80c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ae057640 1 -- 172.21.15.8:0/394029746 >> v1:172.21.15.8:6789/0 conn(0x7fe4a815da30 legacy=0x7fe4a8071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ae057640 1 -- 172.21.15.8:0/394029746 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a80ceda0 con 0x7fe4a815d650 2023-11-18T23:41:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.860+0000 7fe4ad055640 1 -- 172.21.15.8:0/394029746 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062482116 0 0) 0x7fe4a80cd3a0 con 0x7fe4a815da30 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.861+0000 7fe4ae057640 1 --2- 172.21.15.8:0/394029746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a815d650 0x7fe4a80cce60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4a806f080 tx=0x7fe4a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a160d12b34ac11 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.861+0000 7fe4ad055640 1 -- 172.21.15.8:0/394029746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a002cc80 con 0x7fe4a815d650 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.861+0000 7fe4ad055640 1 -- 172.21.15.8:0/394029746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a002cde0 con 0x7fe4a815d650 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.861+0000 7fe4ad055640 1 -- 172.21.15.8:0/394029746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0034660 con 0x7fe4a815d650 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.861+0000 7fe4b02bb640 1 -- 172.21.15.8:0/394029746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a815d650 msgr2=0x7fe4a80cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.861+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/394029746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a815d650 0x7fe4a80cce60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4a806f080 tx=0x7fe4a002bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.861+0000 7fe4b02bb640 1 -- 172.21.15.8:0/394029746 shutdown_connections 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.862+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/394029746 >> v2:172.21.15.116:3300/0 conn(0x7fe4a8072190 0x7fe4a80c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.862+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/394029746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a815d650 0x7fe4a80cce60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.862+0000 7fe4b02bb640 1 -- 172.21.15.8:0/394029746 >> 172.21.15.8:0/394029746 conn(0x7fe4a80cf290 msgr2=0x7fe4a80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.862+0000 7fe4b02bb640 1 -- 172.21.15.8:0/394029746 shutdown_connections 2023-11-18T23:41:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.862+0000 7fe4b02bb640 1 -- 172.21.15.8:0/394029746 wait complete. 2023-11-18T23:41:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 Processor -- start 2023-11-18T23:41:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 -- start start 2023-11-18T23:41:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8072190 0x7fe4a80b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a815d650 0x7fe4a81f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4a815da30 0x7fe4a8156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80b0800 con 0x7fe4a8072190 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a81f41a0 con 0x7fe4a815d650 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.863+0000 7fe4b02bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80c3d40 con 0x7fe4a815da30 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8072190 0x7fe4a80b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8072190 0x7fe4a80b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60288/0 (socket says 172.21.15.8:60288) 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 -- 172.21.15.8:0/3537174382 learned_addr learned my addr 172.21.15.8:0/3537174382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 -- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4a815da30 msgr2=0x7fe4a8156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4a815da30 0x7fe4a8156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 -- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a815d650 msgr2=0x7fe4a81f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a815d650 0x7fe4a81f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 -- 172.21.15.8:0/3537174382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0009a70 con 0x7fe4a8072190 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4ae057640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8072190 0x7fe4a80b02c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0037040 tx=0x7fe4a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe49effd640 1 -- 172.21.15.8:0/3537174382 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0040650 con 0x7fe4a8072190 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe49effd640 1 -- 172.21.15.8:0/3537174382 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a00407b0 con 0x7fe4a8072190 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a81f3ec0 con 0x7fe4a8072190 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe49effd640 1 -- 172.21.15.8:0/3537174382 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0040b60 con 0x7fe4a8072190 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.864+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a80b2370 con 0x7fe4a8072190 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.865+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a80b1ef0 con 0x7fe4a8072190 2023-11-18T23:41:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.866+0000 7fe49effd640 1 -- 172.21.15.8:0/3537174382 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4a0040cc0 con 0x7fe4a8072190 2023-11-18T23:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.866+0000 7fe49effd640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe48c06ae40 0x7fe48c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.866+0000 7fe49effd640 1 -- 172.21.15.8:0/3537174382 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4a00ac440 con 0x7fe4a8072190 2023-11-18T23:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.866+0000 7fe4ad856640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe48c06ae40 0x7fe48c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.867+0000 7fe4ad856640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe48c06ae40 0x7fe48c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe498007fd0 tx=0x7fe498007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:39.871+0000 7fe49effd640 1 -- 172.21.15.8:0/3537174382 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4a80b1ef0 con 0x7fe4a8072190 2023-11-18T23:41:40.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.044+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4a80b1ed0 con 0x7fe4a8072190 2023-11-18T23:41:40.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.045+0000 7fe49effd640 1 -- 172.21.15.8:0/3537174382 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4a0077610 con 0x7fe4a8072190 2023-11-18T23:41:40.046 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe48c06ae40 msgr2=0x7fe48c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe48c06ae40 0x7fe48c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe498007fd0 tx=0x7fe498007960 comp rx=0 tx=0).stop 2023-11-18T23:41:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8072190 msgr2=0x7fe4a80b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8072190 0x7fe4a80b02c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0037040 tx=0x7fe4a0004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 shutdown_connections 2023-11-18T23:41:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fe48c06ae40 0x7fe48c06d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4a815da30 0x7fe4a8156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a815d650 0x7fe4a81f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 --2- 172.21.15.8:0/3537174382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4a8072190 0x7fe4a80b02c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 >> 172.21.15.8:0/3537174382 conn(0x7fe4a80cf290 msgr2=0x7fe4a80afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:40.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 shutdown_connections 2023-11-18T23:41:40.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.047+0000 7fe4b02bb640 1 -- 172.21.15.8:0/3537174382 wait complete. 2023-11-18T23:41:40.086 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-18T23:41:40.086 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:40.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.192+0000 7fa450415640 1 Processor -- start 2023-11-18T23:41:40.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.192+0000 7fa450415640 1 -- start start 2023-11-18T23:41:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa450415640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa448071f00 0x7fa4480b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa450415640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480b3130 con 0x7fa44806dc30 2023-11-18T23:41:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa450415640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa448072350 con 0x7fa448142d20 2023-11-18T23:41:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa450415640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480b2330 con 0x7fa448071f00 2023-11-18T23:41:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa44d9b0640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa44806dc30 0x7fa4480cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39394/0 (socket says 172.21.15.8:39394) 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa44d9b0640 1 -- 172.21.15.8:0/2978183619 learned_addr learned my addr 172.21.15.8:0/2978183619 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa44e9b2640 1 --2- 172.21.15.8:0/2978183619 >> v2:172.21.15.116:3300/0 conn(0x7fa448071f00 0x7fa4480b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.193+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706336998 0 0) 0x7fa4480b3130 con 0x7fa44806dc30 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa430003520 con 0x7fa44806dc30 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481494420 0 0) 0x7fa430003520 con 0x7fa44806dc30 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 >> v2:172.21.15.116:3300/0 conn(0x7fa448071f00 msgr2=0x7fa4480b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 --2- 172.21.15.8:0/2978183619 >> v2:172.21.15.116:3300/0 conn(0x7fa448071f00 0x7fa4480b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 >> v1:172.21.15.116:6789/0 conn(0x7fa448142d20 legacy=0x7fa44806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448143100 con 0x7fa44806dc30 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fa43c001670 con 0x7fa44806dc30 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 >> v1:172.21.15.8:6789/0 conn(0x7fa44806dc30 legacy=0x7fa4480cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa430003970 0x7fa430003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4300047c0 0x7fa430004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa430005180 0x7fa43000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43000bff0 con 0x7fa4300047c0 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43000c160 con 0x7fa430003970 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43000c320 con 0x7fa430005180 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d9b0640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4300047c0 0x7fa430004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44e1b1640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa430003970 0x7fa430003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44e9b2640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa430005180 0x7fa43000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d9b0640 1 -- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa430005180 msgr2=0x7fa43000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d9b0640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa430005180 0x7fa43000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d9b0640 1 -- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa430003970 msgr2=0x7fa430003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d9b0640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa430003970 0x7fa430003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44d9b0640 1 -- 172.21.15.8:0/2978183619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430003520 con 0x7fa4300047c0 2023-11-18T23:41:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.194+0000 7fa44e9b2640 1 -- 172.21.15.8:0/2978183619 reap_dead start 2023-11-18T23:41:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.195+0000 7fa44d9b0640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4300047c0 0x7fa430004c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c190 tx=0x7fa4300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0876e30d48cb606 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.195+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c005ad0 con 0x7fa4300047c0 2023-11-18T23:41:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.195+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c005c50 con 0x7fa4300047c0 2023-11-18T23:41:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.195+0000 7fa44d1af640 1 -- 172.21.15.8:0/2978183619 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c02c830 con 0x7fa4300047c0 2023-11-18T23:41:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.196+0000 7fa450415640 1 -- 172.21.15.8:0/2978183619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4300047c0 msgr2=0x7fa430004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.196+0000 7fa450415640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4300047c0 0x7fa430004c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c190 tx=0x7fa4300057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.196+0000 7fa450415640 1 -- 172.21.15.8:0/2978183619 shutdown_connections 2023-11-18T23:41:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.196+0000 7fa450415640 1 --2- 172.21.15.8:0/2978183619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4300047c0 0x7fa430004c40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.196+0000 7fa450415640 1 -- 172.21.15.8:0/2978183619 >> 172.21.15.8:0/2978183619 conn(0x7fa4480b0af0 msgr2=0x7fa4480b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.196+0000 7fa450415640 1 -- 172.21.15.8:0/2978183619 shutdown_connections 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.196+0000 7fa450415640 1 -- 172.21.15.8:0/2978183619 wait complete. 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.197+0000 7fa450415640 1 Processor -- start 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.197+0000 7fa450415640 1 -- start start 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa450415640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4300047c0 0x7fa4480c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa450415640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa448159940 0x7fa4480702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa450415640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448070800 0x7fa4480cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa450415640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa448070c80 con 0x7fa448159940 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa450415640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa448159dc0 con 0x7fa448070800 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa450415640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480aa680 con 0x7fa4300047c0 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa448159940 0x7fa4480702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa448159940 0x7fa4480702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60300/0 (socket says 172.21.15.8:60300) 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 -- 172.21.15.8:0/3032226661 learned_addr learned my addr 172.21.15.8:0/3032226661 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44e9b2640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448070800 0x7fa4480cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44e1b1640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4300047c0 0x7fa4480c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 -- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4300047c0 msgr2=0x7fa4480c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4300047c0 0x7fa4480c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 -- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448070800 msgr2=0x7fa4480cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448070800 0x7fa4480cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 -- 172.21.15.8:0/3032226661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480aa960 con 0x7fa448159940 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa44d9b0640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa448159940 0x7fa4480702c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa43c001930 tx=0x7fa43c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa446ffd640 1 -- 172.21.15.8:0/3032226661 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c03c040 con 0x7fa448159940 2023-11-18T23:41:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa446ffd640 1 -- 172.21.15.8:0/3032226661 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c02cd00 con 0x7fa448159940 2023-11-18T23:41:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa446ffd640 1 -- 172.21.15.8:0/3032226661 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c007270 con 0x7fa448159940 2023-11-18T23:41:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.198+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4480aac40 con 0x7fa448159940 2023-11-18T23:41:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.199+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4480cd470 con 0x7fa448159940 2023-11-18T23:41:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.200+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4480aa7c0 con 0x7fa448159940 2023-11-18T23:41:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.200+0000 7fa446ffd640 1 -- 172.21.15.8:0/3032226661 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa43c032070 con 0x7fa448159940 2023-11-18T23:41:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.200+0000 7fa446ffd640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa43406ae70 0x7fa43406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.201+0000 7fa446ffd640 1 -- 172.21.15.8:0/3032226661 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa43c0aa890 con 0x7fa448159940 2023-11-18T23:41:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.201+0000 7fa44e1b1640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa43406ae70 0x7fa43406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.201+0000 7fa44e1b1640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa43406ae70 0x7fa43406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa440000c00 tx=0x7fa440009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.205+0000 7fa446ffd640 1 -- 172.21.15.8:0/3032226661 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4480aa7c0 con 0x7fa448159940 2023-11-18T23:41:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.382+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4480aa7c0 con 0x7fa448159940 2023-11-18T23:41:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.383+0000 7fa446ffd640 1 -- 172.21.15.8:0/3032226661 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fa4480aa7c0 con 0x7fa448159940 2023-11-18T23:41:40.384 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:40.384 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa43406ae70 msgr2=0x7fa43406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa43406ae70 0x7fa43406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa440000c00 tx=0x7fa440009040 comp rx=0 tx=0).stop 2023-11-18T23:41:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa448159940 msgr2=0x7fa4480702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa448159940 0x7fa4480702c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa43c001930 tx=0x7fa43c02e070 comp rx=0 tx=0).stop 2023-11-18T23:41:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 shutdown_connections 2023-11-18T23:41:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa43406ae70 0x7fa43406d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa448070800 0x7fa4480cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa448159940 0x7fa4480702c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 --2- 172.21.15.8:0/3032226661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4300047c0 0x7fa4480c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 >> 172.21.15.8:0/3032226661 conn(0x7fa4480b0af0 msgr2=0x7fa4480ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:40.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 shutdown_connections 2023-11-18T23:41:40.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.385+0000 7fa450415640 1 -- 172.21.15.8:0/3032226661 wait complete. 2023-11-18T23:41:40.397 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:40.397 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:40.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.505+0000 7f2047a61640 1 Processor -- start 2023-11-18T23:41:40.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.505+0000 7f2047a61640 1 -- start start 2023-11-18T23:41:40.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2047a61640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 0x7f20400cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2047a61640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2040099970 0x7f2040099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2047a61640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20400b3590 con 0x7f20400cc390 2023-11-18T23:41:40.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2047a61640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204006b310 con 0x7f2040099970 2023-11-18T23:41:40.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2047a61640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204009a2d0 con 0x7f20400b6b50 2023-11-18T23:41:40.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2045ffe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f20400cc390 0x7f20400cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39406/0 (socket says 172.21.15.8:39406) 2023-11-18T23:41:40.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2045ffe640 1 -- 172.21.15.8:0/2477703 learned_addr learned my addr 172.21.15.8:0/2477703 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:40.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f20457fd640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 0x7f20400cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2044ffc640 1 --2- 172.21.15.8:0/2477703 >> v2:172.21.15.116:3300/0 conn(0x7f2040099970 0x7f2040099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056984650 0 0) 0x7f20400b3590 con 0x7f20400cc390 2023-11-18T23:41:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.506+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f202c003520 con 0x7f20400cc390 2023-11-18T23:41:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2137759421 0 0) 0x7f202c003520 con 0x7f20400cc390 2023-11-18T23:41:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 msgr2=0x7f20400cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 0x7f20400cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 >> v2:172.21.15.116:3300/0 conn(0x7f2040099970 msgr2=0x7f2040099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 --2- 172.21.15.8:0/2477703 >> v2:172.21.15.116:3300/0 conn(0x7f2040099970 0x7f2040099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400b37c0 con 0x7f20400cc390 2023-11-18T23:41:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f20380019f0 con 0x7f20400cc390 2023-11-18T23:41:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 >> v1:172.21.15.8:6789/0 conn(0x7f20400cc390 legacy=0x7f20400cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 0x7f202c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f202c003ef0 0x7f202c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c004d00 0x7f202c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204006b310 con 0x7f202c004d00 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204009a2d0 con 0x7f202c003ef0 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c00b9b0 con 0x7f20400b6b50 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2045ffe640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c004d00 0x7f202c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f20457fd640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 0x7f202c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2044ffc640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f202c003ef0 0x7f202c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2045ffe640 1 -- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 msgr2=0x7f202c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2045ffe640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20400b6b50 0x7f202c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2045ffe640 1 -- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f202c003ef0 msgr2=0x7f202c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2045ffe640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f202c003ef0 0x7f202c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.507+0000 7f2045ffe640 1 -- 172.21.15.8:0/2477703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c003520 con 0x7f202c004d00 2023-11-18T23:41:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.508+0000 7f2045ffe640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c004d00 0x7f202c005180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f203800a8d0 tx=0x7f202c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a31a8c2dbb7e412 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.508+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038034630 con 0x7f202c004d00 2023-11-18T23:41:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.508+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203802f070 con 0x7f202c004d00 2023-11-18T23:41:40.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.508+0000 7f2037fff640 1 -- 172.21.15.8:0/2477703 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20380349d0 con 0x7f202c004d00 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.509+0000 7f2047a61640 1 -- 172.21.15.8:0/2477703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c004d00 msgr2=0x7f202c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.509+0000 7f2047a61640 1 --2- 172.21.15.8:0/2477703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c004d00 0x7f202c005180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f203800a8d0 tx=0x7f202c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.509+0000 7f2045ffe640 1 -- 172.21.15.8:0/2477703 reap_dead start 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.509+0000 7f2047a61640 1 -- 172.21.15.8:0/2477703 shutdown_connections 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.509+0000 7f2047a61640 1 -- 172.21.15.8:0/2477703 >> 172.21.15.8:0/2477703 conn(0x7f20400b2a70 msgr2=0x7f20400b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.509+0000 7f2047a61640 1 -- 172.21.15.8:0/2477703 shutdown_connections 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.509+0000 7f2047a61640 1 -- 172.21.15.8:0/2477703 wait complete. 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.510+0000 7f2047a61640 1 Processor -- start 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.510+0000 7f2047a61640 1 -- start start 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2047a61640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20400cca00 0x7f204014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2047a61640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20400ccde0 0x7f204014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2047a61640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20401f3000 0x7f20401f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2047a61640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204015f100 con 0x7f20400cca00 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2047a61640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204015e810 con 0x7f20400ccde0 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2047a61640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20401f3ff0 con 0x7f20401f3000 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20400cca00 0x7f204014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20400cca00 0x7f204014a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60310/0 (socket says 172.21.15.8:60310) 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 -- 172.21.15.8:0/684191853 learned_addr learned my addr 172.21.15.8:0/684191853 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:40.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2044ffc640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20400ccde0 0x7f204014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2045ffe640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20401f3000 0x7f20401f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 -- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20401f3000 msgr2=0x7f20401f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20401f3000 0x7f20401f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 -- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20400ccde0 msgr2=0x7f204014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20400ccde0 0x7f204014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 -- 172.21.15.8:0/684191853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20401f3d10 con 0x7f20400cca00 2023-11-18T23:41:40.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2044ffc640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20400ccde0 0x7f204014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:40.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f20457fd640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20400cca00 0x7f204014a2d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f203c0119a0 tx=0x7f203c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2035ffb640 1 -- 172.21.15.8:0/684191853 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c00faf0 con 0x7f20400cca00 2023-11-18T23:41:40.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2035ffb640 1 -- 172.21.15.8:0/684191853 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c00fc50 con 0x7f20400cca00 2023-11-18T23:41:40.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204015ea40 con 0x7f20400cca00 2023-11-18T23:41:40.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.511+0000 7f2035ffb640 1 -- 172.21.15.8:0/684191853 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c014440 con 0x7f20400cca00 2023-11-18T23:41:40.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.512+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20401f39f0 con 0x7f20400cca00 2023-11-18T23:41:40.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.513+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204009ef40 con 0x7f20400cca00 2023-11-18T23:41:40.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.513+0000 7f2035ffb640 1 -- 172.21.15.8:0/684191853 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f203c0145a0 con 0x7f20400cca00 2023-11-18T23:41:40.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.513+0000 7f2035ffb640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f202406ae40 0x7f202406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.514+0000 7f2035ffb640 1 -- 172.21.15.8:0/684191853 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f203c089ed0 con 0x7f20400cca00 2023-11-18T23:41:40.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.514+0000 7f2044ffc640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f202406ae40 0x7f202406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.514+0000 7f2044ffc640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f202406ae40 0x7f202406d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f204009ab00 tx=0x7f2030008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.518+0000 7f2035ffb640 1 -- 172.21.15.8:0/684191853 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f203c054f80 con 0x7f20400cca00 2023-11-18T23:41:40.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.692+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f204004e920 con 0x7f20400cca00 2023-11-18T23:41:40.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.692+0000 7f2035ffb640 1 -- 172.21.15.8:0/684191853 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f203c0220a0 con 0x7f20400cca00 2023-11-18T23:41:40.694 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:40.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f202406ae40 msgr2=0x7f202406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f202406ae40 0x7f202406d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f204009ab00 tx=0x7f2030008040 comp rx=0 tx=0).stop 2023-11-18T23:41:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20400cca00 msgr2=0x7f204014a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20400cca00 0x7f204014a2d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f203c0119a0 tx=0x7f203c011e60 comp rx=0 tx=0).stop 2023-11-18T23:41:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 shutdown_connections 2023-11-18T23:41:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f202406ae40 0x7f202406d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20401f3000 0x7f20401f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20400ccde0 0x7f204014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 --2- 172.21.15.8:0/684191853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20400cca00 0x7f204014a2d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 >> 172.21.15.8:0/684191853 conn(0x7f20400b2a70 msgr2=0x7f204006d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:40.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 shutdown_connections 2023-11-18T23:41:40.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.694+0000 7f2047a61640 1 -- 172.21.15.8:0/684191853 wait complete. 2023-11-18T23:41:40.706 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.813+0000 7f16efaa9640 1 Processor -- start 2023-11-18T23:41:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.814+0000 7f16efaa9640 1 -- start start 2023-11-18T23:41:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.814+0000 7f16efaa9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f16e8160b70 0x7f16e80d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.814+0000 7f16efaa9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80b2aa0 0x7f16e80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.814+0000 7f16efaa9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f16e80ced30 0x7f16e80cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.814+0000 7f16efaa9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80ce360 con 0x7f16e80ced30 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.814+0000 7f16efaa9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80b2f20 con 0x7f16e8160b70 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.814+0000 7f16efaa9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80cdd50 con 0x7f16e80b2aa0 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f16e80ced30 0x7f16e80cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f16e80ced30 0x7f16e80cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60314/0 (socket says 172.21.15.8:60314) 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 -- 172.21.15.8:0/2262043722 learned_addr learned my addr 172.21.15.8:0/2262043722 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ed845640 1 --2- 172.21.15.8:0/2262043722 >> v2:172.21.15.116:3300/0 conn(0x7f16e8160b70 0x7f16e80d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ed044640 1 --2- 172.21.15.8:0/2262043722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80b2aa0 0x7f16e80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 -- 172.21.15.8:0/2262043722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80b2aa0 msgr2=0x7f16e80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 --2- 172.21.15.8:0/2262043722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80b2aa0 0x7f16e80ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 -- 172.21.15.8:0/2262043722 >> v2:172.21.15.116:3300/0 conn(0x7f16e8160b70 msgr2=0x7f16e80d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 --2- 172.21.15.8:0/2262043722 >> v2:172.21.15.116:3300/0 conn(0x7f16e8160b70 0x7f16e80d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.815+0000 7f16ee046640 1 -- 172.21.15.8:0/2262043722 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80d1c70 con 0x7f16e80ced30 2023-11-18T23:41:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16ee046640 1 --2- 172.21.15.8:0/2262043722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e80ced30 0x7f16e80cfb50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f16e808ca80 tx=0x7f16e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53607bb7f934474f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16ec843640 1 -- 172.21.15.8:0/2262043722 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e002ca70 con 0x7f16e80ced30 2023-11-18T23:41:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16ec843640 1 -- 172.21.15.8:0/2262043722 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e002cbd0 con 0x7f16e80ced30 2023-11-18T23:41:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16ec843640 1 -- 172.21.15.8:0/2262043722 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00343f0 con 0x7f16e80ced30 2023-11-18T23:41:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 -- 172.21.15.8:0/2262043722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e80ced30 msgr2=0x7f16e80cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 --2- 172.21.15.8:0/2262043722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e80ced30 0x7f16e80cfb50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f16e808ca80 tx=0x7f16e002bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 -- 172.21.15.8:0/2262043722 shutdown_connections 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 --2- 172.21.15.8:0/2262043722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e80ced30 0x7f16e80cfb50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 --2- 172.21.15.8:0/2262043722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80b2aa0 0x7f16e80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 --2- 172.21.15.8:0/2262043722 >> v2:172.21.15.116:3300/0 conn(0x7f16e8160b70 0x7f16e80d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 -- 172.21.15.8:0/2262043722 >> 172.21.15.8:0/2262043722 conn(0x7f16e809c470 msgr2=0x7f16e80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 -- 172.21.15.8:0/2262043722 shutdown_connections 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.816+0000 7f16efaa9640 1 -- 172.21.15.8:0/2262043722 wait complete. 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 Processor -- start 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 -- start start 2023-11-18T23:41:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16e80b2aa0 0x7f16e81555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80ced30 0x7f16e815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e8160b70 0x7f16e80b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e814cd20 con 0x7f16e8160b70 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8157fb0 con 0x7f16e80b2aa0 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16efaa9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81573a0 con 0x7f16e80ced30 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16ee046640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e8160b70 0x7f16e80b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16ee046640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e8160b70 0x7f16e80b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60328/0 (socket says 172.21.15.8:60328) 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.818+0000 7f16ee046640 1 -- 172.21.15.8:0/3919176881 learned_addr learned my addr 172.21.15.8:0/3919176881 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ed044640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80ced30 0x7f16e815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ed845640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16e80b2aa0 0x7f16e81555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ee046640 1 -- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80ced30 msgr2=0x7f16e815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ee046640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80ced30 0x7f16e815f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ee046640 1 -- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16e80b2aa0 msgr2=0x7f16e81555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ee046640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16e80b2aa0 0x7f16e81555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ee046640 1 -- 172.21.15.8:0/3919176881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009b30 con 0x7f16e8160b70 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ed845640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16e80b2aa0 0x7f16e81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16ee046640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e8160b70 0x7f16e80b1030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f16e0036040 tx=0x7f16e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16de7fc640 1 -- 172.21.15.8:0/3919176881 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0009510 con 0x7f16e8160b70 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16de7fc640 1 -- 172.21.15.8:0/3919176881 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e003e450 con 0x7f16e8160b70 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e8157680 con 0x7f16e8160b70 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16de7fc640 1 -- 172.21.15.8:0/3919176881 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e003e800 con 0x7f16e8160b70 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.819+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e8157c40 con 0x7f16e8160b70 2023-11-18T23:41:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.820+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e8158140 con 0x7f16e8160b70 2023-11-18T23:41:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.821+0000 7f16de7fc640 1 -- 172.21.15.8:0/3919176881 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16e003e960 con 0x7f16e8160b70 2023-11-18T23:41:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.821+0000 7f16de7fc640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f16cc06ae40 0x7f16cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.821+0000 7f16de7fc640 1 -- 172.21.15.8:0/3919176881 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e00ac3a0 con 0x7f16e8160b70 2023-11-18T23:41:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.821+0000 7f16ed845640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f16cc06ae40 0x7f16cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.822+0000 7f16ed845640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f16cc06ae40 0x7f16cc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16e4006fd0 tx=0x7f16e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:40.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:40.826+0000 7f16de7fc640 1 -- 172.21.15.8:0/3919176881 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16e0077450 con 0x7f16e8160b70 2023-11-18T23:41:41.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.001+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16e80a1150 con 0x7f16e8160b70 2023-11-18T23:41:41.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.002+0000 7f16de7fc640 1 -- 172.21.15.8:0/3919176881 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16e007aa70 con 0x7f16e8160b70 2023-11-18T23:41:41.003 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:41.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f16cc06ae40 msgr2=0x7f16cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f16cc06ae40 0x7f16cc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f16e4006fd0 tx=0x7f16e4008040 comp rx=0 tx=0).stop 2023-11-18T23:41:41.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e8160b70 msgr2=0x7f16e80b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e8160b70 0x7f16e80b1030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f16e0036040 tx=0x7f16e0004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 shutdown_connections 2023-11-18T23:41:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f16cc06ae40 0x7f16cc06d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e8160b70 0x7f16e80b1030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16e80ced30 0x7f16e815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 --2- 172.21.15.8:0/3919176881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16e80b2aa0 0x7f16e81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.003+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 >> 172.21.15.8:0/3919176881 conn(0x7f16e809c470 msgr2=0x7f16e806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:41.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.004+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 shutdown_connections 2023-11-18T23:41:41.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.004+0000 7f16efaa9640 1 -- 172.21.15.8:0/3919176881 wait complete. 2023-11-18T23:41:41.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:41.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.124+0000 7f09c5d1d640 1 Processor -- start 2023-11-18T23:41:41.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.124+0000 7f09c5d1d640 1 -- start start 2023-11-18T23:41:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09c5d1d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c015e810 0x7f09c00ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09c5d1d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f09c015ebf0 0x7f09c0099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09c5d1d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c00cd170 con 0x7f09c00cd540 2023-11-18T23:41:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09c5d1d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00b2260 con 0x7f09c015ebf0 2023-11-18T23:41:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09c5d1d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00b37b0 con 0x7f09c015e810 2023-11-18T23:41:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09beffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f09c015ebf0 0x7f09c0099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09bffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f09c00cd540 0x7f09c0099eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39414/0 (socket says 172.21.15.8:39414) 2023-11-18T23:41:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09bffff640 1 -- 172.21.15.8:0/3236714515 learned_addr learned my addr 172.21.15.8:0/3236714515 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09bf7fe640 1 --2- 172.21.15.8:0/3236714515 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c015e810 0x7f09c00ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09beffd640 1 -- 172.21.15.8:0/3236714515 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c015e810 msgr2=0x7f09c00ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09beffd640 1 --2- 172.21.15.8:0/3236714515 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c015e810 0x7f09c00ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09beffd640 1 -- 172.21.15.8:0/3236714515 >> v1:172.21.15.8:6789/0 conn(0x7f09c00cd540 legacy=0x7f09c0099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09beffd640 1 -- 172.21.15.8:0/3236714515 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c00cc720 con 0x7f09c015ebf0 2023-11-18T23:41:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09be7fc640 1 -- 172.21.15.8:0/3236714515 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315226143 0 0) 0x7f09c00cd170 con 0x7f09c00cd540 2023-11-18T23:41:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.125+0000 7f09bf7fe640 1 --2- 172.21.15.8:0/3236714515 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c015e810 0x7f09c00ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09beffd640 1 --2- 172.21.15.8:0/3236714515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015ebf0 0x7f09c0099970 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f09b40097a0 tx=0x7f09b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7522674076f42d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09be7fc640 1 -- 172.21.15.8:0/3236714515 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4031830 con 0x7f09c015ebf0 2023-11-18T23:41:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09be7fc640 1 -- 172.21.15.8:0/3236714515 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b4031990 con 0x7f09c015ebf0 2023-11-18T23:41:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09be7fc640 1 -- 172.21.15.8:0/3236714515 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4031d20 con 0x7f09c015ebf0 2023-11-18T23:41:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3236714515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015ebf0 msgr2=0x7f09c0099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3236714515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015ebf0 0x7f09c0099970 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f09b40097a0 tx=0x7f09b402b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3236714515 shutdown_connections 2023-11-18T23:41:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.126+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3236714515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015ebf0 0x7f09c0099970 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.127+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3236714515 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c015e810 0x7f09c00ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.127+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3236714515 >> 172.21.15.8:0/3236714515 conn(0x7f09c00b2a70 msgr2=0x7f09c00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.127+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3236714515 shutdown_connections 2023-11-18T23:41:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.127+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3236714515 wait complete. 2023-11-18T23:41:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.128+0000 7f09c5d1d640 1 Processor -- start 2023-11-18T23:41:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.128+0000 7f09c5d1d640 1 -- start start 2023-11-18T23:41:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09c5d1d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c00cd540 0x7f09c01f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09c5d1d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015e810 0x7f09c00c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09c5d1d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09c015ebf0 0x7f09c014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09c5d1d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c5980 con 0x7f09c015e810 2023-11-18T23:41:41.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09c5d1d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c4ab0 con 0x7f09c015ebf0 2023-11-18T23:41:41.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09c5d1d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c4d00 con 0x7f09c00cd540 2023-11-18T23:41:41.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015e810 0x7f09c00c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015e810 0x7f09c00c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60338/0 (socket says 172.21.15.8:60338) 2023-11-18T23:41:41.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 -- 172.21.15.8:0/3587754661 learned_addr learned my addr 172.21.15.8:0/3587754661 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09bffff640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09c015ebf0 0x7f09c014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09bf7fe640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c00cd540 0x7f09c01f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 -- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c00cd540 msgr2=0x7f09c01f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c00cd540 0x7f09c01f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 -- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09c015ebf0 msgr2=0x7f09c014ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09c015ebf0 0x7f09c014ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 -- 172.21.15.8:0/3587754661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4009400 con 0x7f09c015e810 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09bf7fe640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c00cd540 0x7f09c01f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09beffd640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015e810 0x7f09c00c5da0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09b4034040 tx=0x7f09b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.129+0000 7f09a7fff640 1 -- 172.21.15.8:0/3587754661 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40317d0 con 0x7f09c015e810 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.130+0000 7f09a7fff640 1 -- 172.21.15.8:0/3587754661 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b4004030 con 0x7f09c015e810 2023-11-18T23:41:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.130+0000 7f09a7fff640 1 -- 172.21.15.8:0/3587754661 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40043e0 con 0x7f09c015e810 2023-11-18T23:41:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.130+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c00c4fe0 con 0x7f09c015e810 2023-11-18T23:41:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.130+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c00c55a0 con 0x7f09c015e810 2023-11-18T23:41:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.130+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c00c5ac0 con 0x7f09c015e810 2023-11-18T23:41:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.131+0000 7f09a7fff640 1 -- 172.21.15.8:0/3587754661 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09b4043070 con 0x7f09c015e810 2023-11-18T23:41:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.131+0000 7f09a7fff640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.131+0000 7f09a7fff640 1 -- 172.21.15.8:0/3587754661 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09b40ab3a0 con 0x7f09c015e810 2023-11-18T23:41:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.132+0000 7f09bf7fe640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.132+0000 7f09bf7fe640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f09ac06ae70 0x7f09ac06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09b000aa30 tx=0x7f09b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.136+0000 7f09a7fff640 1 -- 172.21.15.8:0/3587754661 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09c00c5ac0 con 0x7f09c015e810 2023-11-18T23:41:41.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.310+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09c00c5ac0 con 0x7f09c015e810 2023-11-18T23:41:41.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.310+0000 7f09a7fff640 1 -- 172.21.15.8:0/3587754661 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09c00c5ac0 con 0x7f09c015e810 2023-11-18T23:41:41.312 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:41.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f09ac06ae70 msgr2=0x7f09ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f09ac06ae70 0x7f09ac06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09b000aa30 tx=0x7f09b0008040 comp rx=0 tx=0).stop 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015e810 msgr2=0x7f09c00c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015e810 0x7f09c00c5da0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09b4034040 tx=0x7f09b40046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 shutdown_connections 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09c015ebf0 0x7f09c014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c015e810 0x7f09c00c5da0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 --2- 172.21.15.8:0/3587754661 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09c00cd540 0x7f09c01f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 >> 172.21.15.8:0/3587754661 conn(0x7f09c00b2a70 msgr2=0x7f09c0099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 shutdown_connections 2023-11-18T23:41:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.312+0000 7f09c5d1d640 1 -- 172.21.15.8:0/3587754661 wait complete. 2023-11-18T23:41:41.324 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-18T23:41:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.430+0000 7f3898d0f640 1 Processor -- start 2023-11-18T23:41:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.430+0000 7f3898d0f640 1 -- start start 2023-11-18T23:41:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.431+0000 7f3898d0f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f38940d1720 0x7f38940d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.431+0000 7f3898d0f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 0x7f38940b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.431+0000 7f3898d0f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940b5f90 con 0x7f389415d3e0 2023-11-18T23:41:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.431+0000 7f3898d0f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38940d20a0 con 0x7f38940d1720 2023-11-18T23:41:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.431+0000 7f3898d0f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b61e0 con 0x7f38940b3db0 2023-11-18T23:41:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389259c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f389415d3e0 0x7f38940ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39420/0 (socket says 172.21.15.8:39420) 2023-11-18T23:41:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389259c640 1 -- 172.21.15.8:0/3411450745 learned_addr learned my addr 172.21.15.8:0/3411450745 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f3891d9b640 1 --2- 172.21.15.8:0/3411450745 >> v2:172.21.15.116:3300/0 conn(0x7f38940d1720 0x7f38940d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f3892d9d640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 0x7f38940b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872375323 0 0) 0x7f38940b5f90 con 0x7f389415d3e0 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3880003520 con 0x7f389415d3e0 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4181112567 0 0) 0x7f3880003520 con 0x7f389415d3e0 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 msgr2=0x7f38940b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 0x7f38940b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 >> v2:172.21.15.116:3300/0 conn(0x7f38940d1720 msgr2=0x7f38940d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 --2- 172.21.15.8:0/3411450745 >> v2:172.21.15.116:3300/0 conn(0x7f38940d1720 0x7f38940d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940b64c0 con 0x7f389415d3e0 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f387c001670 con 0x7f389415d3e0 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f3891d9b640 1 --2- 172.21.15.8:0/3411450745 >> v2:172.21.15.116:3300/0 conn(0x7f38940d1720 0x7f38940d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 >> v1:172.21.15.8:6789/0 conn(0x7f389415d3e0 legacy=0x7f38940ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f3880003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38800047c0 0x7f3880004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 0x7f3880005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940d20a0 con 0x7f3880003970 2023-11-18T23:41:41.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b61e0 con 0x7f38800047c0 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000b980 con 0x7f38940b3db0 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f389259c640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f3880003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f3892d9d640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 0x7f3880005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.432+0000 7f3891d9b640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38800047c0 0x7f3880004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.433+0000 7f389259c640 1 -- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 msgr2=0x7f3880005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.433+0000 7f389259c640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38940b3db0 0x7f3880005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.433+0000 7f389259c640 1 -- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38800047c0 msgr2=0x7f3880004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.433+0000 7f389259c640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38800047c0 0x7f3880004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.433+0000 7f389259c640 1 -- 172.21.15.8:0/3411450745 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880003520 con 0x7f3880003970 2023-11-18T23:41:41.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.433+0000 7f389259c640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f3880003d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c240 tx=0x7f38800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b949c4204ed5c35 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:41.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c02cb00 con 0x7f3880003970 2023-11-18T23:41:41.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c02cc60 con 0x7f3880003970 2023-11-18T23:41:41.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f389159a640 1 -- 172.21.15.8:0/3411450745 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c005af0 con 0x7f3880003970 2023-11-18T23:41:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f3898d0f640 1 -- 172.21.15.8:0/3411450745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 msgr2=0x7f3880003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f3898d0f640 1 --2- 172.21.15.8:0/3411450745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f3880003d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c240 tx=0x7f38800057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f3892d9d640 1 -- 172.21.15.8:0/3411450745 reap_dead start 2023-11-18T23:41:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f3898d0f640 1 -- 172.21.15.8:0/3411450745 shutdown_connections 2023-11-18T23:41:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.434+0000 7f3898d0f640 1 -- 172.21.15.8:0/3411450745 >> 172.21.15.8:0/3411450745 conn(0x7f389409c480 msgr2=0x7f38940d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.435+0000 7f3898d0f640 1 -- 172.21.15.8:0/3411450745 shutdown_connections 2023-11-18T23:41:41.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.435+0000 7f3898d0f640 1 -- 172.21.15.8:0/3411450745 wait complete. 2023-11-18T23:41:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.436+0000 7f3898d0f640 1 Processor -- start 2023-11-18T23:41:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.436+0000 7f3898d0f640 1 -- start start 2023-11-18T23:41:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3898d0f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f38940cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3898d0f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3894151fd0 0x7f38941451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3898d0f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3894145730 0x7f3894143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3898d0f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894145bb0 con 0x7f3880003970 2023-11-18T23:41:41.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3898d0f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894156ac0 con 0x7f3894145730 2023-11-18T23:41:41.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3898d0f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940cbd10 con 0x7f3894151fd0 2023-11-18T23:41:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f389259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f38940cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3892d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3894145730 0x7f3894143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f389259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f38940cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60356/0 (socket says 172.21.15.8:60356) 2023-11-18T23:41:41.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f389259c640 1 -- 172.21.15.8:0/1658196512 learned_addr learned my addr 172.21.15.8:0/1658196512 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:41.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3891d9b640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3894151fd0 0x7f38941451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3892d9d640 1 -- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3894151fd0 msgr2=0x7f38941451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3892d9d640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3894151fd0 0x7f38941451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3892d9d640 1 -- 172.21.15.8:0/1658196512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 msgr2=0x7f38940cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:41.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3892d9d640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f38940cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:41.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f3892d9d640 1 -- 172.21.15.8:0/1658196512 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940cbff0 con 0x7f3894145730 2023-11-18T23:41:41.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.437+0000 7f389259c640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f38940cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:41.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.438+0000 7f3892d9d640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3894145730 0x7f3894143160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38940cdc30 tx=0x7f388c00f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:41.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.438+0000 7f388affd640 1 -- 172.21.15.8:0/1658196512 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00e040 con 0x7f3894145730 2023-11-18T23:41:41.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.438+0000 7f388affd640 1 -- 172.21.15.8:0/1658196512 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00f040 con 0x7f3894145730 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.438+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940cc2d0 con 0x7f3894145730 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.438+0000 7f388affd640 1 -- 172.21.15.8:0/1658196512 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c015430 con 0x7f3894145730 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.438+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3894156750 con 0x7f3894145730 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.439+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894067420 con 0x7f3894145730 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.440+0000 7f388affd640 1 -- 172.21.15.8:0/1658196512 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f388c015590 con 0x7f3894145730 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.440+0000 7f388affd640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f387406ae70 0x7f387406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.440+0000 7f388affd640 1 -- 172.21.15.8:0/1658196512 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f388c089fa0 con 0x7f3894145730 2023-11-18T23:41:41.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.440+0000 7f389259c640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f387406ae70 0x7f387406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:41.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.441+0000 7f389259c640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f387406ae70 0x7f387406d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f387c001930 tx=0x7f387c007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:41.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.444+0000 7f388affd640 1 -- 172.21.15.8:0/1658196512 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f388c0550e0 con 0x7f3894145730 2023-11-18T23:41:41.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:41.689+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f38940d1500 con 0x7f3894145730 2023-11-18T23:41:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.050+0000 7f388affd640 1 -- 172.21.15.8:0/1658196512 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v54) v1 ==== 147+0+0 (secure 0 0 0) 0x7f388c058700 con 0x7f3894145730 2023-11-18T23:41:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f387406ae70 msgr2=0x7f387406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f387406ae70 0x7f387406d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f387c001930 tx=0x7f387c007000 comp rx=0 tx=0).stop 2023-11-18T23:41:42.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3894145730 msgr2=0x7f3894143160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3894145730 0x7f3894143160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38940cdc30 tx=0x7f388c00f580 comp rx=0 tx=0).stop 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 shutdown_connections 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f387406ae70 0x7f387406d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3894145730 0x7f3894143160 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3894151fd0 0x7f38941451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 --2- 172.21.15.8:0/1658196512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3880003970 0x7f38940cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 >> 172.21.15.8:0/1658196512 conn(0x7f389409c480 msgr2=0x7f38940b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 shutdown_connections 2023-11-18T23:41:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.053+0000 7f3898d0f640 1 -- 172.21.15.8:0/1658196512 wait complete. 2023-11-18T23:41:42.066 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-18T23:41:42.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.176+0000 7f62b14ec640 1 Processor -- start 2023-11-18T23:41:42.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.176+0000 7f62b14ec640 1 -- start start 2023-11-18T23:41:42.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62b14ec640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac09a080 0x7f62ac0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62b14ec640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f62ac06bc50 0x7f62ac06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62b14ec640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac0b3590 con 0x7f62ac0b6b50 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62b14ec640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac06b310 con 0x7f62ac06bc50 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62b14ec640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0cd3a0 con 0x7f62ac09a080 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62aaffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f62ac0b6b50 0x7f62ac099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39422/0 (socket says 172.21.15.8:39422) 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62aaffd640 1 -- 172.21.15.8:0/1055041706 learned_addr learned my addr 172.21.15.8:0/1055041706 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62ab7fe640 1 --2- 172.21.15.8:0/1055041706 >> v2:172.21.15.8:3300/0 conn(0x7f62ac06bc50 0x7f62ac06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62aa7fc640 1 --2- 172.21.15.8:0/1055041706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac09a080 0x7f62ac0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62a9ffb640 1 -- 172.21.15.8:0/1055041706 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838050922 0 0) 0x7f62ac0b3590 con 0x7f62ac0b6b50 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62a9ffb640 1 -- 172.21.15.8:0/1055041706 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6298003520 con 0x7f62ac0b6b50 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62ab7fe640 1 -- 172.21.15.8:0/1055041706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac09a080 msgr2=0x7f62ac0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62ab7fe640 1 --2- 172.21.15.8:0/1055041706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac09a080 0x7f62ac0cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62ab7fe640 1 -- 172.21.15.8:0/1055041706 >> v1:172.21.15.8:6789/0 conn(0x7f62ac0b6b50 legacy=0x7f62ac099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62ab7fe640 1 -- 172.21.15.8:0/1055041706 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0b37c0 con 0x7f62ac06bc50 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.177+0000 7f62aa7fc640 1 --2- 172.21.15.8:0/1055041706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac09a080 0x7f62ac0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.178+0000 7f62ab7fe640 1 --2- 172.21.15.8:0/1055041706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac06bc50 0x7f62ac06c100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f629c009d90 tx=0x7f629c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57423e401f021e9a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.178+0000 7f62a9ffb640 1 -- 172.21.15.8:0/1055041706 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c02cce0 con 0x7f62ac06bc50 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.178+0000 7f62a9ffb640 1 -- 172.21.15.8:0/1055041706 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c02ce40 con 0x7f62ac06bc50 2023-11-18T23:41:42.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.178+0000 7f62a9ffb640 1 -- 172.21.15.8:0/1055041706 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c034660 con 0x7f62ac06bc50 2023-11-18T23:41:42.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 -- 172.21.15.8:0/1055041706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac06bc50 msgr2=0x7f62ac06c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 --2- 172.21.15.8:0/1055041706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac06bc50 0x7f62ac06c100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f629c009d90 tx=0x7f629c02bf30 comp rx=0 tx=0).stop 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 -- 172.21.15.8:0/1055041706 shutdown_connections 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 --2- 172.21.15.8:0/1055041706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac06bc50 0x7f62ac06c100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 --2- 172.21.15.8:0/1055041706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac09a080 0x7f62ac0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 -- 172.21.15.8:0/1055041706 >> 172.21.15.8:0/1055041706 conn(0x7f62ac0b2a70 msgr2=0x7f62ac0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 -- 172.21.15.8:0/1055041706 shutdown_connections 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.179+0000 7f62b14ec640 1 -- 172.21.15.8:0/1055041706 wait complete. 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.180+0000 7f62b14ec640 1 Processor -- start 2023-11-18T23:41:42.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.180+0000 7f62b14ec640 1 -- start start 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62b14ec640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac06bc50 0x7f62ac0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62b14ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62ac09a080 0x7f62ac15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62b14ec640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac0b6b50 0x7f62ac14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62b14ec640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0cb2b0 con 0x7f62ac0b6b50 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62b14ec640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac15da60 con 0x7f62ac09a080 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62b14ec640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac160030 con 0x7f62ac06bc50 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac0b6b50 0x7f62ac14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac0b6b50 0x7f62ac14aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60374/0 (socket says 172.21.15.8:60374) 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 -- 172.21.15.8:0/3988409054 learned_addr learned my addr 172.21.15.8:0/3988409054 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:42.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62aaffd640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac06bc50 0x7f62ac0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62aa7fc640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62ac09a080 0x7f62ac15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 -- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac06bc50 msgr2=0x7f62ac0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac06bc50 0x7f62ac0cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 -- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62ac09a080 msgr2=0x7f62ac15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62ac09a080 0x7f62ac15d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62ab7fe640 1 -- 172.21.15.8:0/3988409054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009a70 con 0x7f62ac0b6b50 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.181+0000 7f62aaffd640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac06bc50 0x7f62ac0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.182+0000 7f62ab7fe640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac0b6b50 0x7f62ac14aad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f629c009eb0 tx=0x7f629c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.182+0000 7f62a37fe640 1 -- 172.21.15.8:0/3988409054 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c03d600 con 0x7f62ac0b6b50 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.182+0000 7f62a37fe640 1 -- 172.21.15.8:0/3988409054 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c03d780 con 0x7f62ac0b6b50 2023-11-18T23:41:42.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.182+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac160310 con 0x7f62ac0b6b50 2023-11-18T23:41:42.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.182+0000 7f62a37fe640 1 -- 172.21.15.8:0/3988409054 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c03db30 con 0x7f62ac0b6b50 2023-11-18T23:41:42.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.182+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac0c64f0 con 0x7f62ac0b6b50 2023-11-18T23:41:42.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.183+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac09ef40 con 0x7f62ac0b6b50 2023-11-18T23:41:42.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.183+0000 7f62a37fe640 1 -- 172.21.15.8:0/3988409054 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f629c03b040 con 0x7f62ac0b6b50 2023-11-18T23:41:42.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.184+0000 7f62a37fe640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f628c06ae70 0x7f628c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.184+0000 7f62a37fe640 1 -- 172.21.15.8:0/3988409054 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f629c0ab890 con 0x7f62ac0b6b50 2023-11-18T23:41:42.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.184+0000 7f62aaffd640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f628c06ae70 0x7f628c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.185+0000 7f62aaffd640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f628c06ae70 0x7f628c06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62a40011e0 tx=0x7f62a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:42.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.189+0000 7f62a37fe640 1 -- 172.21.15.8:0/3988409054 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f629c0768a0 con 0x7f62ac0b6b50 2023-11-18T23:41:42.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.365+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f62ac04e920 con 0x7f62ac0b6b50 2023-11-18T23:41:42.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.368+0000 7f62a37fe640 1 -- 172.21.15.8:0/3988409054 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f629c009450 con 0x7f62ac0b6b50 2023-11-18T23:41:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f628c06ae70 msgr2=0x7f628c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f628c06ae70 0x7f628c06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62a40011e0 tx=0x7f62a4009040 comp rx=0 tx=0).stop 2023-11-18T23:41:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac0b6b50 msgr2=0x7f62ac14aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac0b6b50 0x7f62ac14aad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f629c009eb0 tx=0x7f629c004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 shutdown_connections 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f628c06ae70 0x7f628c06d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62ac0b6b50 0x7f62ac14aad0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62ac09a080 0x7f62ac15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 --2- 172.21.15.8:0/3988409054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62ac06bc50 0x7f62ac0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 >> 172.21.15.8:0/3988409054 conn(0x7f62ac0b2a70 msgr2=0x7f62ac0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 shutdown_connections 2023-11-18T23:41:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.370+0000 7f62b14ec640 1 -- 172.21.15.8:0/3988409054 wait complete. 2023-11-18T23:41:42.382 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-18T23:41:42.382 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T23:41:42.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-18T23:41:42.471 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-18T23:41:42.471 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:41:42.471 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:42.487 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:41:42.487 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:42.542 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:42.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:41:42.636 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:41:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.689+0000 7f391ff1d640 1 Processor -- start 2023-11-18T23:41:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.689+0000 7f391ff1d640 1 -- start start 2023-11-18T23:41:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391ff1d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f391815b440 0x7f391809a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391ff1d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180cf4e0 0x7f39180cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391ff1d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180cfe70 con 0x7f39180ceaf0 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391ff1d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39180ccf30 con 0x7f391815b440 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391ff1d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39180cbac0 con 0x7f39180cf4e0 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391dcb9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f391815b440 0x7f391809a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391dcb9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f391815b440 0x7f391809a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60388/0 (socket says 172.21.15.8:60388) 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.690+0000 7f391dcb9640 1 -- 172.21.15.8:0/2185924066 learned_addr learned my addr 172.21.15.8:0/2185924066 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.691+0000 7f391e4ba640 1 --2- 172.21.15.8:0/2185924066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180cf4e0 0x7f39180cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.691+0000 7f391dcb9640 1 -- 172.21.15.8:0/2185924066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180cf4e0 msgr2=0x7f39180cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.691+0000 7f391dcb9640 1 --2- 172.21.15.8:0/2185924066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180cf4e0 0x7f39180cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.691+0000 7f391dcb9640 1 -- 172.21.15.8:0/2185924066 >> v1:172.21.15.116:6789/0 conn(0x7f39180ceaf0 legacy=0x7f39180cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.691+0000 7f391dcb9640 1 -- 172.21.15.8:0/2185924066 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391809a8c0 con 0x7f391815b440 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.691+0000 7f391dcb9640 1 --2- 172.21.15.8:0/2185924066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f391815b440 0x7f391809a380 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3914009870 tx=0x7f391402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfd4baff4f3b1b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ccb7640 1 -- 172.21.15.8:0/2185924066 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914030840 con 0x7f391815b440 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ccb7640 1 -- 172.21.15.8:0/2185924066 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39140309a0 con 0x7f391815b440 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ccb7640 1 -- 172.21.15.8:0/2185924066 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914030d30 con 0x7f391815b440 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 -- 172.21.15.8:0/2185924066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f391815b440 msgr2=0x7f391809a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 --2- 172.21.15.8:0/2185924066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f391815b440 0x7f391809a380 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3914009870 tx=0x7f391402b980 comp rx=0 tx=0).stop 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 -- 172.21.15.8:0/2185924066 shutdown_connections 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 --2- 172.21.15.8:0/2185924066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180cf4e0 0x7f39180cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 --2- 172.21.15.8:0/2185924066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f391815b440 0x7f391809a380 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 -- 172.21.15.8:0/2185924066 >> 172.21.15.8:0/2185924066 conn(0x7f39180b2a10 msgr2=0x7f39180b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 -- 172.21.15.8:0/2185924066 shutdown_connections 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.692+0000 7f391ff1d640 1 -- 172.21.15.8:0/2185924066 wait complete. 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.693+0000 7f391ff1d640 1 Processor -- start 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391ff1d640 1 -- start start 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391ff1d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180ceaf0 0x7f39180c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391ff1d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39180cf4e0 0x7f39180b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391ff1d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f391815b440 0x7f39180c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391ff1d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918157cd0 con 0x7f39180cf4e0 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391ff1d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180c8530 con 0x7f391815b440 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391ff1d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39180caf90 con 0x7f39180ceaf0 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391d4b8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39180cf4e0 0x7f39180b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391d4b8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39180cf4e0 0x7f39180b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60398/0 (socket says 172.21.15.8:60398) 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.694+0000 7f391d4b8640 1 -- 172.21.15.8:0/1444389842 learned_addr learned my addr 172.21.15.8:0/1444389842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391e4ba640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f391815b440 0x7f39180c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391dcb9640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180ceaf0 0x7f39180c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391d4b8640 1 -- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180ceaf0 msgr2=0x7f39180c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391d4b8640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180ceaf0 0x7f39180c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391d4b8640 1 -- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f391815b440 msgr2=0x7f39180c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391d4b8640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f391815b440 0x7f39180c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391d4b8640 1 -- 172.21.15.8:0/1444389842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140094d0 con 0x7f39180cf4e0 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391dcb9640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180ceaf0 0x7f39180c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391e4ba640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f391815b440 0x7f39180c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391d4b8640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39180cf4e0 0x7f39180b44d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f390800c400 tx=0x7f390800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f390e7fc640 1 -- 172.21.15.8:0/1444389842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080052d0 con 0x7f39180cf4e0 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f390e7fc640 1 -- 172.21.15.8:0/1444389842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908005430 con 0x7f39180cf4e0 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39180cacb0 con 0x7f39180cf4e0 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f390e7fc640 1 -- 172.21.15.8:0/1444389842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908003830 con 0x7f39180cf4e0 2023-11-18T23:41:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.695+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39180b4dc0 con 0x7f39180cf4e0 2023-11-18T23:41:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.696+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3918068470 con 0x7f39180cf4e0 2023-11-18T23:41:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.697+0000 7f390e7fc640 1 -- 172.21.15.8:0/1444389842 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3908003990 con 0x7f39180cf4e0 2023-11-18T23:41:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.697+0000 7f390e7fc640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38fc06ae40 0x7f38fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.697+0000 7f390e7fc640 1 -- 172.21.15.8:0/1444389842 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3908088a00 con 0x7f39180cf4e0 2023-11-18T23:41:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.697+0000 7f391dcb9640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38fc06ae40 0x7f38fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:42.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.698+0000 7f391dcb9640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38fc06ae40 0x7f38fc06d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3914036000 tx=0x7f391403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:42.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.702+0000 7f390e7fc640 1 -- 172.21.15.8:0/1444389842 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3908053a20 con 0x7f39180cf4e0 2023-11-18T23:41:42.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.878+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39180cfe70 con 0x7f39180cf4e0 2023-11-18T23:41:42.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.879+0000 7f390e7fc640 1 -- 172.21.15.8:0/1444389842 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f39180cfe70 con 0x7f39180cf4e0 2023-11-18T23:41:42.881 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:42.881 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:42.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38fc06ae40 msgr2=0x7f38fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38fc06ae40 0x7f38fc06d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3914036000 tx=0x7f391403b040 comp rx=0 tx=0).stop 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39180cf4e0 msgr2=0x7f39180b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39180cf4e0 0x7f39180b44d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f390800c400 tx=0x7f390800c8c0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 shutdown_connections 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38fc06ae40 0x7f38fc06d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f391815b440 0x7f39180c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39180cf4e0 0x7f39180b44d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 --2- 172.21.15.8:0/1444389842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39180ceaf0 0x7f39180c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 >> 172.21.15.8:0/1444389842 conn(0x7f39180b2a10 msgr2=0x7f39180b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:42.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 shutdown_connections 2023-11-18T23:41:42.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:42.881+0000 7f391ff1d640 1 -- 172.21.15.8:0/1444389842 wait complete. 2023-11-18T23:41:42.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:42.894 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:43.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.042+0000 7f32face7640 1 Processor -- start 2023-11-18T23:41:43.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.042+0000 7f32face7640 1 -- start start 2023-11-18T23:41:43.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32face7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406ec60 0x7f32f415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32face7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f409a720 con 0x7f32f415d690 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32face7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f4099b10 con 0x7f32f406e460 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32face7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f415e9d0 con 0x7f32f406ec60 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f3fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f32f415d690 0x7f32f406f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39424/0 (socket says 172.21.15.8:39424) 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f3fff640 1 -- 172.21.15.8:0/1184048005 learned_addr learned my addr 172.21.15.8:0/1184048005 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f8a83640 1 --2- 172.21.15.8:0/1184048005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406ec60 0x7f32f415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f37fe640 1 -- 172.21.15.8:0/1184048005 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581366766 0 0) 0x7f32f409a720 con 0x7f32f415d690 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f37fe640 1 -- 172.21.15.8:0/1184048005 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32dc003520 con 0x7f32f415d690 2023-11-18T23:41:43.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f37fe640 1 -- 172.21.15.8:0/1184048005 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490182305 0 0) 0x7f32f4099b10 con 0x7f32f406e460 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f37fe640 1 -- 172.21.15.8:0/1184048005 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f409a720 con 0x7f32f406e460 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f8a83640 1 -- 172.21.15.8:0/1184048005 >> v1:172.21.15.116:6789/0 conn(0x7f32f406e460 legacy=0x7f32f40cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f8a83640 1 -- 172.21.15.8:0/1184048005 >> v1:172.21.15.8:6789/0 conn(0x7f32f415d690 legacy=0x7f32f406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.043+0000 7f32f8a83640 1 -- 172.21.15.8:0/1184048005 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4099df0 con 0x7f32f406ec60 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.044+0000 7f32f8a83640 1 --2- 172.21.15.8:0/1184048005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406ec60 0x7f32f415e490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097d0 tx=0x7f32e402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=728651fd56ca297f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.044+0000 7f32f37fe640 1 -- 172.21.15.8:0/1184048005 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4031800 con 0x7f32f406ec60 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.044+0000 7f32f37fe640 1 -- 172.21.15.8:0/1184048005 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e4031960 con 0x7f32f406ec60 2023-11-18T23:41:43.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32f37fe640 1 -- 172.21.15.8:0/1184048005 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4031cd0 con 0x7f32f406ec60 2023-11-18T23:41:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32face7640 1 -- 172.21.15.8:0/1184048005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406ec60 msgr2=0x7f32f415e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32face7640 1 --2- 172.21.15.8:0/1184048005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406ec60 0x7f32f415e490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097d0 tx=0x7f32e402b8a0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32face7640 1 -- 172.21.15.8:0/1184048005 shutdown_connections 2023-11-18T23:41:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32face7640 1 --2- 172.21.15.8:0/1184048005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406ec60 0x7f32f415e490 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32face7640 1 -- 172.21.15.8:0/1184048005 >> 172.21.15.8:0/1184048005 conn(0x7f32f40b2a20 msgr2=0x7f32f40b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:43.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32face7640 1 -- 172.21.15.8:0/1184048005 shutdown_connections 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.045+0000 7f32face7640 1 -- 172.21.15.8:0/1184048005 wait complete. 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.046+0000 7f32face7640 1 Processor -- start 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.046+0000 7f32face7640 1 -- start start 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32face7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406e460 0x7f32f40c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32face7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f406ec60 0x7f32f41f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32face7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40c5bc0 0x7f32f415f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32face7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4160060 con 0x7f32f40c5bc0 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32face7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f41f3ff0 con 0x7f32f406ec60 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32face7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f40c6160 con 0x7f32f406e460 2023-11-18T23:41:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32f9284640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40c5bc0 0x7f32f415f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32f9284640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40c5bc0 0x7f32f415f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60406/0 (socket says 172.21.15.8:60406) 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32f9284640 1 -- 172.21.15.8:0/3343215414 learned_addr learned my addr 172.21.15.8:0/3343215414 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32f3fff640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f406ec60 0x7f32f41f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32f8a83640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406e460 0x7f32f40c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32f9284640 1 -- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406e460 msgr2=0x7f32f40c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.047+0000 7f32f9284640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406e460 0x7f32f40c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32f9284640 1 -- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f406ec60 msgr2=0x7f32f41f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32f9284640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f406ec60 0x7f32f41f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32f9284640 1 -- 172.21.15.8:0/3343215414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4009400 con 0x7f32f40c5bc0 2023-11-18T23:41:43.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32f9284640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40c5bc0 0x7f32f415f3a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c7c0 tx=0x7f32ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32f17fa640 1 -- 172.21.15.8:0/3343215414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec003b70 con 0x7f32f40c5bc0 2023-11-18T23:41:43.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32f17fa640 1 -- 172.21.15.8:0/3343215414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec003cd0 con 0x7f32f40c5bc0 2023-11-18T23:41:43.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f40c6440 con 0x7f32f40c5bc0 2023-11-18T23:41:43.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32f17fa640 1 -- 172.21.15.8:0/3343215414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec00aa50 con 0x7f32f40c5bc0 2023-11-18T23:41:43.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.048+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f40c6a00 con 0x7f32f40c5bc0 2023-11-18T23:41:43.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.049+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f409f040 con 0x7f32f40c5bc0 2023-11-18T23:41:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.050+0000 7f32f17fa640 1 -- 172.21.15.8:0/3343215414 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32ec00abb0 con 0x7f32f40c5bc0 2023-11-18T23:41:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.050+0000 7f32f17fa640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f32e006ae40 0x7f32e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.050+0000 7f32f17fa640 1 -- 172.21.15.8:0/3343215414 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32ec0894e0 con 0x7f32f40c5bc0 2023-11-18T23:41:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.050+0000 7f32f8a83640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f32e006ae40 0x7f32e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.051+0000 7f32f8a83640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f32e006ae40 0x7f32e006d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32e4036000 tx=0x7f32e403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.056+0000 7f32f17fa640 1 -- 172.21.15.8:0/3343215414 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32ec054590 con 0x7f32f40c5bc0 2023-11-18T23:41:43.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.230+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32f404e920 con 0x7f32f40c5bc0 2023-11-18T23:41:43.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.231+0000 7f32f17fa640 1 -- 172.21.15.8:0/3343215414 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32ec00ae60 con 0x7f32f40c5bc0 2023-11-18T23:41:43.232 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:43.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f32e006ae40 msgr2=0x7f32e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f32e006ae40 0x7f32e006d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32e4036000 tx=0x7f32e403c040 comp rx=0 tx=0).stop 2023-11-18T23:41:43.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40c5bc0 msgr2=0x7f32f415f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40c5bc0 0x7f32f415f3a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c7c0 tx=0x7f32ec00cc80 comp rx=0 tx=0).stop 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 shutdown_connections 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f32e006ae40 0x7f32e006d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40c5bc0 0x7f32f415f3a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32f406ec60 0x7f32f41f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 --2- 172.21.15.8:0/3343215414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32f406e460 0x7f32f40c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 >> 172.21.15.8:0/3343215414 conn(0x7f32f40b2a20 msgr2=0x7f32f406f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 shutdown_connections 2023-11-18T23:41:43.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.233+0000 7f32face7640 1 -- 172.21.15.8:0/3343215414 wait complete. 2023-11-18T23:41:43.245 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.354+0000 7f3c0dfdc640 1 Processor -- start 2023-11-18T23:41:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.354+0000 7f3c0dfdc640 1 -- start start 2023-11-18T23:41:43.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.354+0000 7f3c0dfdc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c080cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.354+0000 7f3c0dfdc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3c0806bc50 0x7f3c0806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.354+0000 7f3c0dfdc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080b3590 con 0x7f3c080b6b50 2023-11-18T23:41:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.354+0000 7f3c0dfdc640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0806b310 con 0x7f3c0806bc50 2023-11-18T23:41:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.354+0000 7f3c0dfdc640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080cd3a0 con 0x7f3c0809a080 2023-11-18T23:41:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c07fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3c0806bc50 0x7f3c0806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c07fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3c0806bc50 0x7f3c0806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60414/0 (socket says 172.21.15.8:60414) 2023-11-18T23:41:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c07fff640 1 -- 172.21.15.8:0/186918884 learned_addr learned my addr 172.21.15.8:0/186918884 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c06ffd640 1 --2- 172.21.15.8:0/186918884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c080cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c07fff640 1 -- 172.21.15.8:0/186918884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 msgr2=0x7f3c080cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c07fff640 1 --2- 172.21.15.8:0/186918884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c080cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c07fff640 1 -- 172.21.15.8:0/186918884 >> v1:172.21.15.116:6789/0 conn(0x7f3c080b6b50 legacy=0x7f3c08099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.355+0000 7f3c07fff640 1 -- 172.21.15.8:0/186918884 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080b37c0 con 0x7f3c0806bc50 2023-11-18T23:41:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c07fff640 1 --2- 172.21.15.8:0/186918884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0806bc50 0x7f3c0806c100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009e50 tx=0x7f3c0002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2089f41e000997b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c067fc640 1 -- 172.21.15.8:0/186918884 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0002cb00 con 0x7f3c0806bc50 2023-11-18T23:41:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c067fc640 1 -- 172.21.15.8:0/186918884 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0002cc60 con 0x7f3c0806bc50 2023-11-18T23:41:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c067fc640 1 -- 172.21.15.8:0/186918884 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c000343f0 con 0x7f3c0806bc50 2023-11-18T23:41:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/186918884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0806bc50 msgr2=0x7f3c0806c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/186918884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0806bc50 0x7f3c0806c100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009e50 tx=0x7f3c0002bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/186918884 shutdown_connections 2023-11-18T23:41:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/186918884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c0806bc50 0x7f3c0806c100 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/186918884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c080cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/186918884 >> 172.21.15.8:0/186918884 conn(0x7f3c080b2a70 msgr2=0x7f3c080b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/186918884 shutdown_connections 2023-11-18T23:41:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.356+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/186918884 wait complete. 2023-11-18T23:41:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.358+0000 7f3c0dfdc640 1 Processor -- start 2023-11-18T23:41:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.358+0000 7f3c0dfdc640 1 -- start start 2023-11-18T23:41:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c0dfdc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c0806bc50 0x7f3c081f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c0dfdc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c0815f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c0dfdc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c080b6b50 0x7f3c0815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c0dfdc640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0809af50 con 0x7f3c080b6b50 2023-11-18T23:41:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c0dfdc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080c9140 con 0x7f3c0806bc50 2023-11-18T23:41:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c0dfdc640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0815ff00 con 0x7f3c0809a080 2023-11-18T23:41:43.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c080b6b50 0x7f3c0815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c080b6b50 0x7f3c0815c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60428/0 (socket says 172.21.15.8:60428) 2023-11-18T23:41:43.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 -- 172.21.15.8:0/4274956036 learned_addr learned my addr 172.21.15.8:0/4274956036 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:43.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c077fe640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c0806bc50 0x7f3c081f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c06ffd640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c0815f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 -- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 msgr2=0x7f3c0815f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c0815f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 -- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c0806bc50 msgr2=0x7f3c081f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c0806bc50 0x7f3c081f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 -- 172.21.15.8:0/4274956036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009b30 con 0x7f3c080b6b50 2023-11-18T23:41:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c07fff640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c080b6b50 0x7f3c0815c110 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009f70 tx=0x7f3c00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3beffff640 1 -- 172.21.15.8:0/4274956036 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00009510 con 0x7f3c080b6b50 2023-11-18T23:41:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3beffff640 1 -- 172.21.15.8:0/4274956036 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0003e450 con 0x7f3c080b6b50 2023-11-18T23:41:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c081f3870 con 0x7f3c080b6b50 2023-11-18T23:41:43.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.359+0000 7f3beffff640 1 -- 172.21.15.8:0/4274956036 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0003e7e0 con 0x7f3c080b6b50 2023-11-18T23:41:43.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.360+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c081f3e30 con 0x7f3c080b6b50 2023-11-18T23:41:43.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.361+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0809ef40 con 0x7f3c080b6b50 2023-11-18T23:41:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.361+0000 7f3beffff640 1 -- 172.21.15.8:0/4274956036 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c0003e940 con 0x7f3c080b6b50 2023-11-18T23:41:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.361+0000 7f3beffff640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3bf406ae40 0x7f3bf406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.361+0000 7f3beffff640 1 -- 172.21.15.8:0/4274956036 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c000ac300 con 0x7f3c080b6b50 2023-11-18T23:41:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.362+0000 7f3c077fe640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3bf406ae40 0x7f3bf406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.362+0000 7f3c077fe640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3bf406ae40 0x7f3bf406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c081f6490 tx=0x7f3bf8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.366+0000 7f3beffff640 1 -- 172.21.15.8:0/4274956036 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c00077460 con 0x7f3c080b6b50 2023-11-18T23:41:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.541+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c0804e920 con 0x7f3c080b6b50 2023-11-18T23:41:43.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.541+0000 7f3beffff640 1 -- 172.21.15.8:0/4274956036 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c0007aa80 con 0x7f3c080b6b50 2023-11-18T23:41:43.543 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3bf406ae40 msgr2=0x7f3bf406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3bf406ae40 0x7f3bf406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c081f6490 tx=0x7f3bf8009060 comp rx=0 tx=0).stop 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c080b6b50 msgr2=0x7f3c0815c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c080b6b50 0x7f3c0815c110 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009f70 tx=0x7f3c00004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 shutdown_connections 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3bf406ae40 0x7f3bf406d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c080b6b50 0x7f3c0815c110 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c0809a080 0x7f3c0815f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 --2- 172.21.15.8:0/4274956036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c0806bc50 0x7f3c081f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 >> 172.21.15.8:0/4274956036 conn(0x7f3c080b2a70 msgr2=0x7f3c080d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:43.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 shutdown_connections 2023-11-18T23:41:43.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.543+0000 7f3c0dfdc640 1 -- 172.21.15.8:0/4274956036 wait complete. 2023-11-18T23:41:43.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:43.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.664+0000 7fa7a3c1c640 1 Processor -- start 2023-11-18T23:41:43.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.665+0000 7fa7a3c1c640 1 -- start start 2023-11-18T23:41:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.665+0000 7fa7a3c1c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 0x7fa79c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.665+0000 7fa7a3c1c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0ce360 con 0x7fa79c0cef00 2023-11-18T23:41:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.665+0000 7fa7a3c1c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0d19f0 con 0x7fa79c160b70 2023-11-18T23:41:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.665+0000 7fa7a3c1c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0cdd50 con 0x7fa79c0d1570 2023-11-18T23:41:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a21b9640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa79c0cef00 0x7fa79c161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39426/0 (socket says 172.21.15.8:39426) 2023-11-18T23:41:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a21b9640 1 -- 172.21.15.8:0/1486758958 learned_addr learned my addr 172.21.15.8:0/1486758958 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 0x7fa79c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589252041 0 0) 0x7fa79c0ce360 con 0x7fa79c0cef00 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa788003520 con 0x7fa79c0cef00 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720814222 0 0) 0x7fa788003520 con 0x7fa79c0cef00 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 msgr2=0x7fa79c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 0x7fa79c0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 >> v1:172.21.15.116:6789/0 conn(0x7fa79c160b70 legacy=0x7fa79c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0d1c70 con 0x7fa79c0cef00 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fa7940019f0 con 0x7fa79c0cef00 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 >> v1:172.21.15.8:6789/0 conn(0x7fa79c0cef00 legacy=0x7fa79c161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7880039a0 0x7fa788003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa788004350 0x7fa788004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 0x7fa788005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0cdd50 con 0x7fa788004350 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78800b980 con 0x7fa7880039a0 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78800bb40 con 0x7fa79c0d1570 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.666+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa788004350 0x7fa788004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.667+0000 7fa7a21b9640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 0x7fa788005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.667+0000 7fa7a19b8640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7880039a0 0x7fa788003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.667+0000 7fa7a11b7640 1 -- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 msgr2=0x7fa788005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.667+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa79c0d1570 0x7fa788005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.667+0000 7fa7a11b7640 1 -- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7880039a0 msgr2=0x7fa788003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.667+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7880039a0 0x7fa788003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.667+0000 7fa7a11b7640 1 -- 172.21.15.8:0/1486758958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa788003520 con 0x7fa788004350 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa788004350 0x7fa788004820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009ac0 tx=0x7fa7880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbba7d42b2044c1f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c02c6b0 con 0x7fa788004350 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c02c810 con 0x7fa788004350 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a09b6640 1 -- 172.21.15.8:0/1486758958 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c02cba0 con 0x7fa788004350 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1486758958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa788004350 msgr2=0x7fa788004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a3c1c640 1 --2- 172.21.15.8:0/1486758958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa788004350 0x7fa788004820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009ac0 tx=0x7fa7880057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a21b9640 1 -- 172.21.15.8:0/1486758958 reap_dead start 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1486758958 shutdown_connections 2023-11-18T23:41:43.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1486758958 >> 172.21.15.8:0/1486758958 conn(0x7fa79c09c470 msgr2=0x7fa79c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1486758958 shutdown_connections 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.668+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1486758958 wait complete. 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 Processor -- start 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 -- start start 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa788004350 0x7fa79c0b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa79c15a8e0 0x7fa79c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa79c15f190 0x7fa79c09d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b6a00 con 0x7fa79c15a8e0 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b6ce0 con 0x7fa79c15f190 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a3c1c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b6fc0 con 0x7fa788004350 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a11b7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa79c15a8e0 0x7fa79c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a11b7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa79c15a8e0 0x7fa79c15ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60432/0 (socket says 172.21.15.8:60432) 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.670+0000 7fa7a11b7640 1 -- 172.21.15.8:0/1948771329 learned_addr learned my addr 172.21.15.8:0/1948771329 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a19b8640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa788004350 0x7fa79c0b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a21b9640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa79c15f190 0x7fa79c09d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a11b7640 1 -- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa788004350 msgr2=0x7fa79c0b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa788004350 0x7fa79c0b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a11b7640 1 -- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa79c15f190 msgr2=0x7fa79c09d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa79c15f190 0x7fa79c09d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a11b7640 1 -- 172.21.15.8:0/1948771329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0b72a0 con 0x7fa79c15a8e0 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a19b8640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa788004350 0x7fa79c0b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a21b9640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa79c15f190 0x7fa79c09d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a11b7640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa79c15a8e0 0x7fa79c15ec50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa78c037040 tx=0x7fa78c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7927fc640 1 -- 172.21.15.8:0/1948771329 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c003810 con 0x7fa79c15a8e0 2023-11-18T23:41:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7927fc640 1 -- 172.21.15.8:0/1948771329 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c003970 con 0x7fa79c15a8e0 2023-11-18T23:41:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c0b7580 con 0x7fa79c15a8e0 2023-11-18T23:41:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7927fc640 1 -- 172.21.15.8:0/1948771329 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c003d00 con 0x7fa79c15a8e0 2023-11-18T23:41:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.671+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c15ad60 con 0x7fa79c15a8e0 2023-11-18T23:41:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.672+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c0a1150 con 0x7fa79c15a8e0 2023-11-18T23:41:43.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.673+0000 7fa7927fc640 1 -- 172.21.15.8:0/1948771329 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa78c047450 con 0x7fa79c15a8e0 2023-11-18T23:41:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.673+0000 7fa7927fc640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa78006ae70 0x7fa78006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.673+0000 7fa7927fc640 1 -- 172.21.15.8:0/1948771329 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa78c0ab910 con 0x7fa79c15a8e0 2023-11-18T23:41:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.673+0000 7fa7a19b8640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa78006ae70 0x7fa78006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.674+0000 7fa7a19b8640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa78006ae70 0x7fa78006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa798003640 tx=0x7fa798009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.677+0000 7fa7927fc640 1 -- 172.21.15.8:0/1948771329 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa78c076a70 con 0x7fa79c15a8e0 2023-11-18T23:41:43.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.856+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa79c0b22d0 con 0x7fa79c15a8e0 2023-11-18T23:41:43.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.857+0000 7fa7927fc640 1 -- 172.21.15.8:0/1948771329 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa78c003e60 con 0x7fa79c15a8e0 2023-11-18T23:41:43.859 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:43.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa78006ae70 msgr2=0x7fa78006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa78006ae70 0x7fa78006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa798003640 tx=0x7fa798009040 comp rx=0 tx=0).stop 2023-11-18T23:41:43.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa79c15a8e0 msgr2=0x7fa79c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa79c15a8e0 0x7fa79c15ec50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa78c037040 tx=0x7fa78c004730 comp rx=0 tx=0).stop 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 shutdown_connections 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa78006ae70 0x7fa78006d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa79c15f190 0x7fa79c09d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa79c15a8e0 0x7fa79c15ec50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 --2- 172.21.15.8:0/1948771329 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa788004350 0x7fa79c0b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 >> 172.21.15.8:0/1948771329 conn(0x7fa79c09c470 msgr2=0x7fa79c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 shutdown_connections 2023-11-18T23:41:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.859+0000 7fa7a3c1c640 1 -- 172.21.15.8:0/1948771329 wait complete. 2023-11-18T23:41:43.871 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.979+0000 7fb4b6d78640 1 Processor -- start 2023-11-18T23:41:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.979+0000 7fb4b6d78640 1 -- start start 2023-11-18T23:41:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.979+0000 7fb4b6d78640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b01465d0 0x7fb4b00b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.979+0000 7fb4b6d78640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4b006abe0 0x7fb4b0160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.979+0000 7fb4b6d78640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b00721d0 con 0x7fb4b0071d40 2023-11-18T23:41:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.979+0000 7fb4b6d78640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b0161d80 con 0x7fb4b006abe0 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.979+0000 7fb4b6d78640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b01612d0 con 0x7fb4b01465d0 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b5315640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4b006abe0 0x7fb4b0160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b5315640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4b006abe0 0x7fb4b0160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60442/0 (socket says 172.21.15.8:60442) 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b5315640 1 -- 172.21.15.8:0/1138888693 learned_addr learned my addr 172.21.15.8:0/1138888693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4affff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb4b0071d40 0x7fb4b006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39432/0 (socket says 172.21.15.8:39432) 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b4b14640 1 --2- 172.21.15.8:0/1138888693 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b01465d0 0x7fb4b00b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b5315640 1 -- 172.21.15.8:0/1138888693 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b01465d0 msgr2=0x7fb4b00b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b5315640 1 --2- 172.21.15.8:0/1138888693 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b01465d0 0x7fb4b00b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b5315640 1 -- 172.21.15.8:0/1138888693 >> v1:172.21.15.8:6789/0 conn(0x7fb4b0071d40 legacy=0x7fb4b006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.980+0000 7fb4b5315640 1 -- 172.21.15.8:0/1138888693 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b00cf790 con 0x7fb4b006abe0 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b5315640 1 --2- 172.21.15.8:0/1138888693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b0160d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009e50 tx=0x7fb4a802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e73405b07795ff server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4af7fe640 1 -- 172.21.15.8:0/1138888693 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a802cb00 con 0x7fb4b006abe0 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4af7fe640 1 -- 172.21.15.8:0/1138888693 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a802cc60 con 0x7fb4b006abe0 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4af7fe640 1 -- 172.21.15.8:0/1138888693 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80343f0 con 0x7fb4b006abe0 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 -- 172.21.15.8:0/1138888693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 msgr2=0x7fb4b0160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/1138888693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b0160d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009e50 tx=0x7fb4a802bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 -- 172.21.15.8:0/1138888693 shutdown_connections 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/1138888693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b0160d90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/1138888693 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b01465d0 0x7fb4b00b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 -- 172.21.15.8:0/1138888693 >> 172.21.15.8:0/1138888693 conn(0x7fb4b00cc930 msgr2=0x7fb4b00ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 -- 172.21.15.8:0/1138888693 shutdown_connections 2023-11-18T23:41:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.981+0000 7fb4b6d78640 1 -- 172.21.15.8:0/1138888693 wait complete. 2023-11-18T23:41:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.983+0000 7fb4b6d78640 1 Processor -- start 2023-11-18T23:41:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.983+0000 7fb4b6d78640 1 -- start start 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b6d78640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b6d78640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b0071d40 0x7fb4b00ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b6d78640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4b01465d0 0x7fb4b00aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b6d78640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00b1a50 con 0x7fb4b006abe0 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b6d78640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00b29b0 con 0x7fb4b01465d0 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b6d78640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00b0dd0 con 0x7fb4b0071d40 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b00b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60448/0 (socket says 172.21.15.8:60448) 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 -- 172.21.15.8:0/3332313338 learned_addr learned my addr 172.21.15.8:0/3332313338 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4affff640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b0071d40 0x7fb4b00ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b5315640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4b01465d0 0x7fb4b00aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 -- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b0071d40 msgr2=0x7fb4b00ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b0071d40 0x7fb4b00ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 -- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4b01465d0 msgr2=0x7fb4b00aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4b01465d0 0x7fb4b00aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 -- 172.21.15.8:0/3332313338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8009b30 con 0x7fb4b006abe0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b4b14640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b00b2470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400d5f0 tx=0x7fb4a400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4ad7fa640 1 -- 172.21.15.8:0/3332313338 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a40125f0 con 0x7fb4b006abe0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4ad7fa640 1 -- 172.21.15.8:0/3332313338 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4012750 con 0x7fb4b006abe0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b00b10b0 con 0x7fb4b006abe0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.984+0000 7fb4ad7fa640 1 -- 172.21.15.8:0/3332313338 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4012b00 con 0x7fb4b006abe0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.985+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b00b1670 con 0x7fb4b006abe0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.985+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b015b010 con 0x7fb4b006abe0 2023-11-18T23:41:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.986+0000 7fb4ad7fa640 1 -- 172.21.15.8:0/3332313338 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4a4012c60 con 0x7fb4b006abe0 2023-11-18T23:41:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.986+0000 7fb4ad7fa640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49406ae40 0x7fb49406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.986+0000 7fb4ad7fa640 1 -- 172.21.15.8:0/3332313338 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4a40898c0 con 0x7fb4b006abe0 2023-11-18T23:41:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.986+0000 7fb4affff640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49406ae40 0x7fb49406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.987+0000 7fb4affff640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49406ae40 0x7fb49406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00b2190 tx=0x7fb49c000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:43.991+0000 7fb4ad7fa640 1 -- 172.21.15.8:0/3332313338 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4a4054ab0 con 0x7fb4b006abe0 2023-11-18T23:41:44.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.183+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4b006e6a0 con 0x7fb4b006abe0 2023-11-18T23:41:44.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.183+0000 7fb4ad7fa640 1 -- 172.21.15.8:0/3332313338 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb4a40580d0 con 0x7fb4b006abe0 2023-11-18T23:41:44.185 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49406ae40 msgr2=0x7fb49406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49406ae40 0x7fb49406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00b2190 tx=0x7fb49c000ed0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 msgr2=0x7fb4b00b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b00b2470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400d5f0 tx=0x7fb4a400dab0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 shutdown_connections 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb49406ae40 0x7fb49406d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4b01465d0 0x7fb4b00aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb4b0071d40 0x7fb4b00ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 --2- 172.21.15.8:0/3332313338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4b006abe0 0x7fb4b00b2470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 >> 172.21.15.8:0/3332313338 conn(0x7fb4b00cc930 msgr2=0x7fb4b006a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 shutdown_connections 2023-11-18T23:41:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.185+0000 7fb4b6d78640 1 -- 172.21.15.8:0/3332313338 wait complete. 2023-11-18T23:41:44.197 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:41:44.197 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:44.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:44.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.357+0000 7f187126f640 1 Processor -- start 2023-11-18T23:41:44.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.357+0000 7f187126f640 1 -- start start 2023-11-18T23:41:44.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.358+0000 7f187126f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f186c15e1c0 0x7f186c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.358+0000 7f187126f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f186c0b3fa0 0x7f186c0d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.358+0000 7f187126f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c161e60 con 0x7f186c15e5a0 2023-11-18T23:41:44.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.358+0000 7f187126f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c15dd50 con 0x7f186c15e1c0 2023-11-18T23:41:44.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.358+0000 7f187126f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0b2fc0 con 0x7f186c0b3fa0 2023-11-18T23:41:44.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.358+0000 7f186b7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f186c15e5a0 0x7f186c0d2f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39436/0 (socket says 172.21.15.8:39436) 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.358+0000 7f186b7fe640 1 -- 172.21.15.8:0/3181979196 learned_addr learned my addr 172.21.15.8:0/3181979196 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f186affd640 1 --2- 172.21.15.8:0/3181979196 >> v2:172.21.15.116:3300/0 conn(0x7f186c15e1c0 0x7f186c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f186c0b3fa0 0x7f186c0d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968356243 0 0) 0x7f186c161e60 con 0x7f186c15e5a0 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1858003520 con 0x7f186c15e5a0 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953608359 0 0) 0x7f1858003520 con 0x7f186c15e5a0 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f186c0b3fa0 msgr2=0x7f186c0d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f186c0b3fa0 0x7f186c0d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 >> v2:172.21.15.116:3300/0 conn(0x7f186c15e1c0 msgr2=0x7f186c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 --2- 172.21.15.8:0/3181979196 >> v2:172.21.15.116:3300/0 conn(0x7f186c15e1c0 0x7f186c0b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c161b80 con 0x7f186c15e5a0 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f185c0019f0 con 0x7f186c15e5a0 2023-11-18T23:41:44.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 >> v1:172.21.15.8:6789/0 conn(0x7f186c15e5a0 legacy=0x7f186c0d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1858003970 0x7f1858003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18580047c0 0x7f1858004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1858005180 0x7f185800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c15dd50 con 0x7f18580047c0 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0b2fc0 con 0x7f1858003970 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1858005670 con 0x7f1858005180 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18580047c0 0x7f1858004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f186b7fe640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1858005180 0x7f185800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.359+0000 7f186affd640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1858003970 0x7f1858003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f186a7fc640 1 -- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1858005180 msgr2=0x7f185800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1858005180 0x7f185800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f186a7fc640 1 -- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1858003970 msgr2=0x7f1858003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:44.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1858003970 0x7f1858003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f186a7fc640 1 -- 172.21.15.8:0/3181979196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858003520 con 0x7f18580047c0 2023-11-18T23:41:44.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18580047c0 0x7f1858004c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1854009a90 tx=0x7f18580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e6ef7c394ffeb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185402c680 con 0x7f18580047c0 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185402c7e0 con 0x7f18580047c0 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.360+0000 7f1869ffb640 1 -- 172.21.15.8:0/3181979196 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185402cb90 con 0x7f18580047c0 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.361+0000 7f187126f640 1 -- 172.21.15.8:0/3181979196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18580047c0 msgr2=0x7f1858004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.361+0000 7f187126f640 1 --2- 172.21.15.8:0/3181979196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18580047c0 0x7f1858004c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1854009a90 tx=0x7f18580057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.361+0000 7f186b7fe640 1 -- 172.21.15.8:0/3181979196 reap_dead start 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.361+0000 7f187126f640 1 -- 172.21.15.8:0/3181979196 shutdown_connections 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.361+0000 7f187126f640 1 -- 172.21.15.8:0/3181979196 >> 172.21.15.8:0/3181979196 conn(0x7f186c08cbc0 msgr2=0x7f186c09c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.361+0000 7f187126f640 1 -- 172.21.15.8:0/3181979196 shutdown_connections 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.361+0000 7f187126f640 1 -- 172.21.15.8:0/3181979196 wait complete. 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.362+0000 7f187126f640 1 Processor -- start 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f187126f640 1 -- start start 2023-11-18T23:41:44.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f187126f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18580047c0 0x7f186c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f187126f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f186c0cf550 0x7f186c14d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f187126f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f186c0b0e90 0x7f186c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f187126f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0b1880 con 0x7f186c0cf550 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f187126f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0c95f0 con 0x7f186c0b0e90 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f187126f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0c74a0 con 0x7f18580047c0 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f186a7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f186c0cf550 0x7f186c14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f186a7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f186c0cf550 0x7f186c14d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60472/0 (socket says 172.21.15.8:60472) 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f186a7fc640 1 -- 172.21.15.8:0/3268014049 learned_addr learned my addr 172.21.15.8:0/3268014049 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f186affd640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18580047c0 0x7f186c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.363+0000 7f186b7fe640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f186c0b0e90 0x7f186c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f186a7fc640 1 -- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18580047c0 msgr2=0x7f186c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18580047c0 0x7f186c157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f186a7fc640 1 -- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f186c0b0e90 msgr2=0x7f186c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f186c0b0e90 0x7f186c0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f186a7fc640 1 -- 172.21.15.8:0/3268014049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0c6ee0 con 0x7f186c0cf550 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f186a7fc640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f186c0cf550 0x7f186c14d500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1854037040 tx=0x7f1854004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f18637fe640 1 -- 172.21.15.8:0/3268014049 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854040860 con 0x7f186c0cf550 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f18637fe640 1 -- 172.21.15.8:0/3268014049 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18540409c0 con 0x7f186c0cf550 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c0c71c0 con 0x7f186c0cf550 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f18637fe640 1 -- 172.21.15.8:0/3268014049 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854040d50 con 0x7f186c0cf550 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.364+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0cf9b0 con 0x7f186c0cf550 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.365+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c0c9450 con 0x7f186c0cf550 2023-11-18T23:41:44.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.366+0000 7f18637fe640 1 -- 172.21.15.8:0/3268014049 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1854034440 con 0x7f186c0cf550 2023-11-18T23:41:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.366+0000 7f18637fe640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f184c06ae40 0x7f184c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.366+0000 7f18637fe640 1 -- 172.21.15.8:0/3268014049 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18540ab630 con 0x7f186c0cf550 2023-11-18T23:41:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.366+0000 7f186affd640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f184c06ae40 0x7f184c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.367+0000 7f186affd640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f184c06ae40 0x7f184c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1864009bc0 tx=0x7f1864009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.370+0000 7f18637fe640 1 -- 172.21.15.8:0/3268014049 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f186c0c9450 con 0x7f186c0cf550 2023-11-18T23:41:44.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.547+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f186c0c9450 con 0x7f186c0cf550 2023-11-18T23:41:44.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.548+0000 7f18637fe640 1 -- 172.21.15.8:0/3268014049 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f186c0c9450 con 0x7f186c0cf550 2023-11-18T23:41:44.549 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:44.549 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f184c06ae40 msgr2=0x7f184c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f184c06ae40 0x7f184c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1864009bc0 tx=0x7f1864009190 comp rx=0 tx=0).stop 2023-11-18T23:41:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f186c0cf550 msgr2=0x7f186c14d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f186c0cf550 0x7f186c14d500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1854037040 tx=0x7f1854004730 comp rx=0 tx=0).stop 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 shutdown_connections 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f184c06ae40 0x7f184c06d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f186c0b0e90 0x7f186c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f186c0cf550 0x7f186c14d500 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 --2- 172.21.15.8:0/3268014049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18580047c0 0x7f186c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 >> 172.21.15.8:0/3268014049 conn(0x7f186c08cbc0 msgr2=0x7f186c1612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 shutdown_connections 2023-11-18T23:41:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.550+0000 7f187126f640 1 -- 172.21.15.8:0/3268014049 wait complete. 2023-11-18T23:41:44.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:44.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:44.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.670+0000 7fd8b13c0640 1 Processor -- start 2023-11-18T23:41:44.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.671+0000 7fd8b13c0640 1 -- start start 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.671+0000 7fd8b13c0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8ac06efd0 0x7fd8ac0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.671+0000 7fd8b13c0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd8ac161540 0x7fd8ac06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.671+0000 7fd8b13c0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0b3aa0 con 0x7fd8ac0b3610 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.671+0000 7fd8b13c0640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b3d80 con 0x7fd8ac06efd0 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.671+0000 7fd8b13c0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b4060 con 0x7fd8ac161540 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.671+0000 7fd8aaffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8ac06efd0 0x7fd8ac0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.672+0000 7fd8aaffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8ac06efd0 0x7fd8ac0ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60482/0 (socket says 172.21.15.8:60482) 2023-11-18T23:41:44.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.672+0000 7fd8aaffd640 1 -- 172.21.15.8:0/1172662544 learned_addr learned my addr 172.21.15.8:0/1172662544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:44.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.672+0000 7fd8ab7fe640 1 --2- 172.21.15.8:0/1172662544 >> v2:172.21.15.116:3300/0 conn(0x7fd8ac161540 0x7fd8ac06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.672+0000 7fd8aaffd640 1 -- 172.21.15.8:0/1172662544 >> v2:172.21.15.116:3300/0 conn(0x7fd8ac161540 msgr2=0x7fd8ac06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:44.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.672+0000 7fd8aaffd640 1 --2- 172.21.15.8:0/1172662544 >> v2:172.21.15.116:3300/0 conn(0x7fd8ac161540 0x7fd8ac06a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.672+0000 7fd8aaffd640 1 -- 172.21.15.8:0/1172662544 >> v1:172.21.15.116:6789/0 conn(0x7fd8ac0b3610 legacy=0x7fd8ac160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.672+0000 7fd8aaffd640 1 -- 172.21.15.8:0/1172662544 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0b4340 con 0x7fd8ac06efd0 2023-11-18T23:41:44.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8aaffd640 1 --2- 172.21.15.8:0/1172662544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac0ad690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0ae780 tx=0x7fd8a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a08e2451268276 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8a9ffb640 1 -- 172.21.15.8:0/1172662544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4031870 con 0x7fd8ac06efd0 2023-11-18T23:41:44.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8a9ffb640 1 -- 172.21.15.8:0/1172662544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a40319d0 con 0x7fd8ac06efd0 2023-11-18T23:41:44.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8a9ffb640 1 -- 172.21.15.8:0/1172662544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4031d60 con 0x7fd8ac06efd0 2023-11-18T23:41:44.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1172662544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac06efd0 msgr2=0x7fd8ac0ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1172662544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac0ad690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0ae780 tx=0x7fd8a402b910 comp rx=0 tx=0).stop 2023-11-18T23:41:44.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1172662544 shutdown_connections 2023-11-18T23:41:44.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1172662544 >> v2:172.21.15.116:3300/0 conn(0x7fd8ac161540 0x7fd8ac06a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1172662544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac0ad690 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1172662544 >> 172.21.15.8:0/1172662544 conn(0x7fd8ac0b1670 msgr2=0x7fd8ac0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:44.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1172662544 shutdown_connections 2023-11-18T23:41:44.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.673+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1172662544 wait complete. 2023-11-18T23:41:44.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 Processor -- start 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 -- start start 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac1460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac161540 0x7fd8ac1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8ac150120 0x7fd8ac158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0afa70 con 0x7fd8ac161540 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac15ac10 con 0x7fd8ac06efd0 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8b13c0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac15aef0 con 0x7fd8ac150120 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.675+0000 7fd8aa7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac161540 0x7fd8ac1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac161540 0x7fd8ac1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60492/0 (socket says 172.21.15.8:60492) 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 -- 172.21.15.8:0/1780508987 learned_addr learned my addr 172.21.15.8:0/1780508987 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:44.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8ab7fe640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8ac150120 0x7fd8ac158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aaffd640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac1460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 -- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8ac150120 msgr2=0x7fd8ac158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8ac150120 0x7fd8ac158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 -- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8ac06efd0 msgr2=0x7fd8ac1460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac1460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 -- 172.21.15.8:0/1780508987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40094d0 con 0x7fd8ac161540 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aaffd640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac1460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8aa7fc640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac161540 0x7fd8ac1585f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c400 tx=0x7fd89400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8a37fe640 1 -- 172.21.15.8:0/1780508987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940052d0 con 0x7fd8ac161540 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8a37fe640 1 -- 172.21.15.8:0/1780508987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894005430 con 0x7fd8ac161540 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8a37fe640 1 -- 172.21.15.8:0/1780508987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894003830 con 0x7fd8ac161540 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac0b4cc0 con 0x7fd8ac161540 2023-11-18T23:41:44.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.676+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac0af700 con 0x7fd8ac161540 2023-11-18T23:41:44.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.677+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac0afbb0 con 0x7fd8ac161540 2023-11-18T23:41:44.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.678+0000 7fd8a37fe640 1 -- 172.21.15.8:0/1780508987 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd894003990 con 0x7fd8ac161540 2023-11-18T23:41:44.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.678+0000 7fd8a37fe640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd88c06ae40 0x7fd88c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.678+0000 7fd8a37fe640 1 -- 172.21.15.8:0/1780508987 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd894088cc0 con 0x7fd8ac161540 2023-11-18T23:41:44.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.678+0000 7fd8aaffd640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd88c06ae40 0x7fd88c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.679+0000 7fd8aaffd640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd88c06ae40 0x7fd88c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4036000 tx=0x7fd8a403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.683+0000 7fd8a37fe640 1 -- 172.21.15.8:0/1780508987 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8ac0afbb0 con 0x7fd8ac161540 2023-11-18T23:41:44.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.858+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8ac0afbb0 con 0x7fd8ac161540 2023-11-18T23:41:44.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.859+0000 7fd8a37fe640 1 -- 172.21.15.8:0/1780508987 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8ac0afbb0 con 0x7fd8ac161540 2023-11-18T23:41:44.860 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd88c06ae40 msgr2=0x7fd88c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd88c06ae40 0x7fd88c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4036000 tx=0x7fd8a403c040 comp rx=0 tx=0).stop 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac161540 msgr2=0x7fd8ac1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac161540 0x7fd8ac1585f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c400 tx=0x7fd89400c8c0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 shutdown_connections 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd88c06ae40 0x7fd88c06d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8ac150120 0x7fd8ac158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8ac161540 0x7fd8ac1585f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 --2- 172.21.15.8:0/1780508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8ac06efd0 0x7fd8ac1460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 >> 172.21.15.8:0/1780508987 conn(0x7fd8ac0b1670 msgr2=0x7fd8ac0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 shutdown_connections 2023-11-18T23:41:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.861+0000 7fd8b13c0640 1 -- 172.21.15.8:0/1780508987 wait complete. 2023-11-18T23:41:44.873 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:44.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.981+0000 7f5927505640 1 Processor -- start 2023-11-18T23:41:44.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.981+0000 7f5927505640 1 -- start start 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5927505640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5920144310 0x7f5920144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5927505640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f59200ce7e0 0x7f59200b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5927505640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59201446f0 con 0x7f592006c890 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5927505640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200b3980 con 0x7f59200ce7e0 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5927505640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592015ba80 con 0x7f5920144310 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5924aa0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f59200ce7e0 0x7f59200b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5924aa0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f59200ce7e0 0x7f59200b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60496/0 (socket says 172.21.15.8:60496) 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f5924aa0640 1 -- 172.21.15.8:0/2534159905 learned_addr learned my addr 172.21.15.8:0/2534159905 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:44.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.982+0000 7f59252a1640 1 --2- 172.21.15.8:0/2534159905 >> v2:172.21.15.116:3300/0 conn(0x7f5920144310 0x7f5920144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.983+0000 7f5924aa0640 1 -- 172.21.15.8:0/2534159905 >> v2:172.21.15.116:3300/0 conn(0x7f5920144310 msgr2=0x7f5920144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.983+0000 7f5924aa0640 1 --2- 172.21.15.8:0/2534159905 >> v2:172.21.15.116:3300/0 conn(0x7f5920144310 0x7f5920144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.983+0000 7f5924aa0640 1 -- 172.21.15.8:0/2534159905 >> v1:172.21.15.116:6789/0 conn(0x7f592006c890 legacy=0x7f592015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.983+0000 7f5924aa0640 1 -- 172.21.15.8:0/2534159905 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592015bd60 con 0x7f59200ce7e0 2023-11-18T23:41:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.983+0000 7f5924aa0640 1 --2- 172.21.15.8:0/2534159905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59200ce7e0 0x7f59200b3440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f592006e3f0 tx=0x7f591402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dea3c9182d9445 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.983+0000 7f591ffff640 1 -- 172.21.15.8:0/2534159905 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914030860 con 0x7f59200ce7e0 2023-11-18T23:41:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.983+0000 7f591ffff640 1 -- 172.21.15.8:0/2534159905 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59140309c0 con 0x7f59200ce7e0 2023-11-18T23:41:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f591ffff640 1 -- 172.21.15.8:0/2534159905 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914030d50 con 0x7f59200ce7e0 2023-11-18T23:41:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 -- 172.21.15.8:0/2534159905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59200ce7e0 msgr2=0x7f59200b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 --2- 172.21.15.8:0/2534159905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59200ce7e0 0x7f59200b3440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f592006e3f0 tx=0x7f591402b9a0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 -- 172.21.15.8:0/2534159905 shutdown_connections 2023-11-18T23:41:44.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 --2- 172.21.15.8:0/2534159905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59200ce7e0 0x7f59200b3440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 --2- 172.21.15.8:0/2534159905 >> v2:172.21.15.116:3300/0 conn(0x7f5920144310 0x7f5920144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 -- 172.21.15.8:0/2534159905 >> 172.21.15.8:0/2534159905 conn(0x7f592006a8f0 msgr2=0x7f592006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:44.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 -- 172.21.15.8:0/2534159905 shutdown_connections 2023-11-18T23:41:44.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.984+0000 7f5927505640 1 -- 172.21.15.8:0/2534159905 wait complete. 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.985+0000 7f5927505640 1 Processor -- start 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.985+0000 7f5927505640 1 -- start start 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5927505640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f592006c890 0x7f59201376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5927505640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59200ce7e0 0x7f59201f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5927505640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5920144310 0x7f59200aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5927505640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920137bf0 con 0x7f5920144310 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5927505640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59201f1670 con 0x7f592006c890 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5927505640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59201f1950 con 0x7f59200ce7e0 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5925aa2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5920144310 0x7f59200aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5925aa2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5920144310 0x7f59200aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60502/0 (socket says 172.21.15.8:60502) 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.986+0000 7f5925aa2640 1 -- 172.21.15.8:0/620180131 learned_addr learned my addr 172.21.15.8:0/620180131 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5924aa0640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59200ce7e0 0x7f59201f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f59252a1640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f592006c890 0x7f59201376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5925aa2640 1 -- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59200ce7e0 msgr2=0x7f59201f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5925aa2640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59200ce7e0 0x7f59201f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5925aa2640 1 -- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f592006c890 msgr2=0x7f59201376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5925aa2640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f592006c890 0x7f59201376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5925aa2640 1 -- 172.21.15.8:0/620180131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140094d0 con 0x7f5920144310 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5925aa2640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5920144310 0x7f59200aedf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5910001eb0 tx=0x7f591000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f591dffb640 1 -- 172.21.15.8:0/620180131 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100052d0 con 0x7f5920144310 2023-11-18T23:41:44.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f591dffb640 1 -- 172.21.15.8:0/620180131 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910005430 con 0x7f5920144310 2023-11-18T23:41:44.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59201f1c30 con 0x7f5920144310 2023-11-18T23:41:44.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f591dffb640 1 -- 172.21.15.8:0/620180131 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910003810 con 0x7f5920144310 2023-11-18T23:41:44.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.987+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592013f8f0 con 0x7f5920144310 2023-11-18T23:41:44.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.988+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5920072ae0 con 0x7f5920144310 2023-11-18T23:41:44.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.988+0000 7f591dffb640 1 -- 172.21.15.8:0/620180131 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5910003970 con 0x7f5920144310 2023-11-18T23:41:44.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.989+0000 7f591dffb640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f590c06ae40 0x7f590c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:44.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.989+0000 7f591dffb640 1 -- 172.21.15.8:0/620180131 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5910088bf0 con 0x7f5920144310 2023-11-18T23:41:44.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.989+0000 7f59252a1640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f590c06ae40 0x7f590c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:44.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.990+0000 7f59252a1640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f590c06ae40 0x7f590c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f592013add0 tx=0x7f591800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:44.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:44.993+0000 7f591dffb640 1 -- 172.21.15.8:0/620180131 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5910053c90 con 0x7f5920144310 2023-11-18T23:41:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.172+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f592004e920 con 0x7f5920144310 2023-11-18T23:41:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.173+0000 7f591dffb640 1 -- 172.21.15.8:0/620180131 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5910017020 con 0x7f5920144310 2023-11-18T23:41:45.174 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f590c06ae40 msgr2=0x7f590c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f590c06ae40 0x7f590c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f592013add0 tx=0x7f591800b040 comp rx=0 tx=0).stop 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5920144310 msgr2=0x7f59200aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5920144310 0x7f59200aedf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5910001eb0 tx=0x7f591000c890 comp rx=0 tx=0).stop 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 shutdown_connections 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f590c06ae40 0x7f590c06d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5920144310 0x7f59200aedf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59200ce7e0 0x7f59201f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 --2- 172.21.15.8:0/620180131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f592006c890 0x7f59201376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 >> 172.21.15.8:0/620180131 conn(0x7f592006a8f0 msgr2=0x7f592006ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 shutdown_connections 2023-11-18T23:41:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.175+0000 7f5927505640 1 -- 172.21.15.8:0/620180131 wait complete. 2023-11-18T23:41:45.187 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:45.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.295+0000 7f626862d640 1 Processor -- start 2023-11-18T23:41:45.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.295+0000 7f626862d640 1 -- start start 2023-11-18T23:41:45.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f626862d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626015b0d0 0x7f62600cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f626862d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6260070630 0x7f6260070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f626862d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626015b530 con 0x7f626013f750 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f626862d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600cec70 con 0x7f6260070630 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f626862d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600ce060 con 0x7f626015b0d0 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f6266bca640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6260070630 0x7f6260070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f62663c9640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f626013f750 0x7f626013fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39440/0 (socket says 172.21.15.8:39440) 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f62663c9640 1 -- 172.21.15.8:0/1113249691 learned_addr learned my addr 172.21.15.8:0/1113249691 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f6265bc8640 1 --2- 172.21.15.8:0/1113249691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626015b0d0 0x7f62600cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f6266bca640 1 -- 172.21.15.8:0/1113249691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626015b0d0 msgr2=0x7f62600cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f6266bca640 1 --2- 172.21.15.8:0/1113249691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626015b0d0 0x7f62600cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f6266bca640 1 -- 172.21.15.8:0/1113249691 >> v1:172.21.15.8:6789/0 conn(0x7f626013f750 legacy=0x7f626013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.296+0000 7f6266bca640 1 -- 172.21.15.8:0/1113249691 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600ce340 con 0x7f6260070630 2023-11-18T23:41:45.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.297+0000 7f6266bca640 1 --2- 172.21.15.8:0/1113249691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f6260070ac0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6258009d90 tx=0x7f625802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a280c2f0de537f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.297+0000 7f62653c7640 1 -- 172.21.15.8:0/1113249691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625802cc50 con 0x7f6260070630 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.297+0000 7f62653c7640 1 -- 172.21.15.8:0/1113249691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625802cdb0 con 0x7f6260070630 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.297+0000 7f62653c7640 1 -- 172.21.15.8:0/1113249691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258034660 con 0x7f6260070630 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 -- 172.21.15.8:0/1113249691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 msgr2=0x7f6260070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 --2- 172.21.15.8:0/1113249691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f6260070ac0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6258009d90 tx=0x7f625802bea0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 -- 172.21.15.8:0/1113249691 shutdown_connections 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 --2- 172.21.15.8:0/1113249691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f6260070ac0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 --2- 172.21.15.8:0/1113249691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626015b0d0 0x7f62600cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 -- 172.21.15.8:0/1113249691 >> 172.21.15.8:0/1113249691 conn(0x7f626006a8f0 msgr2=0x7f626006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 -- 172.21.15.8:0/1113249691 shutdown_connections 2023-11-18T23:41:45.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.298+0000 7f626862d640 1 -- 172.21.15.8:0/1113249691 wait complete. 2023-11-18T23:41:45.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.299+0000 7f626862d640 1 Processor -- start 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.299+0000 7f626862d640 1 -- start start 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f626862d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f626013bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f626862d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626013f750 0x7f62600ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f626862d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f626015b0d0 0x7f62600addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f626862d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6260157890 con 0x7f6260070630 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f626862d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6260156c90 con 0x7f626015b0d0 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f626862d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626013c530 con 0x7f626013f750 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f626013bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f626013bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60518/0 (socket says 172.21.15.8:60518) 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 -- 172.21.15.8:0/1874971575 learned_addr learned my addr 172.21.15.8:0/1874971575 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:45.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f6266bca640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f626015b0d0 0x7f62600addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f6265bc8640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626013f750 0x7f62600ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 -- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626013f750 msgr2=0x7f62600ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626013f750 0x7f62600ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 -- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f626015b0d0 msgr2=0x7f62600addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f626015b0d0 0x7f62600addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 -- 172.21.15.8:0/1874971575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009a70 con 0x7f6260070630 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.300+0000 7f62663c9640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f626013bff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f625c00e710 tx=0x7f625c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.301+0000 7f6256ffd640 1 -- 172.21.15.8:0/1874971575 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c005ce0 con 0x7f6260070630 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.301+0000 7f6256ffd640 1 -- 172.21.15.8:0/1874971575 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c005e40 con 0x7f6260070630 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.301+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6260156ef0 con 0x7f6260070630 2023-11-18T23:41:45.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.301+0000 7f6256ffd640 1 -- 172.21.15.8:0/1874971575 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c001920 con 0x7f6260070630 2023-11-18T23:41:45.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.301+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62601574b0 con 0x7f6260070630 2023-11-18T23:41:45.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.302+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6260072ae0 con 0x7f6260070630 2023-11-18T23:41:45.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.302+0000 7f6256ffd640 1 -- 172.21.15.8:0/1874971575 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f625c001b40 con 0x7f6260070630 2023-11-18T23:41:45.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.303+0000 7f6256ffd640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f624406ae40 0x7f624406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.303+0000 7f6256ffd640 1 -- 172.21.15.8:0/1874971575 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f625c08bd10 con 0x7f6260070630 2023-11-18T23:41:45.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.303+0000 7f6265bc8640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f624406ae40 0x7f624406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.303+0000 7f6265bc8640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f624406ae40 0x7f624406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f626015abc0 tx=0x7f6250008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:45.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.307+0000 7f6256ffd640 1 -- 172.21.15.8:0/1874971575 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f625c056dd0 con 0x7f6260070630 2023-11-18T23:41:45.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.481+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62600ccaa0 con 0x7f6260070630 2023-11-18T23:41:45.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.482+0000 7f6256ffd640 1 -- 172.21.15.8:0/1874971575 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f625c01f020 con 0x7f6260070630 2023-11-18T23:41:45.484 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f624406ae40 msgr2=0x7f624406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f624406ae40 0x7f624406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f626015abc0 tx=0x7f6250008040 comp rx=0 tx=0).stop 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 msgr2=0x7f626013bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f626013bff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f625c00e710 tx=0x7f625c00ebd0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 shutdown_connections 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f624406ae40 0x7f624406d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f626015b0d0 0x7f62600addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f626013f750 0x7f62600ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 --2- 172.21.15.8:0/1874971575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6260070630 0x7f626013bff0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 >> 172.21.15.8:0/1874971575 conn(0x7f626006a8f0 msgr2=0x7f626013ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 shutdown_connections 2023-11-18T23:41:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.484+0000 7f626862d640 1 -- 172.21.15.8:0/1874971575 wait complete. 2023-11-18T23:41:45.496 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:45.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.603+0000 7f39435f5640 1 Processor -- start 2023-11-18T23:41:45.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.603+0000 7f39435f5640 1 -- start start 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f39435f5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f393c09a080 0x7f393c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f39435f5640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c0b3590 con 0x7f393c0b6b50 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f39435f5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c06b310 con 0x7f393c06bc50 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f39435f5640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c0cd3a0 con 0x7f393c09a080 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3941391640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f393c0b6b50 0x7f393c099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39450/0 (socket says 172.21.15.8:39450) 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3941391640 1 -- 172.21.15.8:0/177968836 learned_addr learned my addr 172.21.15.8:0/177968836 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3940b90640 1 --2- 172.21.15.8:0/177968836 >> v2:172.21.15.116:3300/0 conn(0x7f393c09a080 0x7f393c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660544904 0 0) 0x7f393c0b3590 con 0x7f393c0b6b50 2023-11-18T23:41:45.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3928003520 con 0x7f393c0b6b50 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438506538 0 0) 0x7f3928003520 con 0x7f393c0b6b50 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 >> v2:172.21.15.116:3300/0 conn(0x7f393c09a080 msgr2=0x7f393c0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 --2- 172.21.15.8:0/177968836 >> v2:172.21.15.116:3300/0 conn(0x7f393c09a080 0x7f393c0cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 >> v1:172.21.15.116:6789/0 conn(0x7f393c06bc50 legacy=0x7f393c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0b37c0 con 0x7f393c0b6b50 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f3938001670 con 0x7f393c0b6b50 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 >> v1:172.21.15.8:6789/0 conn(0x7f393c0b6b50 legacy=0x7f393c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3928003970 0x7f3928003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39280047c0 0x7f3928004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3928005180 0x7f392800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0cd3a0 con 0x7f3928003970 2023-11-18T23:41:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392800c030 con 0x7f3928005180 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392800c1f0 con 0x7f39280047c0 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.604+0000 7f3941391640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3928003970 0x7f3928003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3940b90640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39280047c0 0x7f3928004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941b92640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3928005180 0x7f392800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941391640 1 -- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39280047c0 msgr2=0x7f3928004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941391640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39280047c0 0x7f3928004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941391640 1 -- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3928005180 msgr2=0x7f392800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941391640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3928005180 0x7f392800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941391640 1 -- 172.21.15.8:0/177968836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928003520 con 0x7f3928003970 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941b92640 1 -- 172.21.15.8:0/177968836 reap_dead start 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.605+0000 7f3941391640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3928003970 0x7f3928003d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f393800c240 tx=0x7f39280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76292201344c5a62 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938005ad0 con 0x7f3928003970 2023-11-18T23:41:45.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938005c30 con 0x7f3928003970 2023-11-18T23:41:45.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f3933fff640 1 -- 172.21.15.8:0/177968836 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393802caf0 con 0x7f3928003970 2023-11-18T23:41:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f39435f5640 1 -- 172.21.15.8:0/177968836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3928003970 msgr2=0x7f3928003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f39435f5640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3928003970 0x7f3928003d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f393800c240 tx=0x7f39280057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f39435f5640 1 -- 172.21.15.8:0/177968836 shutdown_connections 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f39435f5640 1 --2- 172.21.15.8:0/177968836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3928003970 0x7f3928003d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f39435f5640 1 -- 172.21.15.8:0/177968836 >> 172.21.15.8:0/177968836 conn(0x7f393c0b2a70 msgr2=0x7f393c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f39435f5640 1 -- 172.21.15.8:0/177968836 shutdown_connections 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.606+0000 7f39435f5640 1 -- 172.21.15.8:0/177968836 wait complete. 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.607+0000 7f39435f5640 1 Processor -- start 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.607+0000 7f39435f5640 1 -- start start 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f39435f5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3928003970 0x7f393c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f39435f5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f393c0af1f0 0x7f393c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f39435f5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f393c1511d0 0x7f393c1604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f39435f5640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0af650 con 0x7f393c1511d0 2023-11-18T23:41:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f39435f5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c15dec0 con 0x7f393c0af1f0 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f39435f5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c15e1a0 con 0x7f3928003970 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f3941b92640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f393c1511d0 0x7f393c1604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f3941b92640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f393c1511d0 0x7f393c1604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60532/0 (socket says 172.21.15.8:60532) 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f3941b92640 1 -- 172.21.15.8:0/1907885508 learned_addr learned my addr 172.21.15.8:0/1907885508 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f3941391640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3928003970 0x7f393c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.608+0000 7f3940b90640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f393c0af1f0 0x7f393c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3941b92640 1 -- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3928003970 msgr2=0x7f393c0cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3941b92640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3928003970 0x7f393c0cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3941b92640 1 -- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f393c0af1f0 msgr2=0x7f393c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3941b92640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f393c0af1f0 0x7f393c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3941b92640 1 -- 172.21.15.8:0/1907885508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c15e480 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3941b92640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f393c1511d0 0x7f393c1604f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f393c0719d0 tx=0x7f393400fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3931ffb640 1 -- 172.21.15.8:0/1907885508 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400fee0 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3931ffb640 1 -- 172.21.15.8:0/1907885508 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934006d60 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f3931ffb640 1 -- 172.21.15.8:0/1907885508 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934003bb0 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c15e760 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.609+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c15dbb0 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.610+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c15ec80 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.610+0000 7f3931ffb640 1 -- 172.21.15.8:0/1907885508 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3934003d10 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.611+0000 7f3931ffb640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f392006ae70 0x7f392006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.611+0000 7f3931ffb640 1 -- 172.21.15.8:0/1907885508 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3934088870 con 0x7f393c1511d0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.611+0000 7f3941391640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f392006ae70 0x7f392006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.611+0000 7f3941391640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f392006ae70 0x7f392006d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3938034000 tx=0x7f3938009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:45.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.615+0000 7f3931ffb640 1 -- 172.21.15.8:0/1907885508 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f393c15ec80 con 0x7f393c1511d0 2023-11-18T23:41:45.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.806+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f393c15ec80 con 0x7f393c1511d0 2023-11-18T23:41:45.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.807+0000 7f3931ffb640 1 -- 172.21.15.8:0/1907885508 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f393401a080 con 0x7f393c1511d0 2023-11-18T23:41:45.808 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f392006ae70 msgr2=0x7f392006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f392006ae70 0x7f392006d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3938034000 tx=0x7f3938009030 comp rx=0 tx=0).stop 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f393c1511d0 msgr2=0x7f393c1604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f393c1511d0 0x7f393c1604f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f393c0719d0 tx=0x7f393400fbd0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 shutdown_connections 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f392006ae70 0x7f392006d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f393c1511d0 0x7f393c1604f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f393c0af1f0 0x7f393c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 --2- 172.21.15.8:0/1907885508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3928003970 0x7f393c0cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 >> 172.21.15.8:0/1907885508 conn(0x7f393c0b2a70 msgr2=0x7f393c0b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:45.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 shutdown_connections 2023-11-18T23:41:45.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:45.809+0000 7f39435f5640 1 -- 172.21.15.8:0/1907885508 wait complete. 2023-11-18T23:41:45.821 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi008.front.sepia.ceph.com... 2023-11-18T23:41:45.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:45.821 DEBUG:teuthology.orchestra.run.smithi008:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-18T23:41:45.852 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:41:45.852 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:41:45.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:45.852 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T23:41:45.919 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:41:45.919 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:45.938 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:41:45.938 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:45.996 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:46.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.102+0000 7f16420c9640 1 Processor -- start 2023-11-18T23:41:46.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f16420c9640 1 -- start start 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f16420c9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c15d900 0x7f163c099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f16420c9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f163c0b2610 0x7f163c099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f16420c9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f163c0b00c0 0x7f163c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f16420c9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c0b0660 con 0x7f163c0b2610 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f16420c9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c06c900 con 0x7f163c0b00c0 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f16420c9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c06cbe0 con 0x7f163c15d900 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.103+0000 7f163affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f163c0b2610 0x7f163c099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f163c0b2610 0x7f163c099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60542/0 (socket says 172.21.15.8:60542) 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 -- 172.21.15.8:0/3923447882 learned_addr learned my addr 172.21.15.8:0/3923447882 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:46.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 -- 172.21.15.8:0/3923447882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c15d900 msgr2=0x7f163c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 --2- 172.21.15.8:0/3923447882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c15d900 0x7f163c099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 -- 172.21.15.8:0/3923447882 >> v2:172.21.15.116:3300/0 conn(0x7f163c0b00c0 msgr2=0x7f163c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 --2- 172.21.15.8:0/3923447882 >> v2:172.21.15.116:3300/0 conn(0x7f163c0b00c0 0x7f163c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 -- 172.21.15.8:0/3923447882 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c06cec0 con 0x7f163c0b2610 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.104+0000 7f163affd640 1 --2- 172.21.15.8:0/3923447882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b2610 0x7f163c099eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f163c071dc0 tx=0x7f163002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28aea425207b0eb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f163a7fc640 1 -- 172.21.15.8:0/3923447882 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630031870 con 0x7f163c0b2610 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f163a7fc640 1 -- 172.21.15.8:0/3923447882 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16300319d0 con 0x7f163c0b2610 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f163a7fc640 1 -- 172.21.15.8:0/3923447882 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630031d60 con 0x7f163c0b2610 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 -- 172.21.15.8:0/3923447882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b2610 msgr2=0x7f163c099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 --2- 172.21.15.8:0/3923447882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b2610 0x7f163c099eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f163c071dc0 tx=0x7f163002b910 comp rx=0 tx=0).stop 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 -- 172.21.15.8:0/3923447882 shutdown_connections 2023-11-18T23:41:46.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 --2- 172.21.15.8:0/3923447882 >> v2:172.21.15.116:3300/0 conn(0x7f163c0b00c0 0x7f163c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 --2- 172.21.15.8:0/3923447882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b2610 0x7f163c099eb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 --2- 172.21.15.8:0/3923447882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c15d900 0x7f163c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 -- 172.21.15.8:0/3923447882 >> 172.21.15.8:0/3923447882 conn(0x7f163c0b2a70 msgr2=0x7f163c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 -- 172.21.15.8:0/3923447882 shutdown_connections 2023-11-18T23:41:46.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.105+0000 7f16420c9640 1 -- 172.21.15.8:0/3923447882 wait complete. 2023-11-18T23:41:46.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.106+0000 7f16420c9640 1 Processor -- start 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f16420c9640 1 -- start start 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f16420c9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b00c0 0x7f163c1f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f16420c9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c0b2610 0x7f163c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f16420c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f163c15d900 0x7f163c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f16420c9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c6f10 con 0x7f163c0b00c0 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f16420c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0b5af0 con 0x7f163c15d900 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f16420c9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0b5dd0 con 0x7f163c0b2610 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f163b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b00c0 0x7f163c1f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f163b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b00c0 0x7f163c1f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60548/0 (socket says 172.21.15.8:60548) 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.107+0000 7f163b7fe640 1 -- 172.21.15.8:0/3709165415 learned_addr learned my addr 172.21.15.8:0/3709165415 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163affd640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c0b2610 0x7f163c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163bfff640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f163c15d900 0x7f163c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163b7fe640 1 -- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c0b2610 msgr2=0x7f163c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163b7fe640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c0b2610 0x7f163c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163b7fe640 1 -- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f163c15d900 msgr2=0x7f163c06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163b7fe640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f163c15d900 0x7f163c06f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163b7fe640 1 -- 172.21.15.8:0/3709165415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300094d0 con 0x7f163c0b00c0 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f163b7fe640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b00c0 0x7f163c1f2d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f162c00b410 tx=0x7f162c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f1623fff640 1 -- 172.21.15.8:0/3709165415 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c011830 con 0x7f163c0b00c0 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f1623fff640 1 -- 172.21.15.8:0/3709165415 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c0119b0 con 0x7f163c0b00c0 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c0b60b0 con 0x7f163c0b00c0 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f1623fff640 1 -- 172.21.15.8:0/3709165415 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c011d60 con 0x7f163c0b00c0 2023-11-18T23:41:46.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.108+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c0b6670 con 0x7f163c0b00c0 2023-11-18T23:41:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.109+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c06bfe0 con 0x7f163c0b00c0 2023-11-18T23:41:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.110+0000 7f1623fff640 1 -- 172.21.15.8:0/3709165415 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f162c01a400 con 0x7f163c0b00c0 2023-11-18T23:41:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.110+0000 7f1623fff640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f162806ae40 0x7f162806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.110+0000 7f1623fff640 1 -- 172.21.15.8:0/3709165415 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f162c0897a0 con 0x7f163c0b00c0 2023-11-18T23:41:46.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.110+0000 7f163affd640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f162806ae40 0x7f162806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.111+0000 7f163affd640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f162806ae40 0x7f162806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1630036000 tx=0x7f163003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.114+0000 7f1623fff640 1 -- 172.21.15.8:0/3709165415 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f162c054850 con 0x7f163c0b00c0 2023-11-18T23:41:46.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.292+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f163c067420 con 0x7f163c0b00c0 2023-11-18T23:41:46.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.293+0000 7f1623fff640 1 -- 172.21.15.8:0/3709165415 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f162c015090 con 0x7f163c0b00c0 2023-11-18T23:41:46.294 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:46.295 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:46.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f162806ae40 msgr2=0x7f162806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f162806ae40 0x7f162806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1630036000 tx=0x7f163003c040 comp rx=0 tx=0).stop 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b00c0 msgr2=0x7f163c1f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b00c0 0x7f163c1f2d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f162c00b410 tx=0x7f162c00b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 shutdown_connections 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f162806ae40 0x7f162806d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f163c15d900 0x7f163c06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f163c0b2610 0x7f163c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 --2- 172.21.15.8:0/3709165415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f163c0b00c0 0x7f163c1f2d60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 >> 172.21.15.8:0/3709165415 conn(0x7f163c0b2a70 msgr2=0x7f163c15bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 shutdown_connections 2023-11-18T23:41:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.295+0000 7f16420c9640 1 -- 172.21.15.8:0/3709165415 wait complete. 2023-11-18T23:41:46.307 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:46.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.416+0000 7fc44c368640 1 Processor -- start 2023-11-18T23:41:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.416+0000 7fc44c368640 1 -- start start 2023-11-18T23:41:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc44c368640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 0x7fc44406c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc44c368640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4440b3590 con 0x7fc4440b6b50 2023-11-18T23:41:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc44c368640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44406b310 con 0x7fc44409a080 2023-11-18T23:41:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc44c368640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440cd3a0 con 0x7fc4440cfd40 2023-11-18T23:41:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc44a104640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc4440b6b50 0x7fc444099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39456/0 (socket says 172.21.15.8:39456) 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc44a104640 1 -- 172.21.15.8:0/1846874758 learned_addr learned my addr 172.21.15.8:0/1846874758 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123996046 0 0) 0x7fc4440b3590 con 0x7fc4440b6b50 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc44a905640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 0x7fc44406c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc430003520 con 0x7fc4440b6b50 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784136231 0 0) 0x7fc430003520 con 0x7fc4440b6b50 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 msgr2=0x7fc44406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc449102640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 0x7fc44406c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.417+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 >> v1:172.21.15.116:6789/0 conn(0x7fc44409a080 legacy=0x7fc44406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440b37c0 con 0x7fc4440b6b50 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fc440001670 con 0x7fc4440b6b50 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 >> v1:172.21.15.8:6789/0 conn(0x7fc4440b6b50 legacy=0x7fc444099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4300039a0 0x7fc430003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430004350 0x7fc430004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 0x7fc430005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440cd3a0 con 0x7fc430004350 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43000b9b0 con 0x7fc4300039a0 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43000bb70 con 0x7fc4440cfd40 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449903640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430004350 0x7fc430004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc44a104640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4300039a0 0x7fc430003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc44a905640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 0x7fc430005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449903640 1 -- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 msgr2=0x7fc430005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449903640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc4440cfd40 0x7fc430005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449903640 1 -- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4300039a0 msgr2=0x7fc430003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449903640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4300039a0 0x7fc430003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.418+0000 7fc449903640 1 -- 172.21.15.8:0/1846874758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430003520 con 0x7fc430004350 2023-11-18T23:41:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.419+0000 7fc449903640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430004350 0x7fc430004820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc434001860 tx=0x7fc4300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2a3dce1fd6ead0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.419+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434033410 con 0x7fc430004350 2023-11-18T23:41:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.419+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc434033590 con 0x7fc430004350 2023-11-18T23:41:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.419+0000 7fc449102640 1 -- 172.21.15.8:0/1846874758 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434033940 con 0x7fc430004350 2023-11-18T23:41:46.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.419+0000 7fc44c368640 1 -- 172.21.15.8:0/1846874758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430004350 msgr2=0x7fc430004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.419+0000 7fc44c368640 1 --2- 172.21.15.8:0/1846874758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc430004350 0x7fc430004820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc434001860 tx=0x7fc4300057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.419+0000 7fc44a905640 1 -- 172.21.15.8:0/1846874758 reap_dead start 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.420+0000 7fc44c368640 1 -- 172.21.15.8:0/1846874758 shutdown_connections 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.420+0000 7fc44c368640 1 -- 172.21.15.8:0/1846874758 >> 172.21.15.8:0/1846874758 conn(0x7fc4440b2a70 msgr2=0x7fc4440b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.420+0000 7fc44c368640 1 -- 172.21.15.8:0/1846874758 shutdown_connections 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.420+0000 7fc44c368640 1 -- 172.21.15.8:0/1846874758 wait complete. 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 Processor -- start 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 -- start start 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc430004350 0x7fc44415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4440c9ef0 0x7fc4440c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc44406bd70 0x7fc44406c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440c9430 con 0x7fc4440c9ef0 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44406c760 con 0x7fc430004350 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.421+0000 7fc44c368640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44415eb70 con 0x7fc44406bd70 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4440c9ef0 0x7fc4440c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4440c9ef0 0x7fc4440c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60556/0 (socket says 172.21.15.8:60556) 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 -- 172.21.15.8:0/83391285 learned_addr learned my addr 172.21.15.8:0/83391285 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc44a104640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc430004350 0x7fc44415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc44a905640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc44406bd70 0x7fc44406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 -- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc44406bd70 msgr2=0x7fc44406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc44406bd70 0x7fc44406c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 -- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc430004350 msgr2=0x7fc44415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc430004350 0x7fc44415ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 -- 172.21.15.8:0/83391285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44415e840 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc449903640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4440c9ef0 0x7fc4440c8520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc43402bd00 tx=0x7fc434001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc43affd640 1 -- 172.21.15.8:0/83391285 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434005270 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc43affd640 1 -- 172.21.15.8:0/83391285 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4340053d0 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44406d290 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc43affd640 1 -- 172.21.15.8:0/83391285 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434033940 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.422+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4440c8e70 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.423+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4440c7ea0 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.424+0000 7fc43affd640 1 -- 172.21.15.8:0/83391285 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc43403a050 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.424+0000 7fc43affd640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc42806ae40 0x7fc42806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.424+0000 7fc43affd640 1 -- 172.21.15.8:0/83391285 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4340aacf0 con 0x7fc4440c9ef0 2023-11-18T23:41:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.424+0000 7fc44a104640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc42806ae40 0x7fc42806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.425+0000 7fc44a104640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc42806ae40 0x7fc42806d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc4440b5490 tx=0x7fc440009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.429+0000 7fc43affd640 1 -- 172.21.15.8:0/83391285 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc434075ee0 con 0x7fc4440c9ef0 2023-11-18T23:41:46.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.603+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc44409ef40 con 0x7fc4440c9ef0 2023-11-18T23:41:46.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.604+0000 7fc43affd640 1 -- 172.21.15.8:0/83391285 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc434079500 con 0x7fc4440c9ef0 2023-11-18T23:41:46.605 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc42806ae40 msgr2=0x7fc42806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc42806ae40 0x7fc42806d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc4440b5490 tx=0x7fc440009040 comp rx=0 tx=0).stop 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4440c9ef0 msgr2=0x7fc4440c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4440c9ef0 0x7fc4440c8520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc43402bd00 tx=0x7fc434001230 comp rx=0 tx=0).stop 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 shutdown_connections 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc42806ae40 0x7fc42806d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc44406bd70 0x7fc44406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4440c9ef0 0x7fc4440c8520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 --2- 172.21.15.8:0/83391285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc430004350 0x7fc44415ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 >> 172.21.15.8:0/83391285 conn(0x7fc4440b2a70 msgr2=0x7fc4440d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:46.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 shutdown_connections 2023-11-18T23:41:46.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.605+0000 7fc44c368640 1 -- 172.21.15.8:0/83391285 wait complete. 2023-11-18T23:41:46.617 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.725+0000 7ff6731ce640 1 Processor -- start 2023-11-18T23:41:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.725+0000 7ff6731ce640 1 -- start start 2023-11-18T23:41:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff6731ce640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c160b70 0x7ff66c0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff6731ce640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff66c0b2aa0 0x7ff66c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff6731ce640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0ce360 con 0x7ff66c0ced30 2023-11-18T23:41:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff6731ce640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0b2f20 con 0x7ff66c0b2aa0 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff6731ce640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0cdd50 con 0x7ff66c160b70 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff66bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff66c0b2aa0 0x7ff66c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff67176b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff66c0ced30 0x7ff66c0cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39472/0 (socket says 172.21.15.8:39472) 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.726+0000 7ff67176b640 1 -- 172.21.15.8:0/3309526568 learned_addr learned my addr 172.21.15.8:0/3309526568 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.727+0000 7ff670f6a640 1 --2- 172.21.15.8:0/3309526568 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c160b70 0x7ff66c0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.727+0000 7ff66b7fe640 1 -- 172.21.15.8:0/3309526568 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057338101 0 0) 0x7ff66c0ce360 con 0x7ff66c0ced30 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.727+0000 7ff66b7fe640 1 -- 172.21.15.8:0/3309526568 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff654003520 con 0x7ff66c0ced30 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.727+0000 7ff66bfff640 1 -- 172.21.15.8:0/3309526568 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c160b70 msgr2=0x7ff66c0d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.727+0000 7ff66bfff640 1 --2- 172.21.15.8:0/3309526568 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c160b70 0x7ff66c0d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.727+0000 7ff66bfff640 1 -- 172.21.15.8:0/3309526568 >> v1:172.21.15.8:6789/0 conn(0x7ff66c0ced30 legacy=0x7ff66c0cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.727+0000 7ff66bfff640 1 -- 172.21.15.8:0/3309526568 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0d1c70 con 0x7ff66c0b2aa0 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff66bfff640 1 --2- 172.21.15.8:0/3309526568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c0b2aa0 0x7ff66c0ce7f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097a0 tx=0x7ff66002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69de7b58f36fe791 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff66b7fe640 1 -- 172.21.15.8:0/3309526568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660031830 con 0x7ff66c0b2aa0 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff66b7fe640 1 -- 172.21.15.8:0/3309526568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff660031990 con 0x7ff66c0b2aa0 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff66b7fe640 1 -- 172.21.15.8:0/3309526568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660031d20 con 0x7ff66c0b2aa0 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 -- 172.21.15.8:0/3309526568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c0b2aa0 msgr2=0x7ff66c0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 --2- 172.21.15.8:0/3309526568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c0b2aa0 0x7ff66c0ce7f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097a0 tx=0x7ff66002b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 -- 172.21.15.8:0/3309526568 shutdown_connections 2023-11-18T23:41:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 --2- 172.21.15.8:0/3309526568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c0b2aa0 0x7ff66c0ce7f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 --2- 172.21.15.8:0/3309526568 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c160b70 0x7ff66c0d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 -- 172.21.15.8:0/3309526568 >> 172.21.15.8:0/3309526568 conn(0x7ff66c09c470 msgr2=0x7ff66c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 -- 172.21.15.8:0/3309526568 shutdown_connections 2023-11-18T23:41:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.728+0000 7ff6731ce640 1 -- 172.21.15.8:0/3309526568 wait complete. 2023-11-18T23:41:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.729+0000 7ff6731ce640 1 Processor -- start 2023-11-18T23:41:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.730+0000 7ff6731ce640 1 -- start start 2023-11-18T23:41:46.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.730+0000 7ff6731ce640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c0b2aa0 0x7ff66c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.730+0000 7ff6731ce640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c0ced30 0x7ff66c06b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.730+0000 7ff6731ce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c160b70 0x7ff66c06b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.730+0000 7ff6731ce640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15e6d0 con 0x7ff66c160b70 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.730+0000 7ff6731ce640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0b7140 con 0x7ff66c0b2aa0 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.730+0000 7ff6731ce640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15a990 con 0x7ff66c0ced30 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c160b70 0x7ff66c06b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c160b70 0x7ff66c06b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60576/0 (socket says 172.21.15.8:60576) 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 -- 172.21.15.8:0/2513864381 learned_addr learned my addr 172.21.15.8:0/2513864381 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff670f6a640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c0b2aa0 0x7ff66c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff66bfff640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c0ced30 0x7ff66c06b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 -- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c0ced30 msgr2=0x7ff66c06b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c0ced30 0x7ff66c06b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 -- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c0b2aa0 msgr2=0x7ff66c14d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c0b2aa0 0x7ff66c14d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 -- 172.21.15.8:0/2513864381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660009400 con 0x7ff66c160b70 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff66bfff640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c0ced30 0x7ff66c06b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff67176b640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c160b70 0x7ff66c06b780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c430 tx=0x7ff65c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff6697fa640 1 -- 172.21.15.8:0/2513864381 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c005ce0 con 0x7ff66c160b70 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff6697fa640 1 -- 172.21.15.8:0/2513864381 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c005e40 con 0x7ff66c160b70 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff6697fa640 1 -- 172.21.15.8:0/2513864381 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c007310 con 0x7ff66c160b70 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c15e3f0 con 0x7ff66c160b70 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.731+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c0b7670 con 0x7ff66c160b70 2023-11-18T23:41:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.732+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c0a1150 con 0x7ff66c160b70 2023-11-18T23:41:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.733+0000 7ff6697fa640 1 -- 172.21.15.8:0/2513864381 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff65c007470 con 0x7ff66c160b70 2023-11-18T23:41:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.733+0000 7ff6697fa640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff65806ae70 0x7ff65806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.733+0000 7ff6697fa640 1 -- 172.21.15.8:0/2513864381 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff65c088c40 con 0x7ff66c160b70 2023-11-18T23:41:46.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.734+0000 7ff670f6a640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff65806ae70 0x7ff65806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.734+0000 7ff670f6a640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff65806ae70 0x7ff65806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff664011340 tx=0x7ff66400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.738+0000 7ff6697fa640 1 -- 172.21.15.8:0/2513864381 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff65c053d10 con 0x7ff66c160b70 2023-11-18T23:41:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.915+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff66c0b22d0 con 0x7ff66c160b70 2023-11-18T23:41:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.915+0000 7ff6697fa640 1 -- 172.21.15.8:0/2513864381 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff65c0170a0 con 0x7ff66c160b70 2023-11-18T23:41:46.917 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.917+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff65806ae70 msgr2=0x7ff65806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.917+0000 7ff6731ce640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff65806ae70 0x7ff65806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff664011340 tx=0x7ff66400b040 comp rx=0 tx=0).stop 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.917+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c160b70 msgr2=0x7ff66c06b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.917+0000 7ff6731ce640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c160b70 0x7ff66c06b780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c430 tx=0x7ff65c00c8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 shutdown_connections 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff65806ae70 0x7ff65806d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff66c160b70 0x7ff66c06b780 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff66c0ced30 0x7ff66c06b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 --2- 172.21.15.8:0/2513864381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c0b2aa0 0x7ff66c14d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 >> 172.21.15.8:0/2513864381 conn(0x7ff66c09c470 msgr2=0x7ff66c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 shutdown_connections 2023-11-18T23:41:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:46.918+0000 7ff6731ce640 1 -- 172.21.15.8:0/2513864381 wait complete. 2023-11-18T23:41:46.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:47.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.038+0000 7f5fd20cf640 1 Processor -- start 2023-11-18T23:41:47.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.038+0000 7f5fd20cf640 1 -- start start 2023-11-18T23:41:47.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fd20cf640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5fcc15e8a0 0x7f5fcc0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fd20cf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fd20cf640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc09a520 con 0x7f5fcc0cccd0 2023-11-18T23:41:47.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fd20cf640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc09a330 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fd20cf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc09a800 con 0x7f5fcc0ceb70 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fcb7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5fcc15e8a0 0x7f5fcc0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fcbfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5fcc0cccd0 0x7f5fcc15efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39480/0 (socket says 172.21.15.8:39480) 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.039+0000 7f5fcbfff640 1 -- 172.21.15.8:0/1296636108 learned_addr learned my addr 172.21.15.8:0/1296636108 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fcaffd640 1 --2- 172.21.15.8:0/1296636108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fcb7fe640 1 -- 172.21.15.8:0/1296636108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 msgr2=0x7f5fcc0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fcb7fe640 1 --2- 172.21.15.8:0/1296636108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fcb7fe640 1 -- 172.21.15.8:0/1296636108 >> v1:172.21.15.8:6789/0 conn(0x7f5fcc0cccd0 legacy=0x7f5fcc15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fca7fc640 1 -- 172.21.15.8:0/1296636108 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894594442 0 0) 0x7f5fcc09a520 con 0x7f5fcc0cccd0 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fcb7fe640 1 -- 172.21.15.8:0/1296636108 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0cbf90 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fcaffd640 1 --2- 172.21.15.8:0/1296636108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.040+0000 7f5fcb7fe640 1 --2- 172.21.15.8:0/1296636108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0cc790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0097a0 tx=0x7f5fbc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9d9928e8eef4fe server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fca7fc640 1 -- 172.21.15.8:0/1296636108 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc031830 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fca7fc640 1 -- 172.21.15.8:0/1296636108 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc031990 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fca7fc640 1 -- 172.21.15.8:0/1296636108 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc031d20 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 -- 172.21.15.8:0/1296636108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 msgr2=0x7f5fcc0cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/1296636108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0cc790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0097a0 tx=0x7f5fbc02b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 -- 172.21.15.8:0/1296636108 shutdown_connections 2023-11-18T23:41:47.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/1296636108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/1296636108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0cc790 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 -- 172.21.15.8:0/1296636108 >> 172.21.15.8:0/1296636108 conn(0x7f5fcc0b2a90 msgr2=0x7f5fcc0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:47.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 -- 172.21.15.8:0/1296636108 shutdown_connections 2023-11-18T23:41:47.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.041+0000 7f5fd20cf640 1 -- 172.21.15.8:0/1296636108 wait complete. 2023-11-18T23:41:47.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.042+0000 7f5fd20cf640 1 Processor -- start 2023-11-18T23:41:47.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.043+0000 7f5fd20cf640 1 -- start start 2023-11-18T23:41:47.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.043+0000 7f5fd20cf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5fcc0cccd0 0x7f5fcc0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.043+0000 7f5fd20cf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.043+0000 7f5fd20cf640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.043+0000 7f5fd20cf640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc1f8010 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.043+0000 7f5fd20cf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0b4f90 con 0x7f5fcc0cccd0 2023-11-18T23:41:47.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.043+0000 7f5fd20cf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0c72a0 con 0x7f5fcc0ceb70 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60592/0 (socket says 172.21.15.8:60592) 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 -- 172.21.15.8:0/761510598 learned_addr learned my addr 172.21.15.8:0/761510598 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 -- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 msgr2=0x7f5fcc0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 -- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5fcc0cccd0 msgr2=0x7f5fcc0c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcb7fe640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5fcc0cccd0 0x7f5fcc0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5fcc0cccd0 0x7f5fcc0c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 -- 172.21.15.8:0/761510598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc009400 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fcbfff640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0b1950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400c7e0 tx=0x7f5fc400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fb3fff640 1 -- 172.21.15.8:0/761510598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400a640 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fb3fff640 1 -- 172.21.15.8:0/761510598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc400a7c0 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc1f7400 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fb3fff640 1 -- 172.21.15.8:0/761510598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400ab70 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.044+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc1f79c0 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.045+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc0b50e0 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.046+0000 7f5fb3fff640 1 -- 172.21.15.8:0/761510598 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fc400acd0 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.046+0000 7f5fb3fff640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5fb806ae40 0x7f5fb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.046+0000 7f5fb3fff640 1 -- 172.21.15.8:0/761510598 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fc4088c30 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.046+0000 7f5fcb7fe640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5fb806ae40 0x7f5fb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.047+0000 7f5fcb7fe640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5fb806ae40 0x7f5fb806d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc036000 tx=0x7f5fbc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.051+0000 7f5fb3fff640 1 -- 172.21.15.8:0/761510598 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fcc0b50e0 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.226+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fcc0b50e0 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.226+0000 7f5fb3fff640 1 -- 172.21.15.8:0/761510598 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fcc0b50e0 con 0x7f5fcc15e8a0 2023-11-18T23:41:47.228 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5fb806ae40 msgr2=0x7f5fb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5fb806ae40 0x7f5fb806d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc036000 tx=0x7f5fbc03c040 comp rx=0 tx=0).stop 2023-11-18T23:41:47.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 msgr2=0x7f5fcc0b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0b1950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400c7e0 tx=0x7f5fc400cca0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 shutdown_connections 2023-11-18T23:41:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5fb806ae40 0x7f5fb806d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fcc15e8a0 0x7f5fcc0b1950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5fcc0ceb70 0x7f5fcc0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 --2- 172.21.15.8:0/761510598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5fcc0cccd0 0x7f5fcc0c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 >> 172.21.15.8:0/761510598 conn(0x7f5fcc0b2a90 msgr2=0x7f5fcc0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:47.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 shutdown_connections 2023-11-18T23:41:47.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.228+0000 7f5fd20cf640 1 -- 172.21.15.8:0/761510598 wait complete. 2023-11-18T23:41:47.240 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:47.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.346+0000 7fa7594af640 1 Processor -- start 2023-11-18T23:41:47.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.346+0000 7fa7594af640 1 -- start start 2023-11-18T23:41:47.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7594af640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa754160b70 0x7fa7540d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7594af640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa7540ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7594af640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa7540ced30 0x7fa7540cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7594af640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540ce360 con 0x7fa7540ced30 2023-11-18T23:41:47.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7594af640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540b2f20 con 0x7fa754160b70 2023-11-18T23:41:47.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7594af640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540cdd50 con 0x7fa7540b2aa0 2023-11-18T23:41:47.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7537fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa7540ced30 0x7fa7540cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7537fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa7540ced30 0x7fa7540cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60596/0 (socket says 172.21.15.8:60596) 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7537fe640 1 -- 172.21.15.8:0/1394744033 learned_addr learned my addr 172.21.15.8:0/1394744033 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa752ffd640 1 --2- 172.21.15.8:0/1394744033 >> v2:172.21.15.116:3300/0 conn(0x7fa754160b70 0x7fa7540d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7537fe640 1 -- 172.21.15.8:0/1394744033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 msgr2=0x7fa7540ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.347+0000 7fa7527fc640 1 --2- 172.21.15.8:0/1394744033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa7540ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.348+0000 7fa7537fe640 1 --2- 172.21.15.8:0/1394744033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa7540ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.348+0000 7fa7537fe640 1 -- 172.21.15.8:0/1394744033 >> v2:172.21.15.116:3300/0 conn(0x7fa754160b70 msgr2=0x7fa7540d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.348+0000 7fa7537fe640 1 --2- 172.21.15.8:0/1394744033 >> v2:172.21.15.116:3300/0 conn(0x7fa754160b70 0x7fa7540d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.348+0000 7fa7537fe640 1 -- 172.21.15.8:0/1394744033 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540d1c70 con 0x7fa7540ced30 2023-11-18T23:41:47.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.348+0000 7fa752ffd640 1 --2- 172.21.15.8:0/1394744033 >> v2:172.21.15.116:3300/0 conn(0x7fa754160b70 0x7fa7540d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.348+0000 7fa7537fe640 1 --2- 172.21.15.8:0/1394744033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa7540cfb50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa75408ca80 tx=0x7fa74402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c603a7859bcb18b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.348+0000 7fa751ffb640 1 -- 172.21.15.8:0/1394744033 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74402ca70 con 0x7fa7540ced30 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa751ffb640 1 -- 172.21.15.8:0/1394744033 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74402cbd0 con 0x7fa7540ced30 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa751ffb640 1 -- 172.21.15.8:0/1394744033 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440343f0 con 0x7fa7540ced30 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 -- 172.21.15.8:0/1394744033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 msgr2=0x7fa7540cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 --2- 172.21.15.8:0/1394744033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa7540cfb50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa75408ca80 tx=0x7fa74402bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 -- 172.21.15.8:0/1394744033 shutdown_connections 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 --2- 172.21.15.8:0/1394744033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa7540cfb50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 --2- 172.21.15.8:0/1394744033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa7540ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 --2- 172.21.15.8:0/1394744033 >> v2:172.21.15.116:3300/0 conn(0x7fa754160b70 0x7fa7540d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 -- 172.21.15.8:0/1394744033 >> 172.21.15.8:0/1394744033 conn(0x7fa75409c470 msgr2=0x7fa7540d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:47.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 -- 172.21.15.8:0/1394744033 shutdown_connections 2023-11-18T23:41:47.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.349+0000 7fa7594af640 1 -- 172.21.15.8:0/1394744033 wait complete. 2023-11-18T23:41:47.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.350+0000 7fa7594af640 1 Processor -- start 2023-11-18T23:41:47.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.350+0000 7fa7594af640 1 -- start start 2023-11-18T23:41:47.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7594af640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa75414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7594af640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa75415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7594af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754160b70 0x7fa7540b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7594af640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75415f910 con 0x7fa7540ced30 2023-11-18T23:41:47.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7594af640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75415fbf0 con 0x7fa754160b70 2023-11-18T23:41:47.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7594af640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75415fed0 con 0x7fa7540b2aa0 2023-11-18T23:41:47.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7527fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa75415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7527fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa75415ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60604/0 (socket says 172.21.15.8:60604) 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7527fc640 1 -- 172.21.15.8:0/1361756225 learned_addr learned my addr 172.21.15.8:0/1361756225 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa7537fe640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754160b70 0x7fa7540b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.351+0000 7fa752ffd640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa75414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7527fc640 1 -- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 msgr2=0x7fa75414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7527fc640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa75414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7527fc640 1 -- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754160b70 msgr2=0x7fa7540b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7527fc640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754160b70 0x7fa7540b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7527fc640 1 -- 172.21.15.8:0/1361756225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009b30 con 0x7fa7540ced30 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7527fc640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa75415ef10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c7f0 tx=0x7fa73c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa74b7fe640 1 -- 172.21.15.8:0/1361756225 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c004220 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa74b7fe640 1 -- 172.21.15.8:0/1361756225 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c004380 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7541601b0 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa74b7fe640 1 -- 172.21.15.8:0/1361756225 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c007860 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.352+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75414c5d0 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.353+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7540d2b50 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.353+0000 7fa74b7fe640 1 -- 172.21.15.8:0/1361756225 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa73c007bd0 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.354+0000 7fa74b7fe640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa73406ae40 0x7fa73406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.354+0000 7fa74b7fe640 1 -- 172.21.15.8:0/1361756225 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73c089510 con 0x7fa7540ced30 2023-11-18T23:41:47.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.354+0000 7fa752ffd640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa73406ae40 0x7fa73406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.354+0000 7fa752ffd640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa73406ae40 0x7fa73406d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00aac0 tx=0x7fa74c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.358+0000 7fa74b7fe640 1 -- 172.21.15.8:0/1361756225 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa73c0545e0 con 0x7fa7540ced30 2023-11-18T23:41:47.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.547+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7540a1150 con 0x7fa7540ced30 2023-11-18T23:41:47.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.548+0000 7fa74b7fe640 1 -- 172.21.15.8:0/1361756225 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa73c01e080 con 0x7fa7540ced30 2023-11-18T23:41:47.549 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:47.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa73406ae40 msgr2=0x7fa73406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa73406ae40 0x7fa73406d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00aac0 tx=0x7fa74c008040 comp rx=0 tx=0).stop 2023-11-18T23:41:47.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 msgr2=0x7fa75415ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa75415ef10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c7f0 tx=0x7fa73c00ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 shutdown_connections 2023-11-18T23:41:47.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fa73406ae40 0x7fa73406d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754160b70 0x7fa7540b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7540ced30 0x7fa75415ef10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 --2- 172.21.15.8:0/1361756225 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7540b2aa0 0x7fa75414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 >> 172.21.15.8:0/1361756225 conn(0x7fa75409c470 msgr2=0x7fa75406b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:47.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 shutdown_connections 2023-11-18T23:41:47.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.550+0000 7fa7594af640 1 -- 172.21.15.8:0/1361756225 wait complete. 2023-11-18T23:41:47.562 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:41:47.562 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:47.581 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:47.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.685+0000 7f730f483640 1 Processor -- start 2023-11-18T23:41:47.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.686+0000 7f730f483640 1 -- start start 2023-11-18T23:41:47.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.686+0000 7f730f483640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7308142d20 0x7f7308071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.686+0000 7f730f483640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73080b3130 con 0x7f730806dc30 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.686+0000 7f730f483640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7308143100 con 0x7f73080b1df0 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.686+0000 7f730f483640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080b2250 con 0x7f7308142d20 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f730da20640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f730806dc30 0x7f73080cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38546/0 (socket says 172.21.15.8:38546) 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f730da20640 1 -- 172.21.15.8:0/2286066229 learned_addr learned my addr 172.21.15.8:0/2286066229 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f730d21f640 1 --2- 172.21.15.8:0/2286066229 >> v2:172.21.15.116:3300/0 conn(0x7f7308142d20 0x7f7308071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970156700 0 0) 0x7f73080b3130 con 0x7f730806dc30 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003520 con 0x7f730806dc30 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4080501355 0 0) 0x7f72f4003520 con 0x7f730806dc30 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 >> v2:172.21.15.116:3300/0 conn(0x7f7308142d20 msgr2=0x7f7308071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 --2- 172.21.15.8:0/2286066229 >> v2:172.21.15.116:3300/0 conn(0x7f7308142d20 0x7f7308071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 >> v1:172.21.15.116:6789/0 conn(0x7f73080b1df0 legacy=0x7f730806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73080b2520 con 0x7f730806dc30 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f73000019f0 con 0x7f730806dc30 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 >> v1:172.21.15.8:6789/0 conn(0x7f730806dc30 legacy=0x7f73080cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f4003970 0x7f72f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f4005180 0x7f72f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080b2250 con 0x7f72f40047c0 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400c020 con 0x7f72f4003970 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400c1e0 con 0x7f72f4005180 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f730ca1e640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.687+0000 7f730d21f640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f4003970 0x7f72f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730da20640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f4005180 0x7f72f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730ca1e640 1 -- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f4005180 msgr2=0x7f72f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730ca1e640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f4005180 0x7f72f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730ca1e640 1 -- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f4003970 msgr2=0x7f72f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730ca1e640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f4003970 0x7f72f4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730ca1e640 1 -- 172.21.15.8:0/2286066229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4003520 con 0x7f72f40047c0 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730da20640 1 -- 172.21.15.8:0/2286066229 reap_dead start 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f730ca1e640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72f8001750 tx=0x7f72f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc876db3cc51c83 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.688+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80052d0 con 0x7f72f40047c0 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f802e050 con 0x7f72f40047c0 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f72fffff640 1 -- 172.21.15.8:0/2286066229 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003830 con 0x7f72f40047c0 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f730f483640 1 -- 172.21.15.8:0/2286066229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f40047c0 msgr2=0x7f72f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f730f483640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72f8001750 tx=0x7f72f40057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f730f483640 1 -- 172.21.15.8:0/2286066229 shutdown_connections 2023-11-18T23:41:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f730f483640 1 --2- 172.21.15.8:0/2286066229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f40047c0 0x7f72f4004c40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f730f483640 1 -- 172.21.15.8:0/2286066229 >> 172.21.15.8:0/2286066229 conn(0x7f73080b0af0 msgr2=0x7f73080b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f730f483640 1 -- 172.21.15.8:0/2286066229 shutdown_connections 2023-11-18T23:41:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.689+0000 7f730f483640 1 -- 172.21.15.8:0/2286066229 wait complete. 2023-11-18T23:41:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.690+0000 7f730f483640 1 Processor -- start 2023-11-18T23:41:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.690+0000 7f730f483640 1 -- start start 2023-11-18T23:41:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730f483640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f40047c0 0x7f73080acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730f483640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f730813f2e0 0x7f73080c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730f483640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73080c42a0 0x7f73081f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730f483640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c56c0 con 0x7f73080c42a0 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730f483640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c4720 con 0x7f730813f2e0 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730f483640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73080ad2d0 con 0x7f72f40047c0 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730da20640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73080c42a0 0x7f73081f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730da20640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73080c42a0 0x7f73081f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50378/0 (socket says 172.21.15.8:50378) 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.691+0000 7f730da20640 1 -- 172.21.15.8:0/2697054027 learned_addr learned my addr 172.21.15.8:0/2697054027 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730ca1e640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f730813f2e0 0x7f73080c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730da20640 1 -- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f40047c0 msgr2=0x7f73080acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730da20640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f40047c0 0x7f73080acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730da20640 1 -- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f730813f2e0 msgr2=0x7f73080c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730da20640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f730813f2e0 0x7f73080c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730da20640 1 -- 172.21.15.8:0/2697054027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730815b480 con 0x7f73080c42a0 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730da20640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73080c42a0 0x7f73081f2d00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f730815da90 tx=0x7f7300007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f72fdffb640 1 -- 172.21.15.8:0/2697054027 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000ea20 con 0x7f73080c42a0 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f72fdffb640 1 -- 172.21.15.8:0/2697054027 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000eb80 con 0x7f73080c42a0 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f72fdffb640 1 -- 172.21.15.8:0/2697054027 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300014430 con 0x7f73080c42a0 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73081f3a30 con 0x7f73080c42a0 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.692+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730815ba00 con 0x7f73080c42a0 2023-11-18T23:41:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.693+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7308067420 con 0x7f73080c42a0 2023-11-18T23:41:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.693+0000 7f72fdffb640 1 -- 172.21.15.8:0/2697054027 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7300014590 con 0x7f73080c42a0 2023-11-18T23:41:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.694+0000 7f72fdffb640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f72ec06ae70 0x7f72ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.694+0000 7f72fdffb640 1 -- 172.21.15.8:0/2697054027 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73000891f0 con 0x7f73080c42a0 2023-11-18T23:41:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.694+0000 7f730d21f640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f72ec06ae70 0x7f72ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.695+0000 7f730d21f640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f72ec06ae70 0x7f72ec06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7304006e80 tx=0x7f7304006df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.698+0000 7f72fdffb640 1 -- 172.21.15.8:0/2697054027 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73000542a0 con 0x7f73080c42a0 2023-11-18T23:41:47.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.873+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f730806d270 con 0x7f73080c42a0 2023-11-18T23:41:47.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.875+0000 7f72fdffb640 1 -- 172.21.15.8:0/2697054027 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f73000578c0 con 0x7f73080c42a0 2023-11-18T23:41:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:47.876 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:47.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.876+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f72ec06ae70 msgr2=0x7f72ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.876+0000 7f730f483640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f72ec06ae70 0x7f72ec06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7304006e80 tx=0x7f7304006df0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.876+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73080c42a0 msgr2=0x7f73081f2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:47.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.876+0000 7f730f483640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73080c42a0 0x7f73081f2d00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f730815da90 tx=0x7f7300007bc0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 shutdown_connections 2023-11-18T23:41:47.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f72ec06ae70 0x7f72ec06d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73080c42a0 0x7f73081f2d00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f730813f2e0 0x7f73080c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 --2- 172.21.15.8:0/2697054027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72f40047c0 0x7f73080acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:47.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 >> 172.21.15.8:0/2697054027 conn(0x7f73080b0af0 msgr2=0x7f730813fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:47.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 shutdown_connections 2023-11-18T23:41:47.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.877+0000 7f730f483640 1 -- 172.21.15.8:0/2697054027 wait complete. 2023-11-18T23:41:47.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:47.889 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:47.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.998+0000 7fbc68061640 1 Processor -- start 2023-11-18T23:41:47.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.998+0000 7fbc68061640 1 -- start start 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc68061640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 0x7fbc600b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc68061640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbc6006abe0 0x7fbc60160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc68061640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600721d0 con 0x7fbc60071d40 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc68061640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc60161d80 con 0x7fbc6006abe0 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc68061640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601612d0 con 0x7fbc601465d0 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc655fc640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbc60071d40 0x7fbc6006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38562/0 (socket says 172.21.15.8:38562) 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc655fc640 1 -- 172.21.15.8:0/843802210 learned_addr learned my addr 172.21.15.8:0/843802210 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc665fe640 1 --2- 172.21.15.8:0/843802210 >> v2:172.21.15.116:3300/0 conn(0x7fbc6006abe0 0x7fbc60160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 0x7fbc600b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403794445 0 0) 0x7fbc600721d0 con 0x7fbc60071d40 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:47.999+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc48003520 con 0x7fbc60071d40 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 582608477 0 0) 0x7fbc48003520 con 0x7fbc60071d40 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 msgr2=0x7fbc600b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 0x7fbc600b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 >> v2:172.21.15.116:3300/0 conn(0x7fbc6006abe0 msgr2=0x7fbc60160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 --2- 172.21.15.8:0/843802210 >> v2:172.21.15.116:3300/0 conn(0x7fbc6006abe0 0x7fbc60160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600cf790 con 0x7fbc60071d40 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fbc54001670 con 0x7fbc60071d40 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc665fe640 1 --2- 172.21.15.8:0/843802210 >> v2:172.21.15.116:3300/0 conn(0x7fbc6006abe0 0x7fbc60160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 >> v1:172.21.15.8:6789/0 conn(0x7fbc60071d40 legacy=0x7fbc6006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc480047c0 0x7fbc48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 0x7fbc48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60161d80 con 0x7fbc48003970 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601612d0 con 0x7fbc480047c0 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4800b980 con 0x7fbc601465d0 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc655fc640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc480047c0 0x7fbc48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc665fe640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 0x7fbc48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc65dfd640 1 -- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 msgr2=0x7fbc48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc601465d0 0x7fbc48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc65dfd640 1 -- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc480047c0 msgr2=0x7fbc48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc480047c0 0x7fbc48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.000+0000 7fbc65dfd640 1 -- 172.21.15.8:0/843802210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48003520 con 0x7fbc48003970 2023-11-18T23:41:48.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.001+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc48003d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009ac0 tx=0x7fbc480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72f722d5b2764cf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.001+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5802c6b0 con 0x7fbc48003970 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.001+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5802c810 con 0x7fbc48003970 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.001+0000 7fbc64dfb640 1 -- 172.21.15.8:0/843802210 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5802cba0 con 0x7fbc48003970 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.002+0000 7fbc68061640 1 -- 172.21.15.8:0/843802210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 msgr2=0x7fbc48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.002+0000 7fbc68061640 1 --2- 172.21.15.8:0/843802210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc48003d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009ac0 tx=0x7fbc480057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.002+0000 7fbc665fe640 1 -- 172.21.15.8:0/843802210 reap_dead start 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.002+0000 7fbc68061640 1 -- 172.21.15.8:0/843802210 shutdown_connections 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.002+0000 7fbc68061640 1 -- 172.21.15.8:0/843802210 >> 172.21.15.8:0/843802210 conn(0x7fbc600cc930 msgr2=0x7fbc600ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.002+0000 7fbc68061640 1 -- 172.21.15.8:0/843802210 shutdown_connections 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.002+0000 7fbc68061640 1 -- 172.21.15.8:0/843802210 wait complete. 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.003+0000 7fbc68061640 1 Processor -- start 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.003+0000 7fbc68061640 1 -- start start 2023-11-18T23:41:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc68061640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc60140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc68061640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6013f9f0 0x7fbc6013fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc68061640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc601403b0 0x7fbc60151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc68061640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b0050 con 0x7fbc48003970 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc68061640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600acef0 con 0x7fbc601403b0 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc68061640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601413e0 con 0x7fbc6013f9f0 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc60140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc60140ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50390/0 (socket says 172.21.15.8:50390) 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 -- 172.21.15.8:0/35026953 learned_addr learned my addr 172.21.15.8:0/35026953 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc655fc640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6013f9f0 0x7fbc6013fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc665fe640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc601403b0 0x7fbc60151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 -- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6013f9f0 msgr2=0x7fbc6013fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6013f9f0 0x7fbc6013fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 -- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc601403b0 msgr2=0x7fbc60151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc601403b0 0x7fbc60151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 -- 172.21.15.8:0/35026953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60140830 con 0x7fbc48003970 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc65dfd640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc60140ea0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbc58037040 tx=0x7fbc58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.004+0000 7fbc5e7fc640 1 -- 172.21.15.8:0/35026953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58003810 con 0x7fbc48003970 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.005+0000 7fbc5e7fc640 1 -- 172.21.15.8:0/35026953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc58003970 con 0x7fbc48003970 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.005+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600afd70 con 0x7fbc48003970 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.005+0000 7fbc5e7fc640 1 -- 172.21.15.8:0/35026953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58003ce0 con 0x7fbc48003970 2023-11-18T23:41:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.005+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6014fc70 con 0x7fbc48003970 2023-11-18T23:41:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.006+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6014f7f0 con 0x7fbc48003970 2023-11-18T23:41:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.006+0000 7fbc5e7fc640 1 -- 172.21.15.8:0/35026953 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc58034440 con 0x7fbc48003970 2023-11-18T23:41:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.006+0000 7fbc5e7fc640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc4c06ae70 0x7fbc4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.006+0000 7fbc5e7fc640 1 -- 172.21.15.8:0/35026953 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc580ab5b0 con 0x7fbc48003970 2023-11-18T23:41:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.007+0000 7fbc655fc640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc4c06ae70 0x7fbc4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.007+0000 7fbc655fc640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc4c06ae70 0x7fbc4c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc54001860 tx=0x7fbc54001e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.011+0000 7fbc5e7fc640 1 -- 172.21.15.8:0/35026953 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc6014f7f0 con 0x7fbc48003970 2023-11-18T23:41:48.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.185+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc6014f7f0 con 0x7fbc48003970 2023-11-18T23:41:48.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.186+0000 7fbc5e7fc640 1 -- 172.21.15.8:0/35026953 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc6014f7f0 con 0x7fbc48003970 2023-11-18T23:41:48.187 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.187+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc4c06ae70 msgr2=0x7fbc4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.187+0000 7fbc68061640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc4c06ae70 0x7fbc4c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc54001860 tx=0x7fbc54001e00 comp rx=0 tx=0).stop 2023-11-18T23:41:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.187+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 msgr2=0x7fbc60140ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.187+0000 7fbc68061640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc60140ea0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbc58037040 tx=0x7fbc58004730 comp rx=0 tx=0).stop 2023-11-18T23:41:48.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 shutdown_connections 2023-11-18T23:41:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbc4c06ae70 0x7fbc4c06d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc601403b0 0x7fbc60151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc6013f9f0 0x7fbc6013fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 --2- 172.21.15.8:0/35026953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc48003970 0x7fbc60140ea0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 >> 172.21.15.8:0/35026953 conn(0x7fbc600cc930 msgr2=0x7fbc600d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 shutdown_connections 2023-11-18T23:41:48.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.188+0000 7fbc68061640 1 -- 172.21.15.8:0/35026953 wait complete. 2023-11-18T23:41:48.200 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:48.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.308+0000 7f14ceee7640 1 Processor -- start 2023-11-18T23:41:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.308+0000 7f14ceee7640 1 -- start start 2023-11-18T23:41:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ceee7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f14c813f750 0x7f14c815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ceee7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c8070630 0x7f14c8070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ceee7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80ce060 con 0x7f14c813fb30 2023-11-18T23:41:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ceee7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80cec70 con 0x7f14c813f750 2023-11-18T23:41:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ceee7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80ce340 con 0x7f14c8070630 2023-11-18T23:41:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ccc83640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f14c813f750 0x7f14c815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14c7fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f14c813fb30 0x7f14c80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38574/0 (socket says 172.21.15.8:38574) 2023-11-18T23:41:48.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14c7fff640 1 -- 172.21.15.8:0/2991729282 learned_addr learned my addr 172.21.15.8:0/2991729282 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:48.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14cd484640 1 --2- 172.21.15.8:0/2991729282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c8070630 0x7f14c8070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ccc83640 1 -- 172.21.15.8:0/2991729282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c8070630 msgr2=0x7f14c8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:48.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ccc83640 1 --2- 172.21.15.8:0/2991729282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c8070630 0x7f14c8070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ccc83640 1 -- 172.21.15.8:0/2991729282 >> v1:172.21.15.8:6789/0 conn(0x7f14c813fb30 legacy=0x7f14c80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14ccc83640 1 -- 172.21.15.8:0/2991729282 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80ce620 con 0x7f14c813f750 2023-11-18T23:41:48.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.309+0000 7f14c77fe640 1 -- 172.21.15.8:0/2991729282 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210881653 0 0) 0x7f14c80ce060 con 0x7f14c813fb30 2023-11-18T23:41:48.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.310+0000 7f14ccc83640 1 --2- 172.21.15.8:0/2991729282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c815b0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f14b80097a0 tx=0x7f14b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee3494f5c3792e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.310+0000 7f14c77fe640 1 -- 172.21.15.8:0/2991729282 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8031830 con 0x7f14c813f750 2023-11-18T23:41:48.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.310+0000 7f14c77fe640 1 -- 172.21.15.8:0/2991729282 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8031990 con 0x7f14c813f750 2023-11-18T23:41:48.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.310+0000 7f14c77fe640 1 -- 172.21.15.8:0/2991729282 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8031d20 con 0x7f14c813f750 2023-11-18T23:41:48.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 -- 172.21.15.8:0/2991729282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 msgr2=0x7f14c815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 --2- 172.21.15.8:0/2991729282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c815b0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f14b80097a0 tx=0x7f14b802b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 -- 172.21.15.8:0/2991729282 shutdown_connections 2023-11-18T23:41:48.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 --2- 172.21.15.8:0/2991729282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c8070630 0x7f14c8070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 --2- 172.21.15.8:0/2991729282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c815b0d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 -- 172.21.15.8:0/2991729282 >> 172.21.15.8:0/2991729282 conn(0x7f14c806a8f0 msgr2=0x7f14c806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 -- 172.21.15.8:0/2991729282 shutdown_connections 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.311+0000 7f14ceee7640 1 -- 172.21.15.8:0/2991729282 wait complete. 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.312+0000 7f14ceee7640 1 Processor -- start 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.312+0000 7f14ceee7640 1 -- start start 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14ceee7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14c8070630 0x7f14c8154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14ceee7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c8137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14ceee7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c813fb30 0x7f14c815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14ceee7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8155e70 con 0x7f14c813f750 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14ceee7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81551f0 con 0x7f14c8070630 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14ceee7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81554d0 con 0x7f14c813fb30 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c8137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c8137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50408/0 (socket says 172.21.15.8:50408) 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 -- 172.21.15.8:0/1624975463 learned_addr learned my addr 172.21.15.8:0/1624975463 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14cd484640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c813fb30 0x7f14c815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14ccc83640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14c8070630 0x7f14c8154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 -- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c813fb30 msgr2=0x7f14c815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c813fb30 0x7f14c815e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 -- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14c8070630 msgr2=0x7f14c8154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14c8070630 0x7f14c8154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.313+0000 7f14c7fff640 1 -- 172.21.15.8:0/1624975463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b8009400 con 0x7f14c813f750 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.314+0000 7f14ccc83640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14c8070630 0x7f14c8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.314+0000 7f14c7fff640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c8137620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00c4a0 tx=0x7f14bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.314+0000 7f14c57fa640 1 -- 172.21.15.8:0/1624975463 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0074e0 con 0x7f14c813f750 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.314+0000 7f14c57fa640 1 -- 172.21.15.8:0/1624975463 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc007640 con 0x7f14c813f750 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.314+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c81557b0 con 0x7f14c813f750 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.314+0000 7f14c57fa640 1 -- 172.21.15.8:0/1624975463 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc004a00 con 0x7f14c813f750 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.314+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c8137b60 con 0x7f14c813f750 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.315+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c8155fb0 con 0x7f14c813f750 2023-11-18T23:41:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.315+0000 7f14c57fa640 1 -- 172.21.15.8:0/1624975463 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14bc004b60 con 0x7f14c813f750 2023-11-18T23:41:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.316+0000 7f14c57fa640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f14b406ae40 0x7f14b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.316+0000 7f14c57fa640 1 -- 172.21.15.8:0/1624975463 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14bc0887d0 con 0x7f14c813f750 2023-11-18T23:41:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.316+0000 7f14ccc83640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f14b406ae40 0x7f14b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.317+0000 7f14ccc83640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f14b406ae40 0x7f14b406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14b8036000 tx=0x7f14b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.320+0000 7f14c57fa640 1 -- 172.21.15.8:0/1624975463 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14c8155fb0 con 0x7f14c813f750 2023-11-18T23:41:48.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.495+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14c8155fb0 con 0x7f14c813f750 2023-11-18T23:41:48.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.495+0000 7f14c57fa640 1 -- 172.21.15.8:0/1624975463 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14c8155fb0 con 0x7f14c813f750 2023-11-18T23:41:48.497 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f14b406ae40 msgr2=0x7f14b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f14b406ae40 0x7f14b406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14b8036000 tx=0x7f14b8008030 comp rx=0 tx=0).stop 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 msgr2=0x7f14c8137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c8137620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00c4a0 tx=0x7f14bc00c960 comp rx=0 tx=0).stop 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 shutdown_connections 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f14b406ae40 0x7f14b406d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f14c813fb30 0x7f14c815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14c813f750 0x7f14c8137620 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 --2- 172.21.15.8:0/1624975463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14c8070630 0x7f14c8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 >> 172.21.15.8:0/1624975463 conn(0x7f14c806a8f0 msgr2=0x7f14c813e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:48.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 shutdown_connections 2023-11-18T23:41:48.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.497+0000 7f14ceee7640 1 -- 172.21.15.8:0/1624975463 wait complete. 2023-11-18T23:41:48.509 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:48.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.617+0000 7f982e7a0640 1 Processor -- start 2023-11-18T23:41:48.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.617+0000 7f982e7a0640 1 -- start start 2023-11-18T23:41:48.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.618+0000 7f982e7a0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f982806f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.618+0000 7f982e7a0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9828140910 0x7f9828071930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.618+0000 7f982e7a0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98280714a0 con 0x7f982806a4d0 2023-11-18T23:41:48.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.618+0000 7f982e7a0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98281411a0 con 0x7f9828140910 2023-11-18T23:41:48.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.618+0000 7f982e7a0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9828141480 con 0x7f982815afe0 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982cf9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9828140910 0x7f9828071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982d79e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f982806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982cf9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9828140910 0x7f9828071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:38164/0 (socket says 172.21.15.8:38164) 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982cf9d640 1 -- 172.21.15.8:0/46778053 learned_addr learned my addr 172.21.15.8:0/46778053 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982d79e640 1 -- 172.21.15.8:0/46778053 >> v2:172.21.15.116:3300/0 conn(0x7f9828140910 msgr2=0x7f9828071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982d79e640 1 --2- 172.21.15.8:0/46778053 >> v2:172.21.15.116:3300/0 conn(0x7f9828140910 0x7f9828071930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982d79e640 1 -- 172.21.15.8:0/46778053 >> v1:172.21.15.116:6789/0 conn(0x7f982806a4d0 legacy=0x7f98280ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982d79e640 1 -- 172.21.15.8:0/46778053 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828141760 con 0x7f982815afe0 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f981ffff640 1 -- 172.21.15.8:0/46778053 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575542354 0 0) 0x7f98280714a0 con 0x7f982806a4d0 2023-11-18T23:41:48.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.619+0000 7f982cf9d640 1 --2- 172.21.15.8:0/46778053 >> v2:172.21.15.116:3300/0 conn(0x7f9828140910 0x7f9828071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.620+0000 7f982d79e640 1 --2- 172.21.15.8:0/46778053 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f982806f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98200097a0 tx=0x7f982002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebaebf3c8c6300e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.620+0000 7f981ffff640 1 -- 172.21.15.8:0/46778053 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820031830 con 0x7f982815afe0 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.620+0000 7f981ffff640 1 -- 172.21.15.8:0/46778053 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820031990 con 0x7f982815afe0 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.620+0000 7f981ffff640 1 -- 172.21.15.8:0/46778053 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820031d20 con 0x7f982815afe0 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 -- 172.21.15.8:0/46778053 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 msgr2=0x7f982806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 --2- 172.21.15.8:0/46778053 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f982806f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98200097a0 tx=0x7f982002b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 -- 172.21.15.8:0/46778053 shutdown_connections 2023-11-18T23:41:48.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 --2- 172.21.15.8:0/46778053 >> v2:172.21.15.116:3300/0 conn(0x7f9828140910 0x7f9828071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 --2- 172.21.15.8:0/46778053 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f982806f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 -- 172.21.15.8:0/46778053 >> 172.21.15.8:0/46778053 conn(0x7f98280cfc10 msgr2=0x7f98280cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:48.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 -- 172.21.15.8:0/46778053 shutdown_connections 2023-11-18T23:41:48.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.621+0000 7f982e7a0640 1 -- 172.21.15.8:0/46778053 wait complete. 2023-11-18T23:41:48.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.622+0000 7f982e7a0640 1 Processor -- start 2023-11-18T23:41:48.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.622+0000 7f982e7a0640 1 -- start start 2023-11-18T23:41:48.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982e7a0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f982806a4d0 0x7f98281f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982e7a0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9828140910 0x7f9828156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982e7a0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f98280b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982e7a0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98281f1ab0 con 0x7f9828140910 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982e7a0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98281f5020 con 0x7f982806a4d0 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982e7a0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98281f44a0 con 0x7f982815afe0 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9828140910 0x7f9828156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9828140910 0x7f9828156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50424/0 (socket says 172.21.15.8:50424) 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 -- 172.21.15.8:0/114065791 learned_addr learned my addr 172.21.15.8:0/114065791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982d79e640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f982806a4d0 0x7f98281f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982df9f640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f98280b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 -- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 msgr2=0x7f98280b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f98280b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 -- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f982806a4d0 msgr2=0x7f98281f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f982806a4d0 0x7f98281f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 -- 172.21.15.8:0/114065791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180094d0 con 0x7f9828140910 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982cf9d640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9828140910 0x7f9828156af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f981800e9d0 tx=0x7f981800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f981dffb640 1 -- 172.21.15.8:0/114065791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800ca60 con 0x7f9828140910 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9820009400 con 0x7f9828140910 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f981dffb640 1 -- 172.21.15.8:0/114065791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981800cbc0 con 0x7f9828140910 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.623+0000 7f981dffb640 1 -- 172.21.15.8:0/114065791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818013470 con 0x7f9828140910 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.624+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98281f4a60 con 0x7f9828140910 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.625+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982804e840 con 0x7f9828140910 2023-11-18T23:41:48.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.625+0000 7f981dffb640 1 -- 172.21.15.8:0/114065791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98180135d0 con 0x7f9828140910 2023-11-18T23:41:48.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.626+0000 7f981dffb640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f980c06ae40 0x7f980c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.626+0000 7f981dffb640 1 -- 172.21.15.8:0/114065791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9818089880 con 0x7f9828140910 2023-11-18T23:41:48.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.626+0000 7f982d79e640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f980c06ae40 0x7f980c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.626+0000 7f982d79e640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f980c06ae40 0x7f980c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9820036000 tx=0x7f982003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.630+0000 7f981dffb640 1 -- 172.21.15.8:0/114065791 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98180549f0 con 0x7f9828140910 2023-11-18T23:41:48.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.805+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98280cb5d0 con 0x7f9828140910 2023-11-18T23:41:48.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.805+0000 7f981dffb640 1 -- 172.21.15.8:0/114065791 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9818058010 con 0x7f9828140910 2023-11-18T23:41:48.807 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f980c06ae40 msgr2=0x7f980c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f980c06ae40 0x7f980c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9820036000 tx=0x7f982003d040 comp rx=0 tx=0).stop 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9828140910 msgr2=0x7f9828156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9828140910 0x7f9828156af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f981800e9d0 tx=0x7f981800ee90 comp rx=0 tx=0).stop 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 shutdown_connections 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f980c06ae40 0x7f980c06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f982815afe0 0x7f98280b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9828140910 0x7f9828156af0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 --2- 172.21.15.8:0/114065791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f982806a4d0 0x7f98281f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 >> 172.21.15.8:0/114065791 conn(0x7f98280cfc10 msgr2=0x7f982806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:48.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 shutdown_connections 2023-11-18T23:41:48.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.807+0000 7f982e7a0640 1 -- 172.21.15.8:0/114065791 wait complete. 2023-11-18T23:41:48.819 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:48.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.926+0000 7f37f6361640 1 Processor -- start 2023-11-18T23:41:48.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.926+0000 7f37f6361640 1 -- start start 2023-11-18T23:41:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.926+0000 7f37f6361640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f37f00d1570 0x7f37f00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.926+0000 7f37f6361640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f00ce360 con 0x7f37f00cef00 2023-11-18T23:41:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.926+0000 7f37f6361640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f00d19f0 con 0x7f37f0160b70 2023-11-18T23:41:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.926+0000 7f37f6361640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f00cdd50 con 0x7f37f00d1570 2023-11-18T23:41:48.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.927+0000 7f37ef7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f37f00d1570 0x7f37f00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.927+0000 7f37f48fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f37f00cef00 0x7f37f0161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38584/0 (socket says 172.21.15.8:38584) 2023-11-18T23:41:48.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.927+0000 7f37f48fe640 1 -- 172.21.15.8:0/3645872252 learned_addr learned my addr 172.21.15.8:0/3645872252 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:48.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.927+0000 7f37ef7fe640 1 -- 172.21.15.8:0/3645872252 >> v1:172.21.15.116:6789/0 conn(0x7f37f0160b70 legacy=0x7f37f00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:48.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.927+0000 7f37ef7fe640 1 -- 172.21.15.8:0/3645872252 >> v1:172.21.15.8:6789/0 conn(0x7f37f00cef00 legacy=0x7f37f0161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.927+0000 7f37ef7fe640 1 -- 172.21.15.8:0/3645872252 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00d1c70 con 0x7f37f00d1570 2023-11-18T23:41:48.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.927+0000 7f37eeffd640 1 -- 172.21.15.8:0/3645872252 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147144210 0 0) 0x7f37f00ce360 con 0x7f37f00cef00 2023-11-18T23:41:48.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37ef7fe640 1 --2- 172.21.15.8:0/3645872252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b2aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37e40097a0 tx=0x7f37e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f700e1a6d9e123f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37eeffd640 1 -- 172.21.15.8:0/3645872252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4031830 con 0x7f37f00d1570 2023-11-18T23:41:48.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37eeffd640 1 -- 172.21.15.8:0/3645872252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e4031990 con 0x7f37f00d1570 2023-11-18T23:41:48.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37eeffd640 1 -- 172.21.15.8:0/3645872252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4031d20 con 0x7f37f00d1570 2023-11-18T23:41:48.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37f6361640 1 -- 172.21.15.8:0/3645872252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 msgr2=0x7f37f00b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37f6361640 1 --2- 172.21.15.8:0/3645872252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b2aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37e40097a0 tx=0x7f37e402b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37f6361640 1 -- 172.21.15.8:0/3645872252 shutdown_connections 2023-11-18T23:41:48.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37f6361640 1 --2- 172.21.15.8:0/3645872252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b2aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37f6361640 1 -- 172.21.15.8:0/3645872252 >> 172.21.15.8:0/3645872252 conn(0x7f37f009c470 msgr2=0x7f37f00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:48.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37f6361640 1 -- 172.21.15.8:0/3645872252 shutdown_connections 2023-11-18T23:41:48.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.928+0000 7f37f6361640 1 -- 172.21.15.8:0/3645872252 wait complete. 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.929+0000 7f37f6361640 1 Processor -- start 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37f6361640 1 -- start start 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37f6361640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f00cef00 0x7f37f01f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37f6361640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37f6361640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37f0160b70 0x7f37f0153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37f6361640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00b69a0 con 0x7f37f00d1570 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37f6361640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00b5d90 con 0x7f37f00cef00 2023-11-18T23:41:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37f6361640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00b6070 con 0x7f37f0160b70 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37ef7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.930+0000 7f37ef7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50454/0 (socket says 172.21.15.8:50454) 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ef7fe640 1 -- 172.21.15.8:0/639625554 learned_addr learned my addr 172.21.15.8:0/639625554 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37effff640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f00cef00 0x7f37f01f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ef7fe640 1 -- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37f0160b70 msgr2=0x7f37f0153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ef7fe640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37f0160b70 0x7f37f0153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ef7fe640 1 -- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f00cef00 msgr2=0x7f37f01f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ef7fe640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f00cef00 0x7f37f01f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ef7fe640 1 -- 172.21.15.8:0/639625554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4009400 con 0x7f37f00d1570 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37effff640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f00cef00 0x7f37f01f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:48.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ef7fe640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b3a80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37e40098c0 tx=0x7f37e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ecff9640 1 -- 172.21.15.8:0/639625554 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e403ba70 con 0x7f37f00d1570 2023-11-18T23:41:48.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ecff9640 1 -- 172.21.15.8:0/639625554 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e403bbd0 con 0x7f37f00d1570 2023-11-18T23:41:48.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f00b6350 con 0x7f37f00d1570 2023-11-18T23:41:48.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37ecff9640 1 -- 172.21.15.8:0/639625554 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40453f0 con 0x7f37f00d1570 2023-11-18T23:41:48.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.931+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f00ccaa0 con 0x7f37f00d1570 2023-11-18T23:41:48.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.932+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f00b6b10 con 0x7f37f00d1570 2023-11-18T23:41:48.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.933+0000 7f37ecff9640 1 -- 172.21.15.8:0/639625554 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37e404e450 con 0x7f37f00d1570 2023-11-18T23:41:48.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.933+0000 7f37ecff9640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f37dc06ae70 0x7f37dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:48.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.933+0000 7f37ecff9640 1 -- 172.21.15.8:0/639625554 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37e40ab880 con 0x7f37f00d1570 2023-11-18T23:41:48.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.933+0000 7f37effff640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f37dc06ae70 0x7f37dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:48.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.934+0000 7f37effff640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f37dc06ae70 0x7f37dc06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37e0003eb0 tx=0x7f37e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:48.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:48.937+0000 7f37ecff9640 1 -- 172.21.15.8:0/639625554 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37e4076930 con 0x7f37f00d1570 2023-11-18T23:41:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.127+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f37f00a1150 con 0x7f37f00d1570 2023-11-18T23:41:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.127+0000 7f37ecff9640 1 -- 172.21.15.8:0/639625554 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f37e4079f50 con 0x7f37f00d1570 2023-11-18T23:41:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f37dc06ae70 msgr2=0x7f37dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f37dc06ae70 0x7f37dc06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37e0003eb0 tx=0x7f37e0009040 comp rx=0 tx=0).stop 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 msgr2=0x7f37f00b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b3a80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37e40098c0 tx=0x7f37e40046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 shutdown_connections 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f37dc06ae70 0x7f37dc06d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37f0160b70 0x7f37f0153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37f00d1570 0x7f37f00b3a80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 --2- 172.21.15.8:0/639625554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f00cef00 0x7f37f01f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 >> 172.21.15.8:0/639625554 conn(0x7f37f009c470 msgr2=0x7f37f00d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.129+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 shutdown_connections 2023-11-18T23:41:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.130+0000 7f37f6361640 1 -- 172.21.15.8:0/639625554 wait complete. 2023-11-18T23:41:49.141 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi116.front.sepia.ceph.com... 2023-11-18T23:41:49.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:49.142 DEBUG:teuthology.orchestra.run.smithi116:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-18T23:41:49.178 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:41:49.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:41:49.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:49.178 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T23:41:49.289 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:41:49.290 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:49.306 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:41:49.306 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:49.365 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.510+0000 7fc6d351d640 1 Processor -- start 2023-11-18T23:41:49.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d351d640 1 -- start start 2023-11-18T23:41:49.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d351d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc6cc15d3e0 0x7fc6cc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d351d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6cc0ced30 0x7fc6cc0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d351d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0b5f90 con 0x7fc6cc0d1c60 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d351d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0cf170 con 0x7fc6cc0ced30 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d351d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0d20d0 con 0x7fc6cc15d3e0 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d0ab8640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6cc0ced30 0x7fc6cc0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d0ab8640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6cc0ced30 0x7fc6cc0d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50456/0 (socket says 172.21.15.8:50456) 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d1aba640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc6cc0d1c60 0x7fc6cc0b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38588/0 (socket says 172.21.15.8:38588) 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.511+0000 7fc6d0ab8640 1 -- 172.21.15.8:0/227887152 learned_addr learned my addr 172.21.15.8:0/227887152 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.512+0000 7fc6d12b9640 1 --2- 172.21.15.8:0/227887152 >> v2:172.21.15.116:3300/0 conn(0x7fc6cc15d3e0 0x7fc6cc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.512+0000 7fc6d0ab8640 1 -- 172.21.15.8:0/227887152 >> v2:172.21.15.116:3300/0 conn(0x7fc6cc15d3e0 msgr2=0x7fc6cc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.512+0000 7fc6d0ab8640 1 --2- 172.21.15.8:0/227887152 >> v2:172.21.15.116:3300/0 conn(0x7fc6cc15d3e0 0x7fc6cc0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.512+0000 7fc6d0ab8640 1 -- 172.21.15.8:0/227887152 >> v1:172.21.15.8:6789/0 conn(0x7fc6cc0d1c60 legacy=0x7fc6cc0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.512+0000 7fc6d0ab8640 1 -- 172.21.15.8:0/227887152 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0b61e0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.512+0000 7fc6cbfff640 1 -- 172.21.15.8:0/227887152 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002702366 0 0) 0x7fc6cc0b5f90 con 0x7fc6cc0d1c60 2023-11-18T23:41:49.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d0ab8640 1 --2- 172.21.15.8:0/227887152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0d1720 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc073e20 tx=0x7fc6c002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe3898b07293bb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6cbfff640 1 -- 172.21.15.8:0/227887152 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0030860 con 0x7fc6cc0ced30 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6cbfff640 1 -- 172.21.15.8:0/227887152 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c00309c0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6cbfff640 1 -- 172.21.15.8:0/227887152 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0030d50 con 0x7fc6cc0ced30 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 -- 172.21.15.8:0/227887152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 msgr2=0x7fc6cc0d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 --2- 172.21.15.8:0/227887152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0d1720 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc073e20 tx=0x7fc6c002b9a0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 -- 172.21.15.8:0/227887152 shutdown_connections 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 --2- 172.21.15.8:0/227887152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0d1720 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 --2- 172.21.15.8:0/227887152 >> v2:172.21.15.116:3300/0 conn(0x7fc6cc15d3e0 0x7fc6cc0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 -- 172.21.15.8:0/227887152 >> 172.21.15.8:0/227887152 conn(0x7fc6cc09c480 msgr2=0x7fc6cc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 -- 172.21.15.8:0/227887152 shutdown_connections 2023-11-18T23:41:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.513+0000 7fc6d351d640 1 -- 172.21.15.8:0/227887152 wait complete. 2023-11-18T23:41:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 Processor -- start 2023-11-18T23:41:49.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 -- start start 2023-11-18T23:41:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc6cc0d1c60 0x7fc6cc09ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6cc15d3e0 0x7fc6cc09ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc149a00 con 0x7fc6cc0ced30 2023-11-18T23:41:49.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc148df0 con 0x7fc6cc15d3e0 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d351d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1490d0 con 0x7fc6cc0d1c60 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d12b9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d12b9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50468/0 (socket says 172.21.15.8:50468) 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.515+0000 7fc6d12b9640 1 -- 172.21.15.8:0/2958022535 learned_addr learned my addr 172.21.15.8:0/2958022535 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d1aba640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6cc15d3e0 0x7fc6cc09ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d0ab8640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc6cc0d1c60 0x7fc6cc09ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d12b9640 1 -- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc6cc0d1c60 msgr2=0x7fc6cc09ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d12b9640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc6cc0d1c60 0x7fc6cc09ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d12b9640 1 -- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6cc15d3e0 msgr2=0x7fc6cc09ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d12b9640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6cc15d3e0 0x7fc6cc09ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d12b9640 1 -- 172.21.15.8:0/2958022535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00094d0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d1aba640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6cc15d3e0 0x7fc6cc09ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d0ab8640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc6cc0d1c60 0x7fc6cc09ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d12b9640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0c8ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400d5f0 tx=0x7fc6c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6c9ffb640 1 -- 172.21.15.8:0/2958022535 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40125f0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6c9ffb640 1 -- 172.21.15.8:0/2958022535 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c4012750 con 0x7fc6cc0ced30 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc1493b0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6c9ffb640 1 -- 172.21.15.8:0/2958022535 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4012b00 con 0x7fc6cc0ced30 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.516+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc09efa0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.517+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc073e70 con 0x7fc6cc0ced30 2023-11-18T23:41:49.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.518+0000 7fc6c9ffb640 1 -- 172.21.15.8:0/2958022535 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6c4012c60 con 0x7fc6cc0ced30 2023-11-18T23:41:49.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.518+0000 7fc6c9ffb640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc6b806ae40 0x7fc6b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.518+0000 7fc6c9ffb640 1 -- 172.21.15.8:0/2958022535 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c4089a60 con 0x7fc6cc0ced30 2023-11-18T23:41:49.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.518+0000 7fc6d0ab8640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc6b806ae40 0x7fc6b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.519+0000 7fc6d0ab8640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc6b806ae40 0x7fc6b806d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0036000 tx=0x7fc6c003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:49.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.523+0000 7fc6c9ffb640 1 -- 172.21.15.8:0/2958022535 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6c4054ba0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.701+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6cc067420 con 0x7fc6cc0ced30 2023-11-18T23:41:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.703+0000 7fc6c9ffb640 1 -- 172.21.15.8:0/2958022535 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7fc6c40581c0 con 0x7fc6cc0ced30 2023-11-18T23:41:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:49.704 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc6b806ae40 msgr2=0x7fc6b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc6b806ae40 0x7fc6b806d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0036000 tx=0x7fc6c003b040 comp rx=0 tx=0).stop 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 msgr2=0x7fc6cc0c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0c8ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400d5f0 tx=0x7fc6c400dab0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 shutdown_connections 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc6b806ae40 0x7fc6b806d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6cc15d3e0 0x7fc6cc09ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc6cc0d1c60 0x7fc6cc09ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 --2- 172.21.15.8:0/2958022535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6cc0ced30 0x7fc6cc0c8ee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 >> 172.21.15.8:0/2958022535 conn(0x7fc6cc09c480 msgr2=0x7fc6cc15ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 shutdown_connections 2023-11-18T23:41:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.705+0000 7fc6d351d640 1 -- 172.21.15.8:0/2958022535 wait complete. 2023-11-18T23:41:49.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:49.717 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:49.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.826+0000 7fb0baa15640 1 Processor -- start 2023-11-18T23:41:49.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.826+0000 7fb0baa15640 1 -- start start 2023-11-18T23:41:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.826+0000 7fb0baa15640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b40d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.826+0000 7fb0baa15640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0b40b2aa0 0x7fb0b40ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.826+0000 7fb0baa15640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b40ce360 con 0x7fb0b40ced30 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.826+0000 7fb0baa15640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40b2f20 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.826+0000 7fb0baa15640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40cdd50 con 0x7fb0b4160b70 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b37fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0b40b2aa0 0x7fb0b40ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b8fb2640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb0b40ced30 0x7fb0b40cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38602/0 (socket says 172.21.15.8:38602) 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b8fb2640 1 -- 172.21.15.8:0/3468949864 learned_addr learned my addr 172.21.15.8:0/3468949864 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b3fff640 1 --2- 172.21.15.8:0/3468949864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b40d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b37fe640 1 -- 172.21.15.8:0/3468949864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 msgr2=0x7fb0b40d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b37fe640 1 --2- 172.21.15.8:0/3468949864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b40d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b37fe640 1 -- 172.21.15.8:0/3468949864 >> v1:172.21.15.8:6789/0 conn(0x7fb0b40ced30 legacy=0x7fb0b40cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b2ffd640 1 -- 172.21.15.8:0/3468949864 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487821721 0 0) 0x7fb0b40ce360 con 0x7fb0b40ced30 2023-11-18T23:41:49.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b37fe640 1 -- 172.21.15.8:0/3468949864 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40d1c70 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.827+0000 7fb0b3fff640 1 --2- 172.21.15.8:0/3468949864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b40d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0b37fe640 1 --2- 172.21.15.8:0/3468949864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b40ce7f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80097a0 tx=0x7fb0a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8ca5a2976cb952 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0b2ffd640 1 -- 172.21.15.8:0/3468949864 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8031830 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0b2ffd640 1 -- 172.21.15.8:0/3468949864 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8031990 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0b2ffd640 1 -- 172.21.15.8:0/3468949864 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8031d20 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 -- 172.21.15.8:0/3468949864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 msgr2=0x7fb0b40ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3468949864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b40ce7f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80097a0 tx=0x7fb0a802b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 -- 172.21.15.8:0/3468949864 shutdown_connections 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3468949864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b40ce7f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3468949864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b40d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 -- 172.21.15.8:0/3468949864 >> 172.21.15.8:0/3468949864 conn(0x7fb0b409c470 msgr2=0x7fb0b40d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 -- 172.21.15.8:0/3468949864 shutdown_connections 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.828+0000 7fb0baa15640 1 -- 172.21.15.8:0/3468949864 wait complete. 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 Processor -- start 2023-11-18T23:41:49.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 -- start start 2023-11-18T23:41:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b40ced30 0x7fb0b40b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40b68a0 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40b6b80 con 0x7fb0b40ced30 2023-11-18T23:41:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.830+0000 7fb0baa15640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40b6e60 con 0x7fb0b4160b70 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b414e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50496/0 (socket says 172.21.15.8:50496) 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 -- 172.21.15.8:0/3481702607 learned_addr learned my addr 172.21.15.8:0/3481702607 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b8fb2640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 -- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 msgr2=0x7fb0b415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b37fe640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b40ced30 0x7fb0b40b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b415ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 -- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b40ced30 msgr2=0x7fb0b40b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b40ced30 0x7fb0b40b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 -- 172.21.15.8:0/3481702607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a8009400 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b37fe640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b40ced30 0x7fb0b40b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b3fff640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b414e590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c7f0 tx=0x7fb0a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:49.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b0ff9640 1 -- 172.21.15.8:0/3481702607 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007820 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b0ff9640 1 -- 172.21.15.8:0/3481702607 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4007980 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b40b7140 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0b0ff9640 1 -- 172.21.15.8:0/3481702607 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007cf0 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.831+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b40b89c0 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.832+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b40a1150 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.833+0000 7fb0b0ff9640 1 -- 172.21.15.8:0/3481702607 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0a40113f0 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.833+0000 7fb0b0ff9640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb0a006ae40 0x7fb0a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.833+0000 7fb0b0ff9640 1 -- 172.21.15.8:0/3481702607 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0a4089a60 con 0x7fb0b40b2aa0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.833+0000 7fb0b37fe640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb0a006ae40 0x7fb0a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:49.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.834+0000 7fb0b37fe640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb0a006ae40 0x7fb0a006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8036000 tx=0x7fb0a8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:49.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:49.838+0000 7fb0b0ff9640 1 -- 172.21.15.8:0/3481702607 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0a4054a00 con 0x7fb0b40b2aa0 2023-11-18T23:41:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.012+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0b40b22d0 con 0x7fb0b40b2aa0 2023-11-18T23:41:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.012+0000 7fb0b0ff9640 1 -- 172.21.15.8:0/3481702607 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0a401f020 con 0x7fb0b40b2aa0 2023-11-18T23:41:50.014 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:50.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb0a006ae40 msgr2=0x7fb0a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb0a006ae40 0x7fb0a006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8036000 tx=0x7fb0a8008030 comp rx=0 tx=0).stop 2023-11-18T23:41:50.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 msgr2=0x7fb0b414e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b414e590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c7f0 tx=0x7fb0a400ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 shutdown_connections 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fb0a006ae40 0x7fb0a006d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb0b4160b70 0x7fb0b415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0b40ced30 0x7fb0b40b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 --2- 172.21.15.8:0/3481702607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0b40b2aa0 0x7fb0b414e590 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 >> 172.21.15.8:0/3481702607 conn(0x7fb0b409c470 msgr2=0x7fb0b40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 shutdown_connections 2023-11-18T23:41:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.015+0000 7fb0baa15640 1 -- 172.21.15.8:0/3481702607 wait complete. 2023-11-18T23:41:50.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:50.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.136+0000 7f348d626640 1 Processor -- start 2023-11-18T23:41:50.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.136+0000 7f348d626640 1 -- start start 2023-11-18T23:41:50.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f348d626640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f348815e810 0x7f34880ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f348d626640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f34880cd540 0x7f348809a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f348d626640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34880cd170 con 0x7f348815ebf0 2023-11-18T23:41:50.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f348d626640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34880b2260 con 0x7f34880cd540 2023-11-18T23:41:50.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f348d626640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880b37b0 con 0x7f348815e810 2023-11-18T23:41:50.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f34877fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f34880cd540 0x7f348809a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f34877fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f34880cd540 0x7f348809a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50504/0 (socket says 172.21.15.8:50504) 2023-11-18T23:41:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f34877fe640 1 -- 172.21.15.8:0/2189590307 learned_addr learned my addr 172.21.15.8:0/2189590307 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f3486ffd640 1 --2- 172.21.15.8:0/2189590307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f348815e810 0x7f34880ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f34877fe640 1 -- 172.21.15.8:0/2189590307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f348815e810 msgr2=0x7f34880ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f34877fe640 1 --2- 172.21.15.8:0/2189590307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f348815e810 0x7f34880ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f34877fe640 1 -- 172.21.15.8:0/2189590307 >> v1:172.21.15.116:6789/0 conn(0x7f348815ebf0 legacy=0x7f3488099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.137+0000 7f34877fe640 1 -- 172.21.15.8:0/2189590307 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880cc720 con 0x7f34880cd540 2023-11-18T23:41:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.138+0000 7f34877fe640 1 --2- 172.21.15.8:0/2189590307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34880cd540 0x7f348809a080 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3480009e50 tx=0x7f348002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125d2c18fc7fdeb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.138+0000 7f34867fc640 1 -- 172.21.15.8:0/2189590307 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348002cb00 con 0x7f34880cd540 2023-11-18T23:41:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.138+0000 7f34867fc640 1 -- 172.21.15.8:0/2189590307 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348002cc60 con 0x7f34880cd540 2023-11-18T23:41:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.138+0000 7f34867fc640 1 -- 172.21.15.8:0/2189590307 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34800343f0 con 0x7f34880cd540 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 -- 172.21.15.8:0/2189590307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34880cd540 msgr2=0x7f348809a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 --2- 172.21.15.8:0/2189590307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34880cd540 0x7f348809a080 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3480009e50 tx=0x7f348002bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 -- 172.21.15.8:0/2189590307 shutdown_connections 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 --2- 172.21.15.8:0/2189590307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34880cd540 0x7f348809a080 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 --2- 172.21.15.8:0/2189590307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f348815e810 0x7f34880ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 -- 172.21.15.8:0/2189590307 >> 172.21.15.8:0/2189590307 conn(0x7f34880b2a70 msgr2=0x7f34880b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 -- 172.21.15.8:0/2189590307 shutdown_connections 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.139+0000 7f348d626640 1 -- 172.21.15.8:0/2189590307 wait complete. 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.140+0000 7f348d626640 1 Processor -- start 2023-11-18T23:41:50.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.140+0000 7f348d626640 1 -- start start 2023-11-18T23:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f348d626640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34880cd540 0x7f348806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f348d626640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f348815e810 0x7f34880c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f348d626640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348815ebf0 0x7f34881f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f348d626640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880c78f0 con 0x7f348815ebf0 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f348d626640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880c69b0 con 0x7f348815e810 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f348d626640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880c5bf0 con 0x7f34880cd540 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348815ebf0 0x7f34881f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348815ebf0 0x7f34881f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50520/0 (socket says 172.21.15.8:50520) 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 -- 172.21.15.8:0/132664860 learned_addr learned my addr 172.21.15.8:0/132664860 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f3486ffd640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34880cd540 0x7f348806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f347ffff640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f348815e810 0x7f34880c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 -- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34880cd540 msgr2=0x7f348806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34880cd540 0x7f348806fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 -- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f348815e810 msgr2=0x7f34880c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f348815e810 0x7f34880c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.141+0000 7f34877fe640 1 -- 172.21.15.8:0/132664860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480009b30 con 0x7f348815ebf0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.142+0000 7f34877fe640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348815ebf0 0x7f34881f0100 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3480036040 tx=0x7f3480004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.142+0000 7f347f7fe640 1 -- 172.21.15.8:0/132664860 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480009510 con 0x7f348815ebf0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.142+0000 7f347f7fe640 1 -- 172.21.15.8:0/132664860 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348003e450 con 0x7f348815ebf0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.142+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34880c5ed0 con 0x7f348815ebf0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.142+0000 7f347f7fe640 1 -- 172.21.15.8:0/132664860 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348003e7e0 con 0x7f348815ebf0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.142+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34880c6490 con 0x7f348815ebf0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.143+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3488067940 con 0x7f348815ebf0 2023-11-18T23:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.143+0000 7f347f7fe640 1 -- 172.21.15.8:0/132664860 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f348003e940 con 0x7f348815ebf0 2023-11-18T23:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.144+0000 7f347f7fe640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f346806ae70 0x7f346806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.144+0000 7f347f7fe640 1 -- 172.21.15.8:0/132664860 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34800abfc0 con 0x7f348815ebf0 2023-11-18T23:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.144+0000 7f3486ffd640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f346806ae70 0x7f346806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.144+0000 7f3486ffd640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f346806ae70 0x7f346806d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3478006fd0 tx=0x7f3478008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.148+0000 7f347f7fe640 1 -- 172.21.15.8:0/132664860 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34800dee90 con 0x7f348815ebf0 2023-11-18T23:41:50.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.323+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34880c6680 con 0x7f348815ebf0 2023-11-18T23:41:50.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.324+0000 7f347f7fe640 1 -- 172.21.15.8:0/132664860 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3480077120 con 0x7f348815ebf0 2023-11-18T23:41:50.325 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f346806ae70 msgr2=0x7f346806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f346806ae70 0x7f346806d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3478006fd0 tx=0x7f3478008040 comp rx=0 tx=0).stop 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348815ebf0 msgr2=0x7f34881f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348815ebf0 0x7f34881f0100 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3480036040 tx=0x7f3480004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 shutdown_connections 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f346806ae70 0x7f346806d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348815ebf0 0x7f34881f0100 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f348815e810 0x7f34880c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 --2- 172.21.15.8:0/132664860 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34880cd540 0x7f348806fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 >> 172.21.15.8:0/132664860 conn(0x7f34880b2a70 msgr2=0x7f34880b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.325+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 shutdown_connections 2023-11-18T23:41:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.326+0000 7f348d626640 1 -- 172.21.15.8:0/132664860 wait complete. 2023-11-18T23:41:50.338 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.446+0000 7f447f39e640 1 Processor -- start 2023-11-18T23:41:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.446+0000 7f447f39e640 1 -- start start 2023-11-18T23:41:50.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447f39e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f44780cecd0 0x7f447815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447f39e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44780b19b0 0x7f44780cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447f39e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780b2d20 con 0x7f447815d8f0 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447f39e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780cf5f0 con 0x7f44780b19b0 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447f39e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780b21a0 con 0x7f44780cecd0 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447db9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44780b19b0 0x7f44780cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447db9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f44780b19b0 0x7f44780cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50536/0 (socket says 172.21.15.8:50536) 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447db9b640 1 -- 172.21.15.8:0/2895557175 learned_addr learned my addr 172.21.15.8:0/2895557175 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447e39c640 1 --2- 172.21.15.8:0/2895557175 >> v2:172.21.15.116:3300/0 conn(0x7f44780cecd0 0x7f447815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447db9b640 1 -- 172.21.15.8:0/2895557175 >> v2:172.21.15.116:3300/0 conn(0x7f44780cecd0 msgr2=0x7f447815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447db9b640 1 --2- 172.21.15.8:0/2895557175 >> v2:172.21.15.116:3300/0 conn(0x7f44780cecd0 0x7f447815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447db9b640 1 -- 172.21.15.8:0/2895557175 >> v1:172.21.15.116:6789/0 conn(0x7f447815d8f0 legacy=0x7f447815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.447+0000 7f447db9b640 1 -- 172.21.15.8:0/2895557175 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780b2480 con 0x7f44780b19b0 2023-11-18T23:41:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.448+0000 7f447db9b640 1 --2- 172.21.15.8:0/2895557175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44780b19b0 0x7f44780cf0b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f447806b4f0 tx=0x7f446c02db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51053b0118efdf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.448+0000 7f447d39a640 1 -- 172.21.15.8:0/2895557175 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c02f8e0 con 0x7f44780b19b0 2023-11-18T23:41:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.448+0000 7f447d39a640 1 -- 172.21.15.8:0/2895557175 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c02fa40 con 0x7f44780b19b0 2023-11-18T23:41:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.448+0000 7f447d39a640 1 -- 172.21.15.8:0/2895557175 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c02fdd0 con 0x7f44780b19b0 2023-11-18T23:41:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.448+0000 7f447f39e640 1 -- 172.21.15.8:0/2895557175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44780b19b0 msgr2=0x7f44780cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.448+0000 7f447f39e640 1 --2- 172.21.15.8:0/2895557175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44780b19b0 0x7f44780cf0b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f447806b4f0 tx=0x7f446c02db20 comp rx=0 tx=0).stop 2023-11-18T23:41:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.449+0000 7f447f39e640 1 -- 172.21.15.8:0/2895557175 shutdown_connections 2023-11-18T23:41:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.449+0000 7f447f39e640 1 --2- 172.21.15.8:0/2895557175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44780b19b0 0x7f44780cf0b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.449+0000 7f447f39e640 1 --2- 172.21.15.8:0/2895557175 >> v2:172.21.15.116:3300/0 conn(0x7f44780cecd0 0x7f447815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.449+0000 7f447f39e640 1 -- 172.21.15.8:0/2895557175 >> 172.21.15.8:0/2895557175 conn(0x7f447806a6b0 msgr2=0x7f447806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.449+0000 7f447f39e640 1 -- 172.21.15.8:0/2895557175 shutdown_connections 2023-11-18T23:41:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.449+0000 7f447f39e640 1 -- 172.21.15.8:0/2895557175 wait complete. 2023-11-18T23:41:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.450+0000 7f447f39e640 1 Processor -- start 2023-11-18T23:41:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.450+0000 7f447f39e640 1 -- start start 2023-11-18T23:41:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447f39e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44780b19b0 0x7f44780ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447f39e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44780cecd0 0x7f4478151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447f39e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447815d8f0 0x7f4478155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447f39e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780cd530 con 0x7f447815d8f0 2023-11-18T23:41:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447f39e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780cd810 con 0x7f44780b19b0 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447f39e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780cdaf0 con 0x7f44780cecd0 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447815d8f0 0x7f4478155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447815d8f0 0x7f4478155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50540/0 (socket says 172.21.15.8:50540) 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 -- 172.21.15.8:0/3471156670 learned_addr learned my addr 172.21.15.8:0/3471156670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447e39c640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44780b19b0 0x7f44780ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447db9b640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44780cecd0 0x7f4478151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 -- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44780cecd0 msgr2=0x7f4478151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44780cecd0 0x7f4478151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 -- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44780b19b0 msgr2=0x7f44780ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44780b19b0 0x7f44780ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 -- 172.21.15.8:0/3471156670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0094d0 con 0x7f447815d8f0 2023-11-18T23:41:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.451+0000 7f447eb9d640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447815d8f0 0x7f4478155b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f446800c6b0 tx=0x7f446800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.452+0000 7f4476ffd640 1 -- 172.21.15.8:0/3471156670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468003b70 con 0x7f447815d8f0 2023-11-18T23:41:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.452+0000 7f4476ffd640 1 -- 172.21.15.8:0/3471156670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4468003cf0 con 0x7f447815d8f0 2023-11-18T23:41:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.452+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44780cddd0 con 0x7f447815d8f0 2023-11-18T23:41:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.452+0000 7f4476ffd640 1 -- 172.21.15.8:0/3471156670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468003ea0 con 0x7f447815d8f0 2023-11-18T23:41:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.452+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44781560d0 con 0x7f447815d8f0 2023-11-18T23:41:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.453+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44780cdfc0 con 0x7f447815d8f0 2023-11-18T23:41:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.453+0000 7f4476ffd640 1 -- 172.21.15.8:0/3471156670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4468005310 con 0x7f447815d8f0 2023-11-18T23:41:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.453+0000 7f4476ffd640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f446406ae40 0x7f446406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.454+0000 7f4476ffd640 1 -- 172.21.15.8:0/3471156670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44680891e0 con 0x7f447815d8f0 2023-11-18T23:41:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.454+0000 7f447e39c640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f446406ae40 0x7f446406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.454+0000 7f447e39c640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f446406ae40 0x7f446406d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f44780cb000 tx=0x7f4470009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.458+0000 7f4476ffd640 1 -- 172.21.15.8:0/3471156670 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44680543d0 con 0x7f447815d8f0 2023-11-18T23:41:50.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.632+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f447804e840 con 0x7f447815d8f0 2023-11-18T23:41:50.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.633+0000 7f4476ffd640 1 -- 172.21.15.8:0/3471156670 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44680579f0 con 0x7f447815d8f0 2023-11-18T23:41:50.635 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:50.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f446406ae40 msgr2=0x7f446406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f446406ae40 0x7f446406d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f44780cb000 tx=0x7f4470009190 comp rx=0 tx=0).stop 2023-11-18T23:41:50.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447815d8f0 msgr2=0x7f4478155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447815d8f0 0x7f4478155b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f446800c6b0 tx=0x7f446800cb70 comp rx=0 tx=0).stop 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 shutdown_connections 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f446406ae40 0x7f446406d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447815d8f0 0x7f4478155b90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44780cecd0 0x7f4478151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 --2- 172.21.15.8:0/3471156670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44780b19b0 0x7f44780ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 >> 172.21.15.8:0/3471156670 conn(0x7f447806a6b0 msgr2=0x7f4478153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 shutdown_connections 2023-11-18T23:41:50.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.635+0000 7f447f39e640 1 -- 172.21.15.8:0/3471156670 wait complete. 2023-11-18T23:41:50.647 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.752+0000 7f4001290640 1 Processor -- start 2023-11-18T23:41:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.753+0000 7f4001290640 1 -- start start 2023-11-18T23:41:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.753+0000 7f4001290640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3ffc160b70 0x7f3ffc0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.753+0000 7f4001290640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0ce360 con 0x7f3ffc0cef00 2023-11-18T23:41:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.753+0000 7f4001290640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0b2f20 con 0x7f3ffc0b2aa0 2023-11-18T23:41:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.753+0000 7f4001290640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cdd50 con 0x7f3ffc160b70 2023-11-18T23:41:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.753+0000 7f3ffb7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3ffc0cef00 0x7f3ffc161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38618/0 (socket says 172.21.15.8:38618) 2023-11-18T23:41:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.753+0000 7f3ffb7fe640 1 -- 172.21.15.8:0/416346518 learned_addr learned my addr 172.21.15.8:0/416346518 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/416346518 >> v2:172.21.15.116:3300/0 conn(0x7f3ffc160b70 0x7f3ffc0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110767203 0 0) 0x7f3ffc0ce360 con 0x7f3ffc0cef00 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe4003520 con 0x7f3ffc0cef00 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3594002216 0 0) 0x7f3fe4003520 con 0x7f3ffc0cef00 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 >> v2:172.21.15.116:3300/0 conn(0x7f3ffc160b70 msgr2=0x7f3ffc0d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 --2- 172.21.15.8:0/416346518 >> v2:172.21.15.116:3300/0 conn(0x7f3ffc160b70 0x7f3ffc0d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 >> v1:172.21.15.116:6789/0 conn(0x7f3ffc0b2aa0 legacy=0x7f3ffc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0d1c70 con 0x7f3ffc0cef00 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f3fec0019f0 con 0x7f3ffc0cef00 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 >> v1:172.21.15.8:6789/0 conn(0x7f3ffc0cef00 legacy=0x7f3ffc161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe4003970 0x7f3fe4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4004370 0x7f3fe4004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3fe4005040 0x7f3fe400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cdd50 con 0x7f3fe4003970 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe400bfa0 con 0x7f3fe4004370 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe400c160 con 0x7f3fe4005040 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe4003970 0x7f3fe4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ffa7fc640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4004370 0x7f3fe4004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.754+0000 7f3ffb7fe640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3fe4005040 0x7f3fe400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ffaffd640 1 -- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3fe4005040 msgr2=0x7f3fe400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3fe4005040 0x7f3fe400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ffaffd640 1 -- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4004370 msgr2=0x7f3fe4004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4004370 0x7f3fe4004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ffb7fe640 1 -- 172.21.15.8:0/416346518 reap_dead start 2023-11-18T23:41:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ffaffd640 1 -- 172.21.15.8:0/416346518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4003520 con 0x7f3fe4003970 2023-11-18T23:41:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe4003970 0x7f3fe4003d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009ac0 tx=0x7f3fe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce788fd96095bca server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff402c6d0 con 0x7f3fe4003970 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff402c830 con 0x7f3fe4003970 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.755+0000 7f3ff9ffb640 1 -- 172.21.15.8:0/416346518 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff402cbc0 con 0x7f3fe4003970 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.756+0000 7f4001290640 1 -- 172.21.15.8:0/416346518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe4003970 msgr2=0x7f3fe4003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.756+0000 7f4001290640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe4003970 0x7f3fe4003d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009ac0 tx=0x7f3fe40057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.756+0000 7f4001290640 1 -- 172.21.15.8:0/416346518 shutdown_connections 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.756+0000 7f4001290640 1 --2- 172.21.15.8:0/416346518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe4003970 0x7f3fe4003d50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.756+0000 7f4001290640 1 -- 172.21.15.8:0/416346518 >> 172.21.15.8:0/416346518 conn(0x7f3ffc09c470 msgr2=0x7f3ffc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.756+0000 7f4001290640 1 -- 172.21.15.8:0/416346518 shutdown_connections 2023-11-18T23:41:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.756+0000 7f4001290640 1 -- 172.21.15.8:0/416346518 wait complete. 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.757+0000 7f4001290640 1 Processor -- start 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.757+0000 7f4001290640 1 -- start start 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f4001290640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4003970 0x7f3ffc1f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f4001290640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc0c8ed0 0x7f3ffc0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f4001290640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ffc0cad60 0x7f3ffc0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f4001290640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cc6a0 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f4001290640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cba90 con 0x7f3fe4003970 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f4001290640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cbd70 con 0x7f3ffc0cad60 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f3ffa7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc0c8ed0 0x7f3ffc0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f3ffa7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc0c8ed0 0x7f3ffc0c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50564/0 (socket says 172.21.15.8:50564) 2023-11-18T23:41:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f3ffa7fc640 1 -- 172.21.15.8:0/2438470937 learned_addr learned my addr 172.21.15.8:0/2438470937 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f3ffb7fe640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ffc0cad60 0x7f3ffc0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.758+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4003970 0x7f3ffc1f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3ffa7fc640 1 -- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ffc0cad60 msgr2=0x7f3ffc0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3ffa7fc640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ffc0cad60 0x7f3ffc0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3ffa7fc640 1 -- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4003970 msgr2=0x7f3ffc1f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3ffa7fc640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4003970 0x7f3ffc1f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3ffa7fc640 1 -- 172.21.15.8:0/2438470937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0cc050 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4003970 0x7f3ffc1f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3ffa7fc640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc0c8ed0 0x7f3ffc0c9350 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000f770 tx=0x7f3ff000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3fe37fe640 1 -- 172.21.15.8:0/2438470937 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000fe80 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3fe37fe640 1 -- 172.21.15.8:0/2438470937 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff00052e0 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc0cc330 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f3fe37fe640 1 -- 172.21.15.8:0/2438470937 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000d970 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.759+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc0cb750 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.760+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc0a1150 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.760+0000 7f3fe37fe640 1 -- 172.21.15.8:0/2438470937 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ff000dad0 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.761+0000 7f3fe37fe640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3fe806ae70 0x7f3fe806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.761+0000 7f3fe37fe640 1 -- 172.21.15.8:0/2438470937 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ff0089590 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.761+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3fe806ae70 0x7f3fe806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.762+0000 7f3ffaffd640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3fe806ae70 0x7f3fe806d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4036000 tx=0x7f3ff4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:50.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.766+0000 7f3fe37fe640 1 -- 172.21.15.8:0/2438470937 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ff0054640 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.955+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ffc0678b0 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.956+0000 7f3fe37fe640 1 -- 172.21.15.8:0/2438470937 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ff0057c60 con 0x7f3ffc0c8ed0 2023-11-18T23:41:50.957 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:50.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.957+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3fe806ae70 msgr2=0x7f3fe806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.957+0000 7f4001290640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3fe806ae70 0x7f3fe806d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4036000 tx=0x7f3ff4030000 comp rx=0 tx=0).stop 2023-11-18T23:41:50.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.957+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc0c8ed0 msgr2=0x7f3ffc0c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:50.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.957+0000 7f4001290640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc0c8ed0 0x7f3ffc0c9350 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000f770 tx=0x7f3ff000fc30 comp rx=0 tx=0).stop 2023-11-18T23:41:50.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 shutdown_connections 2023-11-18T23:41:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3fe806ae70 0x7f3fe806d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ffc0cad60 0x7f3ffc0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc0c8ed0 0x7f3ffc0c9350 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 --2- 172.21.15.8:0/2438470937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fe4003970 0x7f3ffc1f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 >> 172.21.15.8:0/2438470937 conn(0x7f3ffc09c470 msgr2=0x7f3ffc0d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 shutdown_connections 2023-11-18T23:41:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:50.958+0000 7f4001290640 1 -- 172.21.15.8:0/2438470937 wait complete. 2023-11-18T23:41:50.970 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:41:50.970 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:50.985 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:51.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.132+0000 7faf01ee7640 1 Processor -- start 2023-11-18T23:41:51.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.132+0000 7faf01ee7640 1 -- start start 2023-11-18T23:41:51.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faf01ee7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faefc13e2d0 0x7faefc0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faf01ee7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc06de80 con 0x7faefc15bf60 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faf01ee7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc15c360 con 0x7faefc0b4640 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faf01ee7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc0b4ad0 con 0x7faefc13e2d0 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faefb7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faefc13e2d0 0x7faefc0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faefbfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faefc15bf60 0x7faefc0cd810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38632/0 (socket says 172.21.15.8:38632) 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faefbfff640 1 -- 172.21.15.8:0/2382713768 learned_addr learned my addr 172.21.15.8:0/2382713768 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faefb7fe640 1 -- 172.21.15.8:0/2382713768 >> v1:172.21.15.116:6789/0 conn(0x7faefc0b4640 legacy=0x7faefc15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faefb7fe640 1 -- 172.21.15.8:0/2382713768 >> v1:172.21.15.8:6789/0 conn(0x7faefc15bf60 legacy=0x7faefc0cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faefa7fc640 1 -- 172.21.15.8:0/2382713768 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131790147 0 0) 0x7faefc06de80 con 0x7faefc15bf60 2023-11-18T23:41:51.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.133+0000 7faefb7fe640 1 -- 172.21.15.8:0/2382713768 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc06d5c0 con 0x7faefc13e2d0 2023-11-18T23:41:51.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.134+0000 7faefb7fe640 1 --2- 172.21.15.8:0/2382713768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc13e2d0 0x7faefc0b4100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faeec0097a0 tx=0x7faeec02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97157b51aab9d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.134+0000 7faefa7fc640 1 -- 172.21.15.8:0/2382713768 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec030610 con 0x7faefc13e2d0 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.134+0000 7faefa7fc640 1 -- 172.21.15.8:0/2382713768 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec030770 con 0x7faefc13e2d0 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.134+0000 7faefa7fc640 1 -- 172.21.15.8:0/2382713768 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec030b00 con 0x7faefc13e2d0 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.135+0000 7faf01ee7640 1 -- 172.21.15.8:0/2382713768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc13e2d0 msgr2=0x7faefc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.135+0000 7faf01ee7640 1 --2- 172.21.15.8:0/2382713768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc13e2d0 0x7faefc0b4100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faeec0097a0 tx=0x7faeec02b960 comp rx=0 tx=0).stop 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.135+0000 7faf01ee7640 1 -- 172.21.15.8:0/2382713768 shutdown_connections 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.135+0000 7faf01ee7640 1 --2- 172.21.15.8:0/2382713768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc13e2d0 0x7faefc0b4100 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.135+0000 7faf01ee7640 1 -- 172.21.15.8:0/2382713768 >> 172.21.15.8:0/2382713768 conn(0x7faefc0b0af0 msgr2=0x7faefc0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.135+0000 7faf01ee7640 1 -- 172.21.15.8:0/2382713768 shutdown_connections 2023-11-18T23:41:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.135+0000 7faf01ee7640 1 -- 172.21.15.8:0/2382713768 wait complete. 2023-11-18T23:41:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.136+0000 7faf01ee7640 1 Processor -- start 2023-11-18T23:41:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.136+0000 7faf01ee7640 1 -- start start 2023-11-18T23:41:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faf01ee7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc0b4640 0x7faefc0aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faf01ee7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc13e2d0 0x7faefc0a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faf01ee7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faefc15bf60 0x7faefc1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faf01ee7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc153890 con 0x7faefc0b4640 2023-11-18T23:41:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faf01ee7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc153b30 con 0x7faefc13e2d0 2023-11-18T23:41:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faf01ee7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc153e10 con 0x7faefc15bf60 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc0b4640 0x7faefc0aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc0b4640 0x7faefc0aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50594/0 (socket says 172.21.15.8:50594) 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 -- 172.21.15.8:0/3587248829 learned_addr learned my addr 172.21.15.8:0/3587248829 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefaffd640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc13e2d0 0x7faefc0a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefbfff640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faefc15bf60 0x7faefc1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 -- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faefc15bf60 msgr2=0x7faefc1548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faefc15bf60 0x7faefc1548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 -- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc13e2d0 msgr2=0x7faefc0a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc13e2d0 0x7faefc0a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefb7fe640 1 -- 172.21.15.8:0/3587248829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec009400 con 0x7faefc0b4640 2023-11-18T23:41:51.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.137+0000 7faefbfff640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faefc15bf60 0x7faefc1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:51.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.138+0000 7faefb7fe640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc0b4640 0x7faefc0aba50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faeec0098c0 tx=0x7faeec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.138+0000 7faee3fff640 1 -- 172.21.15.8:0/3587248829 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec03e040 con 0x7faefc0b4640 2023-11-18T23:41:51.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.138+0000 7faee3fff640 1 -- 172.21.15.8:0/3587248829 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec039cb0 con 0x7faefc0b4640 2023-11-18T23:41:51.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.138+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc1540f0 con 0x7faefc0b4640 2023-11-18T23:41:51.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.138+0000 7faee3fff640 1 -- 172.21.15.8:0/3587248829 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec044630 con 0x7faefc0b4640 2023-11-18T23:41:51.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.138+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc0abf90 con 0x7faefc0b4640 2023-11-18T23:41:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.139+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc15fc40 con 0x7faefc0b4640 2023-11-18T23:41:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.139+0000 7faee3fff640 1 -- 172.21.15.8:0/3587248829 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faeec04d3b0 con 0x7faefc0b4640 2023-11-18T23:41:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.140+0000 7faee3fff640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faee806ae40 0x7faee806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.140+0000 7faee3fff640 1 -- 172.21.15.8:0/3587248829 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faeec0abb60 con 0x7faefc0b4640 2023-11-18T23:41:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.140+0000 7faefaffd640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faee806ae40 0x7faee806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.140+0000 7faefaffd640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faee806ae40 0x7faee806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faefc13dc20 tx=0x7faef0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.144+0000 7faee3fff640 1 -- 172.21.15.8:0/3587248829 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faefc15fc40 con 0x7faefc0b4640 2023-11-18T23:41:51.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.322+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faefc15fc40 con 0x7faefc0b4640 2023-11-18T23:41:51.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.323+0000 7faee3fff640 1 -- 172.21.15.8:0/3587248829 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16433 (secure 0 0 0) 0x7faefc15fc40 con 0x7faefc0b4640 2023-11-18T23:41:51.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:51.325 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:12.921285+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faee806ae40 msgr2=0x7faee806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faee806ae40 0x7faee806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faefc13dc20 tx=0x7faef0009040 comp rx=0 tx=0).stop 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc0b4640 msgr2=0x7faefc0aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc0b4640 0x7faefc0aba50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faeec0098c0 tx=0x7faeec004730 comp rx=0 tx=0).stop 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 shutdown_connections 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7faee806ae40 0x7faee806d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faefc15bf60 0x7faefc1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc13e2d0 0x7faefc0a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 --2- 172.21.15.8:0/3587248829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faefc0b4640 0x7faefc0aba50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 >> 172.21.15.8:0/3587248829 conn(0x7faefc0b0af0 msgr2=0x7faefc0cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 shutdown_connections 2023-11-18T23:41:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.325+0000 7faf01ee7640 1 -- 172.21.15.8:0/3587248829 wait complete. 2023-11-18T23:41:51.338 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:51.338 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.445+0000 7f6279bc9640 1 Processor -- start 2023-11-18T23:41:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.445+0000 7f6279bc9640 1 -- start start 2023-11-18T23:41:51.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.446+0000 7f6279bc9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6274160b70 0x7f62740d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.446+0000 7f6279bc9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62740ce360 con 0x7f62740cef00 2023-11-18T23:41:51.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.446+0000 7f6279bc9640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62740b2f20 con 0x7f62740b2aa0 2023-11-18T23:41:51.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.446+0000 7f6279bc9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740cdd50 con 0x7f6274160b70 2023-11-18T23:41:51.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.446+0000 7f62737fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6274160b70 0x7f62740d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.446+0000 7f6273fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f62740cef00 0x7f6274161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38642/0 (socket says 172.21.15.8:38642) 2023-11-18T23:41:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.446+0000 7f6273fff640 1 -- 172.21.15.8:0/3374940918 learned_addr learned my addr 172.21.15.8:0/3374940918 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.447+0000 7f62737fe640 1 -- 172.21.15.8:0/3374940918 >> v1:172.21.15.116:6789/0 conn(0x7f62740b2aa0 legacy=0x7f62740ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.447+0000 7f62737fe640 1 -- 172.21.15.8:0/3374940918 >> v1:172.21.15.8:6789/0 conn(0x7f62740cef00 legacy=0x7f6274161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.447+0000 7f62727fc640 1 -- 172.21.15.8:0/3374940918 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285817268 0 0) 0x7f62740ce360 con 0x7f62740cef00 2023-11-18T23:41:51.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.447+0000 7f62737fe640 1 -- 172.21.15.8:0/3374940918 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62740d1c70 con 0x7f6274160b70 2023-11-18T23:41:51.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f62737fe640 1 --2- 172.21.15.8:0/3374940918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6274160b70 0x7f62740d1570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f62640097a0 tx=0x7f626402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3aa37a949b33d1a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f62727fc640 1 -- 172.21.15.8:0/3374940918 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264031830 con 0x7f6274160b70 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f62727fc640 1 -- 172.21.15.8:0/3374940918 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6264031990 con 0x7f6274160b70 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f62727fc640 1 -- 172.21.15.8:0/3374940918 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264031d20 con 0x7f6274160b70 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f6279bc9640 1 -- 172.21.15.8:0/3374940918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6274160b70 msgr2=0x7f62740d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3374940918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6274160b70 0x7f62740d1570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f62640097a0 tx=0x7f626402b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f6279bc9640 1 -- 172.21.15.8:0/3374940918 shutdown_connections 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3374940918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6274160b70 0x7f62740d1570 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f6279bc9640 1 -- 172.21.15.8:0/3374940918 >> 172.21.15.8:0/3374940918 conn(0x7f627409c470 msgr2=0x7f62740d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f6279bc9640 1 -- 172.21.15.8:0/3374940918 shutdown_connections 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.448+0000 7f6279bc9640 1 -- 172.21.15.8:0/3374940918 wait complete. 2023-11-18T23:41:51.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.449+0000 7f6279bc9640 1 Processor -- start 2023-11-18T23:41:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6279bc9640 1 -- start start 2023-11-18T23:41:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6279bc9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62740b2aa0 0x7f62741596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6279bc9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62740cef00 0x7f62740cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6279bc9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6274160b70 0x7f6274156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6279bc9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62741f3870 con 0x7f62740cef00 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6279bc9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627415a300 con 0x7f62740b2aa0 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6279bc9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627415a020 con 0x7f6274160b70 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6272ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62740cef00 0x7f62740cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6272ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62740cef00 0x7f62740cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50608/0 (socket says 172.21.15.8:50608) 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.450+0000 7f6272ffd640 1 -- 172.21.15.8:0/3152023351 learned_addr learned my addr 172.21.15.8:0/3152023351 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:51.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f62737fe640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62740b2aa0 0x7f62741596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6273fff640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6274160b70 0x7f6274156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6272ffd640 1 -- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6274160b70 msgr2=0x7f6274156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6272ffd640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6274160b70 0x7f6274156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6272ffd640 1 -- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62740b2aa0 msgr2=0x7f62741596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6272ffd640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62740b2aa0 0x7f62741596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6272ffd640 1 -- 172.21.15.8:0/3152023351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009400 con 0x7f62740cef00 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6273fff640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6274160b70 0x7f6274156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6272ffd640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62740cef00 0x7f62740cc650 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f626800b420 tx=0x7f626800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f625bfff640 1 -- 172.21.15.8:0/3152023351 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268011830 con 0x7f62740cef00 2023-11-18T23:41:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f625bfff640 1 -- 172.21.15.8:0/3152023351 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268011990 con 0x7f62740cef00 2023-11-18T23:41:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62741f31b0 con 0x7f62740cef00 2023-11-18T23:41:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f625bfff640 1 -- 172.21.15.8:0/3152023351 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268011d40 con 0x7f62740cef00 2023-11-18T23:41:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.451+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274159c30 con 0x7f62740cef00 2023-11-18T23:41:51.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.452+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62741f3010 con 0x7f62740cef00 2023-11-18T23:41:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.453+0000 7f625bfff640 1 -- 172.21.15.8:0/3152023351 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f626801b460 con 0x7f62740cef00 2023-11-18T23:41:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.453+0000 7f625bfff640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f626006ae40 0x7f626006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.453+0000 7f625bfff640 1 -- 172.21.15.8:0/3152023351 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6268089090 con 0x7f62740cef00 2023-11-18T23:41:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.453+0000 7f62737fe640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f626006ae40 0x7f626006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.454+0000 7f62737fe640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f626006ae40 0x7f626006d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6264036000 tx=0x7f626403e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.457+0000 7f625bfff640 1 -- 172.21.15.8:0/3152023351 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62741f3010 con 0x7f62740cef00 2023-11-18T23:41:51.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.631+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62741f39b0 con 0x7f62740cef00 2023-11-18T23:41:51.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.632+0000 7f625bfff640 1 -- 172.21.15.8:0/3152023351 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62741f39b0 con 0x7f62740cef00 2023-11-18T23:41:51.633 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f626006ae40 msgr2=0x7f626006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f626006ae40 0x7f626006d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6264036000 tx=0x7f626403e040 comp rx=0 tx=0).stop 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62740cef00 msgr2=0x7f62740cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62740cef00 0x7f62740cc650 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f626800b420 tx=0x7f626800b8e0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 shutdown_connections 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f626006ae40 0x7f626006d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6274160b70 0x7f6274156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f62740cef00 0x7f62740cc650 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 --2- 172.21.15.8:0/3152023351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62740b2aa0 0x7f62741596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.633+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 >> 172.21.15.8:0/3152023351 conn(0x7f627409c470 msgr2=0x7f627406c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.634+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 shutdown_connections 2023-11-18T23:41:51.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.634+0000 7f6279bc9640 1 -- 172.21.15.8:0/3152023351 wait complete. 2023-11-18T23:41:51.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.754+0000 7f2cd8397640 1 Processor -- start 2023-11-18T23:41:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.754+0000 7f2cd8397640 1 -- start start 2023-11-18T23:41:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd8397640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2cd013f750 0x7f2cd015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd8397640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd8397640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2cd015db40 0x7f2cd015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd8397640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00cec70 con 0x7f2cd015db40 2023-11-18T23:41:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd8397640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00ce060 con 0x7f2cd013f750 2023-11-18T23:41:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd8397640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00ce340 con 0x7f2cd013fb30 2023-11-18T23:41:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2cd015db40 0x7f2cd015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2cd015db40 0x7f2cd015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50612/0 (socket says 172.21.15.8:50612) 2023-11-18T23:41:51.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 -- 172.21.15.8:0/3904423289 learned_addr learned my addr 172.21.15.8:0/3904423289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:51.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6133640 1 --2- 172.21.15.8:0/3904423289 >> v2:172.21.15.116:3300/0 conn(0x7f2cd013f750 0x7f2cd015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd5932640 1 --2- 172.21.15.8:0/3904423289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 -- 172.21.15.8:0/3904423289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 msgr2=0x7f2cd00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:51.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 --2- 172.21.15.8:0/3904423289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 -- 172.21.15.8:0/3904423289 >> v2:172.21.15.116:3300/0 conn(0x7f2cd013f750 msgr2=0x7f2cd015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:51.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 --2- 172.21.15.8:0/3904423289 >> v2:172.21.15.116:3300/0 conn(0x7f2cd013f750 0x7f2cd015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.755+0000 7f2cd6934640 1 -- 172.21.15.8:0/3904423289 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00ce620 con 0x7f2cd015db40 2023-11-18T23:41:51.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.756+0000 7f2cd6934640 1 --2- 172.21.15.8:0/3904423289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd015dfd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0071f40 tx=0x7f2cc002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb9b3a1289a54d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.756+0000 7f2cd5131640 1 -- 172.21.15.8:0/3904423289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc002ca70 con 0x7f2cd015db40 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.756+0000 7f2cd5131640 1 -- 172.21.15.8:0/3904423289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc002cbd0 con 0x7f2cd015db40 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.756+0000 7f2cd5131640 1 -- 172.21.15.8:0/3904423289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00343f0 con 0x7f2cd015db40 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 -- 172.21.15.8:0/3904423289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 msgr2=0x7f2cd015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 --2- 172.21.15.8:0/3904423289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd015dfd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0071f40 tx=0x7f2cc002bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 -- 172.21.15.8:0/3904423289 shutdown_connections 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 --2- 172.21.15.8:0/3904423289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd015dfd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 --2- 172.21.15.8:0/3904423289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 --2- 172.21.15.8:0/3904423289 >> v2:172.21.15.116:3300/0 conn(0x7f2cd013f750 0x7f2cd015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 -- 172.21.15.8:0/3904423289 >> 172.21.15.8:0/3904423289 conn(0x7f2cd006a8f0 msgr2=0x7f2cd006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 -- 172.21.15.8:0/3904423289 shutdown_connections 2023-11-18T23:41:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.757+0000 7f2cd8397640 1 -- 172.21.15.8:0/3904423289 wait complete. 2023-11-18T23:41:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.758+0000 7f2cd8397640 1 Processor -- start 2023-11-18T23:41:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.758+0000 7f2cd8397640 1 -- start start 2023-11-18T23:41:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd8397640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cd013f750 0x7f2cd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd8397640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd8397640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd0152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd8397640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0139f50 con 0x7f2cd015db40 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd8397640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0155530 con 0x7f2cd013f750 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd8397640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00aef60 con 0x7f2cd013fb30 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd0152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd0152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50624/0 (socket says 172.21.15.8:50624) 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 -- 172.21.15.8:0/2632372046 learned_addr learned my addr 172.21.15.8:0/2632372046 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6133640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cd013f750 0x7f2cd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd5932640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 -- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 msgr2=0x7f2cd00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 -- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cd013f750 msgr2=0x7f2cd006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cd013f750 0x7f2cd006d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.759+0000 7f2cd6934640 1 -- 172.21.15.8:0/2632372046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0009b30 con 0x7f2cd015db40 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.760+0000 7f2cd6934640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd0152d70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0036040 tx=0x7f2cc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.760+0000 7f2cceffd640 1 -- 172.21.15.8:0/2632372046 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0040670 con 0x7f2cd015db40 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.760+0000 7f2cceffd640 1 -- 172.21.15.8:0/2632372046 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00407d0 con 0x7f2cd015db40 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.760+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd00af240 con 0x7f2cd015db40 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.760+0000 7f2cceffd640 1 -- 172.21.15.8:0/2632372046 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0040b80 con 0x7f2cd015db40 2023-11-18T23:41:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.760+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd00af800 con 0x7f2cd015db40 2023-11-18T23:41:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.761+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd0072100 con 0x7f2cd015db40 2023-11-18T23:41:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.761+0000 7f2cceffd640 1 -- 172.21.15.8:0/2632372046 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cc0040ce0 con 0x7f2cd015db40 2023-11-18T23:41:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.762+0000 7f2cceffd640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2cbc06ae40 0x7f2cbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.762+0000 7f2cceffd640 1 -- 172.21.15.8:0/2632372046 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cc00ac370 con 0x7f2cd015db40 2023-11-18T23:41:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.762+0000 7f2cd6133640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2cbc06ae40 0x7f2cbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.763+0000 7f2cd6133640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2cbc06ae40 0x7f2cbc06d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009aa0 tx=0x7f2cc8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.766+0000 7f2cceffd640 1 -- 172.21.15.8:0/2632372046 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2cc0077560 con 0x7f2cd015db40 2023-11-18T23:41:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.947+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cd0072ae0 con 0x7f2cd015db40 2023-11-18T23:41:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.947+0000 7f2cceffd640 1 -- 172.21.15.8:0/2632372046 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cc0009510 con 0x7f2cd015db40 2023-11-18T23:41:51.949 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.949+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2cbc06ae40 msgr2=0x7f2cbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.949+0000 7f2cd8397640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2cbc06ae40 0x7f2cbc06d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009aa0 tx=0x7f2cc8009190 comp rx=0 tx=0).stop 2023-11-18T23:41:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 msgr2=0x7f2cd0152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd0152d70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0036040 tx=0x7f2cc0004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 shutdown_connections 2023-11-18T23:41:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2cbc06ae40 0x7f2cbc06d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd015db40 0x7f2cd0152d70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cd013fb30 0x7f2cd00b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 --2- 172.21.15.8:0/2632372046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cd013f750 0x7f2cd006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 >> 172.21.15.8:0/2632372046 conn(0x7f2cd006a8f0 msgr2=0x7f2cd0158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 shutdown_connections 2023-11-18T23:41:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:51.950+0000 7f2cd8397640 1 -- 172.21.15.8:0/2632372046 wait complete. 2023-11-18T23:41:51.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:52.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.069+0000 7f56b3d16640 1 Processor -- start 2023-11-18T23:41:52.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.069+0000 7f56b3d16640 1 -- start start 2023-11-18T23:41:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b3d16640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b3d16640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56ac0d1d60 0x7f56ac0d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b3d16640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f56ac15cfb0 0x7f56ac15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b3d16640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac0d11d0 con 0x7f56ac15cfb0 2023-11-18T23:41:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b3d16640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac0ce2b0 con 0x7f56ac0d1d60 2023-11-18T23:41:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b3d16640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0ce590 con 0x7f56ac0d1980 2023-11-18T23:41:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b22b3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f56ac15cfb0 0x7f56ac15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b22b3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f56ac15cfb0 0x7f56ac15d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50634/0 (socket says 172.21.15.8:50634) 2023-11-18T23:41:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.070+0000 7f56b22b3640 1 -- 172.21.15.8:0/343486909 learned_addr learned my addr 172.21.15.8:0/343486909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b1ab2640 1 --2- 172.21.15.8:0/343486909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b12b1640 1 --2- 172.21.15.8:0/343486909 >> v2:172.21.15.116:3300/0 conn(0x7f56ac0d1d60 0x7f56ac0d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b22b3640 1 -- 172.21.15.8:0/343486909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 msgr2=0x7f56ac0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b22b3640 1 --2- 172.21.15.8:0/343486909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b22b3640 1 -- 172.21.15.8:0/343486909 >> v2:172.21.15.116:3300/0 conn(0x7f56ac0d1d60 msgr2=0x7f56ac0d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b22b3640 1 --2- 172.21.15.8:0/343486909 >> v2:172.21.15.116:3300/0 conn(0x7f56ac0d1d60 0x7f56ac0d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b22b3640 1 -- 172.21.15.8:0/343486909 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac0ce870 con 0x7f56ac15cfb0 2023-11-18T23:41:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b1ab2640 1 --2- 172.21.15.8:0/343486909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b12b1640 1 --2- 172.21.15.8:0/343486909 >> v2:172.21.15.116:3300/0 conn(0x7f56ac0d1d60 0x7f56ac0d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.071+0000 7f56b22b3640 1 --2- 172.21.15.8:0/343486909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac15cfb0 0x7f56ac15d3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f56ac08bb60 tx=0x7f569c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede4b5ab4d170c3b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b0ab0640 1 -- 172.21.15.8:0/343486909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c02c9e0 con 0x7f56ac15cfb0 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b0ab0640 1 -- 172.21.15.8:0/343486909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c02cb40 con 0x7f56ac15cfb0 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b0ab0640 1 -- 172.21.15.8:0/343486909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0343f0 con 0x7f56ac15cfb0 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 -- 172.21.15.8:0/343486909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac15cfb0 msgr2=0x7f56ac15d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 --2- 172.21.15.8:0/343486909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac15cfb0 0x7f56ac15d3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f56ac08bb60 tx=0x7f569c02be40 comp rx=0 tx=0).stop 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 -- 172.21.15.8:0/343486909 shutdown_connections 2023-11-18T23:41:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 --2- 172.21.15.8:0/343486909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac15cfb0 0x7f56ac15d3b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 --2- 172.21.15.8:0/343486909 >> v2:172.21.15.116:3300/0 conn(0x7f56ac0d1d60 0x7f56ac0d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 --2- 172.21.15.8:0/343486909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 -- 172.21.15.8:0/343486909 >> 172.21.15.8:0/343486909 conn(0x7f56ac09c470 msgr2=0x7f56ac0d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 -- 172.21.15.8:0/343486909 shutdown_connections 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.072+0000 7f56b3d16640 1 -- 172.21.15.8:0/343486909 wait complete. 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.073+0000 7f56b3d16640 1 Processor -- start 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.074+0000 7f56b3d16640 1 -- start start 2023-11-18T23:41:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.074+0000 7f56b3d16640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b3d16640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac0d1d60 0x7f56ac1f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b3d16640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56ac15cfb0 0x7f56ac09f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b3d16640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac09e0d0 con 0x7f56ac0d1d60 2023-11-18T23:41:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b3d16640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac152b70 con 0x7f56ac15cfb0 2023-11-18T23:41:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b3d16640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1f3810 con 0x7f56ac0d1980 2023-11-18T23:41:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac0d1d60 0x7f56ac1f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac0d1d60 0x7f56ac1f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50640/0 (socket says 172.21.15.8:50640) 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 -- 172.21.15.8:0/71963067 learned_addr learned my addr 172.21.15.8:0/71963067 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b22b3640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56ac15cfb0 0x7f56ac09f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b1ab2640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 -- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 msgr2=0x7f56ac152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 -- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56ac15cfb0 msgr2=0x7f56ac09f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56ac15cfb0 0x7f56ac09f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 -- 172.21.15.8:0/71963067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009b30 con 0x7f56ac0d1d60 2023-11-18T23:41:52.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.075+0000 7f56b12b1640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac0d1d60 0x7f56ac1f32d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f56a000e810 tx=0x7f56a000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.077+0000 7f56aa7fc640 1 -- 172.21.15.8:0/71963067 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0004030 con 0x7f56ac0d1d60 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.077+0000 7f56aa7fc640 1 -- 172.21.15.8:0/71963067 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a0004190 con 0x7f56ac0d1d60 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.077+0000 7f56aa7fc640 1 -- 172.21.15.8:0/71963067 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0004520 con 0x7f56ac0d1d60 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.077+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac09f860 con 0x7f56ac0d1d60 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.077+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac0c70e0 con 0x7f56ac0d1d60 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.078+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac0d39b0 con 0x7f56ac0d1d60 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.078+0000 7f56aa7fc640 1 -- 172.21.15.8:0/71963067 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56a000c6d0 con 0x7f56ac0d1d60 2023-11-18T23:41:52.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.079+0000 7f56aa7fc640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f569806ae40 0x7f569806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.079+0000 7f56aa7fc640 1 -- 172.21.15.8:0/71963067 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f56a0089290 con 0x7f56ac0d1d60 2023-11-18T23:41:52.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.079+0000 7f56b1ab2640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f569806ae40 0x7f569806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.080+0000 7f56b1ab2640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f569806ae40 0x7f569806d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009950 tx=0x7f56a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.085+0000 7f56aa7fc640 1 -- 172.21.15.8:0/71963067 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f56a0054360 con 0x7f56ac0d1d60 2023-11-18T23:41:52.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.263+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56ac04e920 con 0x7f56ac0d1d60 2023-11-18T23:41:52.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.263+0000 7f56aa7fc640 1 -- 172.21.15.8:0/71963067 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56a0054360 con 0x7f56ac0d1d60 2023-11-18T23:41:52.265 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f569806ae40 msgr2=0x7f569806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f569806ae40 0x7f569806d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009950 tx=0x7f56a4008040 comp rx=0 tx=0).stop 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac0d1d60 msgr2=0x7f56ac1f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac0d1d60 0x7f56ac1f32d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f56a000e810 tx=0x7f56a000ecd0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 shutdown_connections 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f569806ae40 0x7f569806d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56ac15cfb0 0x7f56ac09f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f56ac0d1d60 0x7f56ac1f32d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 --2- 172.21.15.8:0/71963067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56ac0d1980 0x7f56ac152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 >> 172.21.15.8:0/71963067 conn(0x7f56ac09c470 msgr2=0x7f56ac0afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:52.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 shutdown_connections 2023-11-18T23:41:52.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.265+0000 7f56b3d16640 1 -- 172.21.15.8:0/71963067 wait complete. 2023-11-18T23:41:52.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.384+0000 7f158dc09640 1 Processor -- start 2023-11-18T23:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.384+0000 7f158dc09640 1 -- start start 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f158dc09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15880b3610 0x7f1588160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f158dc09640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1588161370 0x7f158806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f158dc09640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15880adda0 con 0x7f158806efd0 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f158dc09640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1588161820 con 0x7f1588161370 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f158dc09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15880b3aa0 con 0x7f15880b3610 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1587fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1588161370 0x7f158806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1587fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1588161370 0x7f158806a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50646/0 (socket says 172.21.15.8:50646) 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1587fff640 1 -- 172.21.15.8:0/1945771158 learned_addr learned my addr 172.21.15.8:0/1945771158 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1586ffd640 1 --2- 172.21.15.8:0/1945771158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15880b3610 0x7f1588160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1587fff640 1 -- 172.21.15.8:0/1945771158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15880b3610 msgr2=0x7f1588160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1587fff640 1 --2- 172.21.15.8:0/1945771158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15880b3610 0x7f1588160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1587fff640 1 -- 172.21.15.8:0/1945771158 >> v1:172.21.15.116:6789/0 conn(0x7f158806efd0 legacy=0x7f15880ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.385+0000 7f1587fff640 1 -- 172.21.15.8:0/1945771158 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15880b3d80 con 0x7f1588161370 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.386+0000 7f1587fff640 1 --2- 172.21.15.8:0/1945771158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158806a4d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1580009e50 tx=0x7f158002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df105abdd9504dc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.386+0000 7f15867fc640 1 -- 172.21.15.8:0/1945771158 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158002ca70 con 0x7f1588161370 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.386+0000 7f15867fc640 1 -- 172.21.15.8:0/1945771158 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158002cbd0 con 0x7f1588161370 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.386+0000 7f15867fc640 1 -- 172.21.15.8:0/1945771158 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800343f0 con 0x7f1588161370 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 -- 172.21.15.8:0/1945771158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 msgr2=0x7f158806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 --2- 172.21.15.8:0/1945771158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158806a4d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1580009e50 tx=0x7f158002bed0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 -- 172.21.15.8:0/1945771158 shutdown_connections 2023-11-18T23:41:52.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 --2- 172.21.15.8:0/1945771158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158806a4d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 --2- 172.21.15.8:0/1945771158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15880b3610 0x7f1588160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 -- 172.21.15.8:0/1945771158 >> 172.21.15.8:0/1945771158 conn(0x7f15880b1670 msgr2=0x7f15880b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 -- 172.21.15.8:0/1945771158 shutdown_connections 2023-11-18T23:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.387+0000 7f158dc09640 1 -- 172.21.15.8:0/1945771158 wait complete. 2023-11-18T23:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.388+0000 7f158dc09640 1 Processor -- start 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.388+0000 7f158dc09640 1 -- start start 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f158dc09640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158806efd0 0x7f158806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f158dc09640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f158dc09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158815b8a0 0x7f1588150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f158dc09640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15881f3140 con 0x7f1588161370 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f158dc09640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158806d9e0 con 0x7f158806efd0 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f158dc09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158806dcc0 con 0x7f158815b8a0 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158815c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50658/0 (socket says 172.21.15.8:50658) 2023-11-18T23:41:52.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 -- 172.21.15.8:0/1007504099 learned_addr learned my addr 172.21.15.8:0/1007504099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f15877fe640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158806efd0 0x7f158806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1587fff640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158815b8a0 0x7f1588150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 -- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158815b8a0 msgr2=0x7f1588150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158815b8a0 0x7f1588150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 -- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158806efd0 msgr2=0x7f158806d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158806efd0 0x7f158806d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1586ffd640 1 -- 172.21.15.8:0/1007504099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1580009b30 con 0x7f1588161370 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f15877fe640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158806efd0 0x7f158806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.389+0000 7f1587fff640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158815b8a0 0x7f1588150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.390+0000 7f1586ffd640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158815c320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f157c00c7f0 tx=0x7f157c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.390+0000 7f156ffff640 1 -- 172.21.15.8:0/1007504099 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c004220 con 0x7f1588161370 2023-11-18T23:41:52.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.390+0000 7f156ffff640 1 -- 172.21.15.8:0/1007504099 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c0043a0 con 0x7f1588161370 2023-11-18T23:41:52.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.390+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158806dfa0 con 0x7f1588161370 2023-11-18T23:41:52.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.390+0000 7f156ffff640 1 -- 172.21.15.8:0/1007504099 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c007860 con 0x7f1588161370 2023-11-18T23:41:52.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.390+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158806e280 con 0x7f1588161370 2023-11-18T23:41:52.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.391+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15881f3310 con 0x7f1588161370 2023-11-18T23:41:52.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.391+0000 7f156ffff640 1 -- 172.21.15.8:0/1007504099 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f157c007bd0 con 0x7f1588161370 2023-11-18T23:41:52.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.392+0000 7f156ffff640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f157406ae70 0x7f157406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.392+0000 7f156ffff640 1 -- 172.21.15.8:0/1007504099 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f157c0896b0 con 0x7f1588161370 2023-11-18T23:41:52.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.392+0000 7f15877fe640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f157406ae70 0x7f157406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.393+0000 7f15877fe640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f157406ae70 0x7f157406d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1578003eb0 tx=0x7f1578009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.396+0000 7f156ffff640 1 -- 172.21.15.8:0/1007504099 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15881f3310 con 0x7f1588161370 2023-11-18T23:41:52.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.585+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1588072720 con 0x7f1588161370 2023-11-18T23:41:52.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.585+0000 7f156ffff640 1 -- 172.21.15.8:0/1007504099 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f157c01e080 con 0x7f1588161370 2023-11-18T23:41:52.587 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f157406ae70 msgr2=0x7f157406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f157406ae70 0x7f157406d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1578003eb0 tx=0x7f1578009040 comp rx=0 tx=0).stop 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 msgr2=0x7f158815c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158815c320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f157c00c7f0 tx=0x7f157c00ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 shutdown_connections 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f157406ae70 0x7f157406d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158815b8a0 0x7f1588150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588161370 0x7f158815c320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 --2- 172.21.15.8:0/1007504099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158806efd0 0x7f158806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.587+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 >> 172.21.15.8:0/1007504099 conn(0x7f15880b1670 msgr2=0x7f158806a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.588+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 shutdown_connections 2023-11-18T23:41:52.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.588+0000 7f158dc09640 1 -- 172.21.15.8:0/1007504099 wait complete. 2023-11-18T23:41:52.599 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi008.front.sepia.ceph.com... 2023-11-18T23:41:52.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:52.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-18T23:41:52.630 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:41:52.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-11-18T23:41:52.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:52.631 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-18T23:41:52.686 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:41:52.686 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:52.705 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:41:52.705 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:52.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:52.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.868+0000 7f8f208e7640 1 Processor -- start 2023-11-18T23:41:52.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.868+0000 7f8f208e7640 1 -- start start 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.869+0000 7f8f208e7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 0x7f8f1c0d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.869+0000 7f8f208e7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c0b5f90 con 0x7f8f1c0b3db0 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.869+0000 7f8f208e7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c0d20a0 con 0x7f8f1c15d3e0 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.869+0000 7f8f208e7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b61e0 con 0x7f8f1c0d1720 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.869+0000 7f8f1ad9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8f1c0b3db0 0x7f8f1c0b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38644/0 (socket says 172.21.15.8:38644) 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.869+0000 7f8f1ad9d640 1 -- 172.21.15.8:0/3486249200 learned_addr learned my addr 172.21.15.8:0/3486249200 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f19d9b640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 0x7f8f1c0d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680802119 0 0) 0x7f8f1c0b5f90 con 0x7f8f1c0b3db0 2023-11-18T23:41:52.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f08003520 con 0x7f8f1c0b3db0 2023-11-18T23:41:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168579844 0 0) 0x7f8f1c0d20a0 con 0x7f8f1c15d3e0 2023-11-18T23:41:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f1c0b5f90 con 0x7f8f1c15d3e0 2023-11-18T23:41:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697554641 0 0) 0x7f8f08003520 con 0x7f8f1c0b3db0 2023-11-18T23:41:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 msgr2=0x7f8f1c0d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 0x7f8f1c0d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 >> v1:172.21.15.116:6789/0 conn(0x7f8f1c15d3e0 legacy=0x7f8f1c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0b64c0 con 0x7f8f1c0b3db0 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f8f140015f0 con 0x7f8f1c0b3db0 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f19d9b640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 0x7f8f1c0d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 >> v1:172.21.15.8:6789/0 conn(0x7f8f1c0b3db0 legacy=0x7f8f1c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 0x7f8f08003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080040c0 0x7f8f080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f08004d00 0x7f8f08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b61e0 con 0x7f8f08004d00 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0800ba90 con 0x7f8f080040c0 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0800bc50 con 0x7f8f1c0d1720 2023-11-18T23:41:52.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1ad9d640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f08004d00 0x7f8f08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f1a59c640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 0x7f8f08003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.870+0000 7f8f19d9b640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080040c0 0x7f8f080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1ad9d640 1 -- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 msgr2=0x7f8f08003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1ad9d640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f1c0d1720 0x7f8f08003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1ad9d640 1 -- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080040c0 msgr2=0x7f8f080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1ad9d640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080040c0 0x7f8f080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1ad9d640 1 -- 172.21.15.8:0/3486249200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04009400 con 0x7f8f08004d00 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1ad9d640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f08004d00 0x7f8f08005180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007ee0 tx=0x7f8f080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe3e401f58fb030 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14005ad0 con 0x7f8f08004d00 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14005c30 con 0x7f8f08004d00 2023-11-18T23:41:52.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.871+0000 7f8f1959a640 1 -- 172.21.15.8:0/3486249200 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14007070 con 0x7f8f08004d00 2023-11-18T23:41:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.872+0000 7f8f208e7640 1 -- 172.21.15.8:0/3486249200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f08004d00 msgr2=0x7f8f08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.872+0000 7f8f208e7640 1 --2- 172.21.15.8:0/3486249200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f08004d00 0x7f8f08005180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007ee0 tx=0x7f8f080057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.872+0000 7f8f1ad9d640 1 -- 172.21.15.8:0/3486249200 reap_dead start 2023-11-18T23:41:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.872+0000 7f8f208e7640 1 -- 172.21.15.8:0/3486249200 shutdown_connections 2023-11-18T23:41:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.872+0000 7f8f208e7640 1 -- 172.21.15.8:0/3486249200 >> 172.21.15.8:0/3486249200 conn(0x7f8f1c09c480 msgr2=0x7f8f1c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.872+0000 7f8f208e7640 1 -- 172.21.15.8:0/3486249200 shutdown_connections 2023-11-18T23:41:52.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.872+0000 7f8f208e7640 1 -- 172.21.15.8:0/3486249200 wait complete. 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.873+0000 7f8f208e7640 1 Processor -- start 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.873+0000 7f8f208e7640 1 -- start start 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f208e7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f08004d00 0x7f8f1c159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f208e7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f1c0aff30 0x7f8f1c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f208e7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f1c0cdca0 0x7f8f1c0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f208e7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b08b0 con 0x7f8f1c0aff30 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f208e7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0ce640 con 0x7f8f1c0cdca0 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f208e7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c15d7c0 con 0x7f8f08004d00 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f19d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f1c0aff30 0x7f8f1c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f19d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f1c0aff30 0x7f8f1c0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50690/0 (socket says 172.21.15.8:50690) 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.874+0000 7f8f19d9b640 1 -- 172.21.15.8:0/3616570778 learned_addr learned my addr 172.21.15.8:0/3616570778 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f1ad9d640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f1c0cdca0 0x7f8f1c0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f1a59c640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f08004d00 0x7f8f1c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f19d9b640 1 -- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f08004d00 msgr2=0x7f8f1c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f19d9b640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f08004d00 0x7f8f1c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f19d9b640 1 -- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f1c0cdca0 msgr2=0x7f8f1c0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f19d9b640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f1c0cdca0 0x7f8f1c0ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f19d9b640 1 -- 172.21.15.8:0/3616570778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c15e620 con 0x7f8f1c0aff30 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f1ad9d640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f1c0cdca0 0x7f8f1c0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f1a59c640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f08004d00 0x7f8f1c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f19d9b640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f1c0aff30 0x7f8f1c0b0370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f04011d30 tx=0x7f8f0400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f12ffd640 1 -- 172.21.15.8:0/3616570778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04009e10 con 0x7f8f1c0aff30 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f12ffd640 1 -- 172.21.15.8:0/3616570778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04004030 con 0x7f8f1c0aff30 2023-11-18T23:41:52.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f12ffd640 1 -- 172.21.15.8:0/3616570778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040043e0 con 0x7f8f1c0aff30 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c15da10 con 0x7f8f1c0aff30 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.875+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c15dfd0 con 0x7f8f1c0aff30 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.876+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c15e7b0 con 0x7f8f1c0aff30 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.876+0000 7f8f12ffd640 1 -- 172.21.15.8:0/3616570778 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f04003610 con 0x7f8f1c0aff30 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.877+0000 7f8f12ffd640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8efc06ae40 0x7f8efc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.877+0000 7f8f12ffd640 1 -- 172.21.15.8:0/3616570778 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f8f04089ed0 con 0x7f8f1c0aff30 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.877+0000 7f8f1a59c640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8efc06ae40 0x7f8efc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:52.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.878+0000 7f8f1a59c640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8efc06ae40 0x7f8efc06d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c003f40 tx=0x7f8f0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:52.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:52.881+0000 7f8f12ffd640 1 -- 172.21.15.8:0/3616570778 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f04054ef0 con 0x7f8f1c0aff30 2023-11-18T23:41:53.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.057+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f1c067420 con 0x7f8f1c0aff30 2023-11-18T23:41:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.058+0000 7f8f12ffd640 1 -- 172.21.15.8:0/3616570778 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16719 (secure 0 0 0) 0x7f8f04019090 con 0x7f8f1c0aff30 2023-11-18T23:41:53.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:53.060 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:52.074360+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":1},{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8efc06ae40 msgr2=0x7f8efc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8efc06ae40 0x7f8efc06d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c003f40 tx=0x7f8f0c009040 comp rx=0 tx=0).stop 2023-11-18T23:41:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f1c0aff30 msgr2=0x7f8f1c0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f1c0aff30 0x7f8f1c0b0370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f04011d30 tx=0x7f8f0400f610 comp rx=0 tx=0).stop 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 shutdown_connections 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8efc06ae40 0x7f8efc06d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f1c0cdca0 0x7f8f1c0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f1c0aff30 0x7f8f1c0b0370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 --2- 172.21.15.8:0/3616570778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f08004d00 0x7f8f1c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 >> 172.21.15.8:0/3616570778 conn(0x7f8f1c09c480 msgr2=0x7f8f1c0b88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 shutdown_connections 2023-11-18T23:41:53.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.060+0000 7f8f208e7640 1 -- 172.21.15.8:0/3616570778 wait complete. 2023-11-18T23:41:53.072 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:53.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.182+0000 7fdd55aa2640 1 Processor -- start 2023-11-18T23:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.182+0000 7fdd55aa2640 1 -- start start 2023-11-18T23:41:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd55aa2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 0x7fdd500cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd55aa2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5006ae00 con 0x7fdd5015eb80 2023-11-18T23:41:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd55aa2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd500ccc70 con 0x7fdd5015ef60 2023-11-18T23:41:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd55aa2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500cf120 con 0x7fdd500cc7f0 2023-11-18T23:41:53.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4f7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdd5015eb80 0x7fdd5015c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38660/0 (socket says 172.21.15.8:38660) 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/223848847 learned_addr learned my addr 172.21.15.8:0/223848847 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4effd640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 0x7fdd500cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88498074 0 0) 0x7fdd5006ae00 con 0x7fdd5015eb80 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd38003520 con 0x7fdd5015eb80 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058687680 0 0) 0x7fdd38003520 con 0x7fdd5015eb80 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 msgr2=0x7fdd500cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 0x7fdd500cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 >> v1:172.21.15.116:6789/0 conn(0x7fdd5015ef60 legacy=0x7fdd500ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500cf3a0 con 0x7fdd5015eb80 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fdd40001670 con 0x7fdd5015eb80 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 >> v1:172.21.15.8:6789/0 conn(0x7fdd5015eb80 legacy=0x7fdd5015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.183+0000 7fdd4e7fc640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd380047c0 0x7fdd38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4e7fc640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 0x7fdd38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500cf120 con 0x7fdd380039a0 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3800ba30 con 0x7fdd380047c0 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3800bbf0 con 0x7fdd500cc7f0 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4f7fe640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4effd640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd380047c0 0x7fdd38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4ffff640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 0x7fdd38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 msgr2=0x7fdd38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4f7fe640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 0x7fdd38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd380047c0 msgr2=0x7fdd38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4f7fe640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd380047c0 0x7fdd38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/223848847 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd38003520 con 0x7fdd380039a0 2023-11-18T23:41:53.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.184+0000 7fdd4ffff640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd500cc7f0 0x7fdd38005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:53.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd4f7fe640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd38003dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdd40007fd0 tx=0x7fdd380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbde208ef8e26ad3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40005ad0 con 0x7fdd380039a0 2023-11-18T23:41:53.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40005c30 con 0x7fdd380039a0 2023-11-18T23:41:53.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd4e7fc640 1 -- 172.21.15.8:0/223848847 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4002c850 con 0x7fdd380039a0 2023-11-18T23:41:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd55aa2640 1 -- 172.21.15.8:0/223848847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 msgr2=0x7fdd38003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd55aa2640 1 --2- 172.21.15.8:0/223848847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd38003dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdd40007fd0 tx=0x7fdd380057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd4ffff640 1 -- 172.21.15.8:0/223848847 reap_dead start 2023-11-18T23:41:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd55aa2640 1 -- 172.21.15.8:0/223848847 shutdown_connections 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd55aa2640 1 -- 172.21.15.8:0/223848847 >> 172.21.15.8:0/223848847 conn(0x7fdd500b1670 msgr2=0x7fdd500b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd55aa2640 1 -- 172.21.15.8:0/223848847 shutdown_connections 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.185+0000 7fdd55aa2640 1 -- 172.21.15.8:0/223848847 wait complete. 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 Processor -- start 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 -- start start 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd50154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd50140020 0x7fdd501404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd5013dda0 0x7fdd5013e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50154d90 con 0x7fdd380039a0 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501409e0 con 0x7fdd5013dda0 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.187+0000 7fdd55aa2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5013eb40 con 0x7fdd50140020 2023-11-18T23:41:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd50154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd50154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50712/0 (socket says 172.21.15.8:50712) 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/2920521497 learned_addr learned my addr 172.21.15.8:0/2920521497 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4ffff640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd5013dda0 0x7fdd5013e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4effd640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd50140020 0x7fdd501404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd50140020 msgr2=0x7fdd501404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd50140020 0x7fdd501404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd5013dda0 msgr2=0x7fdd5013e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd5013dda0 0x7fdd5013e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 -- 172.21.15.8:0/2920521497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5013ee20 con 0x7fdd380039a0 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4ffff640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd5013dda0 0x7fdd5013e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd4f7fe640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd50154850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdd40001930 tx=0x7fdd4002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd37fff640 1 -- 172.21.15.8:0/2920521497 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4003c040 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd37fff640 1 -- 172.21.15.8:0/2920521497 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4002cc60 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5013f100 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd37fff640 1 -- 172.21.15.8:0/2920521497 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40007070 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.188+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5013f6c0 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.189+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd50067940 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.190+0000 7fdd37fff640 1 -- 172.21.15.8:0/2920521497 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd40032070 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.190+0000 7fdd37fff640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.190+0000 7fdd37fff640 1 -- 172.21.15.8:0/2920521497 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fdd400aa750 con 0x7fdd380039a0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.191+0000 7fdd4effd640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.191+0000 7fdd4effd640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdd3c06ae40 0x7fdd3c06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006cdd0 tx=0x7fdd44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.195+0000 7fdd37fff640 1 -- 172.21.15.8:0/2920521497 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd400756e0 con 0x7fdd380039a0 2023-11-18T23:41:53.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.370+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd50072720 con 0x7fdd380039a0 2023-11-18T23:41:53.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.370+0000 7fdd37fff640 1 -- 172.21.15.8:0/2920521497 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd400450a0 con 0x7fdd380039a0 2023-11-18T23:41:53.372 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdd3c06ae40 msgr2=0x7fdd3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdd3c06ae40 0x7fdd3c06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006cdd0 tx=0x7fdd44008040 comp rx=0 tx=0).stop 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 msgr2=0x7fdd50154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd50154850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdd40001930 tx=0x7fdd4002e070 comp rx=0 tx=0).stop 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 shutdown_connections 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdd3c06ae40 0x7fdd3c06d300 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006cdd0 tx=0x7fdd44008040 comp rx=0 tx=0).stop 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd5013dda0 0x7fdd5013e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd50140020 0x7fdd501404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 --2- 172.21.15.8:0/2920521497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd380039a0 0x7fdd50154850 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 >> 172.21.15.8:0/2920521497 conn(0x7fdd500b1670 msgr2=0x7fdd5013d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 shutdown_connections 2023-11-18T23:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.372+0000 7fdd55aa2640 1 -- 172.21.15.8:0/2920521497 wait complete. 2023-11-18T23:41:53.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:53.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.495+0000 7f999c6a2640 1 Processor -- start 2023-11-18T23:41:53.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.495+0000 7f999c6a2640 1 -- start start 2023-11-18T23:41:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999c6a2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f999415b0d0 0x7f99940cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999c6a2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9994070630 0x7f9994070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999c6a2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999415b530 con 0x7f999413f750 2023-11-18T23:41:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999c6a2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99940cec70 con 0x7f9994070630 2023-11-18T23:41:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999c6a2640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99940ce060 con 0x7f999415b0d0 2023-11-18T23:41:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999ac3f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9994070630 0x7f9994070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999ac3f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9994070630 0x7f9994070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50714/0 (socket says 172.21.15.8:50714) 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999ac3f640 1 -- 172.21.15.8:0/2342180020 learned_addr learned my addr 172.21.15.8:0/2342180020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f999a43e640 1 --1- 172.21.15.8:0/2342180020 >> v1:172.21.15.8:6789/0 conn(0x7f999413f750 0x7f999413fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38674/0 (socket says 172.21.15.8:38674) 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.496+0000 7f9999c3d640 1 --2- 172.21.15.8:0/2342180020 >> v2:172.21.15.116:3300/0 conn(0x7f999415b0d0 0x7f99940cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999ac3f640 1 -- 172.21.15.8:0/2342180020 >> v2:172.21.15.116:3300/0 conn(0x7f999415b0d0 msgr2=0x7f99940cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999ac3f640 1 --2- 172.21.15.8:0/2342180020 >> v2:172.21.15.116:3300/0 conn(0x7f999415b0d0 0x7f99940cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999ac3f640 1 -- 172.21.15.8:0/2342180020 >> v1:172.21.15.8:6789/0 conn(0x7f999413f750 legacy=0x7f999413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999ac3f640 1 -- 172.21.15.8:0/2342180020 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99940ce340 con 0x7f9994070630 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999943c640 1 -- 172.21.15.8:0/2342180020 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407310089 0 0) 0x7f999415b530 con 0x7f999413f750 2023-11-18T23:41:53.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f9999c3d640 1 --2- 172.21.15.8:0/2342180020 >> v2:172.21.15.116:3300/0 conn(0x7f999415b0d0 0x7f99940cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:53.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999ac3f640 1 --2- 172.21.15.8:0/2342180020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f9994070ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f999415ec00 tx=0x7f998402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58983ce9032e37d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999943c640 1 -- 172.21.15.8:0/2342180020 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998402cb20 con 0x7f9994070630 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999943c640 1 -- 172.21.15.8:0/2342180020 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998402cc80 con 0x7f9994070630 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.497+0000 7f999943c640 1 -- 172.21.15.8:0/2342180020 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840343f0 con 0x7f9994070630 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 -- 172.21.15.8:0/2342180020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 msgr2=0x7f9994070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 --2- 172.21.15.8:0/2342180020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f9994070ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f999415ec00 tx=0x7f998402bf80 comp rx=0 tx=0).stop 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 -- 172.21.15.8:0/2342180020 shutdown_connections 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 --2- 172.21.15.8:0/2342180020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f9994070ac0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 --2- 172.21.15.8:0/2342180020 >> v2:172.21.15.116:3300/0 conn(0x7f999415b0d0 0x7f99940cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 -- 172.21.15.8:0/2342180020 >> 172.21.15.8:0/2342180020 conn(0x7f999406a8f0 msgr2=0x7f999406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 -- 172.21.15.8:0/2342180020 shutdown_connections 2023-11-18T23:41:53.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.498+0000 7f999c6a2640 1 -- 172.21.15.8:0/2342180020 wait complete. 2023-11-18T23:41:53.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.499+0000 7f999c6a2640 1 Processor -- start 2023-11-18T23:41:53.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.499+0000 7f999c6a2640 1 -- start start 2023-11-18T23:41:53.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999c6a2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f999413b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999c6a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f999413f750 0x7f99940cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999c6a2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f999415b0d0 0x7f999406d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999c6a2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940cc640 con 0x7f9994070630 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999c6a2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9994156610 con 0x7f999413f750 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999c6a2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9994156e70 con 0x7f999415b0d0 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999a43e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f999413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999a43e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f999413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50730/0 (socket says 172.21.15.8:50730) 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999a43e640 1 -- 172.21.15.8:0/203616129 learned_addr learned my addr 172.21.15.8:0/203616129 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:53.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999a43e640 1 -- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f999415b0d0 msgr2=0x7f999406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999a43e640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f999415b0d0 0x7f999406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f999a43e640 1 -- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f999413f750 msgr2=0x7f99940cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.500+0000 7f9999c3d640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f999413f750 0x7f99940cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f999a43e640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f999413f750 0x7f99940cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f999a43e640 1 -- 172.21.15.8:0/203616129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984009b30 con 0x7f9994070630 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f9999c3d640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f999413f750 0x7f99940cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f999a43e640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f999413b210 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c430 tx=0x7f998c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f9992ffd640 1 -- 172.21.15.8:0/203616129 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0074e0 con 0x7f9994070630 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f9992ffd640 1 -- 172.21.15.8:0/203616129 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c007660 con 0x7f9994070630 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99940cb8e0 con 0x7f9994070630 2023-11-18T23:41:53.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f9992ffd640 1 -- 172.21.15.8:0/203616129 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c004a20 con 0x7f9994070630 2023-11-18T23:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.501+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9994156820 con 0x7f9994070630 2023-11-18T23:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.502+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9994072ae0 con 0x7f9994070630 2023-11-18T23:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.502+0000 7f9992ffd640 1 -- 172.21.15.8:0/203616129 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f998c004b80 con 0x7f9994070630 2023-11-18T23:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.503+0000 7f9992ffd640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f998006ae40 0x7f998006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.503+0000 7f9992ffd640 1 -- 172.21.15.8:0/203616129 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f998c0894d0 con 0x7f9994070630 2023-11-18T23:41:53.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.503+0000 7f9999c3d640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f998006ae40 0x7f998006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.503+0000 7f9999c3d640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f998006ae40 0x7f998006d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.507+0000 7f9992ffd640 1 -- 172.21.15.8:0/203616129 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f998c0544f0 con 0x7f9994070630 2023-11-18T23:41:53.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.683+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f999404e920 con 0x7f9994070630 2023-11-18T23:41:53.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.684+0000 7f9992ffd640 1 -- 172.21.15.8:0/203616129 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f998c057b10 con 0x7f9994070630 2023-11-18T23:41:53.685 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:53.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.685+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f998006ae40 msgr2=0x7f998006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f998006ae40 0x7f998006d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988008040 comp rx=0 tx=0).stop 2023-11-18T23:41:53.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 msgr2=0x7f999413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f999413b210 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c430 tx=0x7f998c00c8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 shutdown_connections 2023-11-18T23:41:53.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f998006ae40 0x7f998006d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f999415b0d0 0x7f999406d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f999413f750 0x7f99940cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 --2- 172.21.15.8:0/203616129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9994070630 0x7f999413b210 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 >> 172.21.15.8:0/203616129 conn(0x7f999406a8f0 msgr2=0x7f99941597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:53.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 shutdown_connections 2023-11-18T23:41:53.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.686+0000 7f999c6a2640 1 -- 172.21.15.8:0/203616129 wait complete. 2023-11-18T23:41:53.698 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:53.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.805+0000 7fc92b41c640 1 Processor -- start 2023-11-18T23:41:53.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.806+0000 7fc92b41c640 1 -- start start 2023-11-18T23:41:53.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.806+0000 7fc92b41c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9240b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.806+0000 7fc92b41c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc92406abe0 0x7fc924160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.806+0000 7fc92b41c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240721d0 con 0x7fc924071d40 2023-11-18T23:41:53.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.806+0000 7fc92b41c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc924161d80 con 0x7fc92406abe0 2023-11-18T23:41:53.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.806+0000 7fc92b41c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9241612d0 con 0x7fc9241465d0 2023-11-18T23:41:53.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9299b9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc92406abe0 0x7fc924160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9299b9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc92406abe0 0x7fc924160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:38322/0 (socket says 172.21.15.8:38322) 2023-11-18T23:41:53.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9291b8640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9240b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9289b7640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc924071d40 0x7fc92406a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:50134/0 (socket says 172.21.15.8:50134) 2023-11-18T23:41:53.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9299b9640 1 -- 172.21.15.8:0/3825642359 learned_addr learned my addr 172.21.15.8:0/3825642359 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:53.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9299b9640 1 -- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 msgr2=0x7fc9240b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:53.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9299b9640 1 --2- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9240b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9299b9640 1 -- 172.21.15.8:0/3825642359 >> v1:172.21.15.116:6789/0 conn(0x7fc924071d40 legacy=0x7fc92406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9299b9640 1 -- 172.21.15.8:0/3825642359 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240cf790 con 0x7fc92406abe0 2023-11-18T23:41:53.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc91bfff640 1 -- 172.21.15.8:0/3825642359 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655326545 0 0) 0x7fc9240721d0 con 0x7fc924071d40 2023-11-18T23:41:53.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.807+0000 7fc9291b8640 1 --2- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9240b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:41:53.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.808+0000 7fc9299b9640 1 --2- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc92406abe0 0x7fc924160d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009e50 tx=0x7fc91c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8911192d5ed5e7cb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.808+0000 7fc91bfff640 1 -- 172.21.15.8:0/3825642359 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c02cb00 con 0x7fc92406abe0 2023-11-18T23:41:53.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.808+0000 7fc91bfff640 1 -- 172.21.15.8:0/3825642359 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c02cc60 con 0x7fc92406abe0 2023-11-18T23:41:53.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.808+0000 7fc91bfff640 1 -- 172.21.15.8:0/3825642359 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0343f0 con 0x7fc92406abe0 2023-11-18T23:41:53.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 -- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc92406abe0 msgr2=0x7fc924160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 --2- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc92406abe0 0x7fc924160d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009e50 tx=0x7fc91c02bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:53.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 -- 172.21.15.8:0/3825642359 shutdown_connections 2023-11-18T23:41:53.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 --2- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc92406abe0 0x7fc924160d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 --2- 172.21.15.8:0/3825642359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9240b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 -- 172.21.15.8:0/3825642359 >> 172.21.15.8:0/3825642359 conn(0x7fc9240cc930 msgr2=0x7fc9240ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:53.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 -- 172.21.15.8:0/3825642359 shutdown_connections 2023-11-18T23:41:53.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.809+0000 7fc92b41c640 1 -- 172.21.15.8:0/3825642359 wait complete. 2023-11-18T23:41:53.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.810+0000 7fc92b41c640 1 Processor -- start 2023-11-18T23:41:53.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.810+0000 7fc92b41c640 1 -- start start 2023-11-18T23:41:53.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc92b41c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc92406abe0 0x7fc9241f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc92b41c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc924071d40 0x7fc9241522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc92b41c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9241527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc92b41c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240ae150 con 0x7fc92406abe0 2023-11-18T23:41:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc92b41c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240ad5d0 con 0x7fc924071d40 2023-11-18T23:41:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc92b41c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240ad8b0 con 0x7fc9241465d0 2023-11-18T23:41:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc92406abe0 0x7fc9241f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc92406abe0 0x7fc9241f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50740/0 (socket says 172.21.15.8:50740) 2023-11-18T23:41:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 -- 172.21.15.8:0/2593941442 learned_addr learned my addr 172.21.15.8:0/2593941442 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9289b7640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc924071d40 0x7fc9241522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9299b9640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9241527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 -- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 msgr2=0x7fc9241527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9241527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 -- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc924071d40 msgr2=0x7fc9241522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc924071d40 0x7fc9241522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 -- 172.21.15.8:0/2593941442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009400 con 0x7fc92406abe0 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.811+0000 7fc9291b8640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc92406abe0 0x7fc9241f21b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e960 tx=0x7fc92000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.812+0000 7fc919ffb640 1 -- 172.21.15.8:0/2593941442 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000ca00 con 0x7fc92406abe0 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.812+0000 7fc919ffb640 1 -- 172.21.15.8:0/2593941442 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000cb60 con 0x7fc92406abe0 2023-11-18T23:41:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.812+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c009b30 con 0x7fc92406abe0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.812+0000 7fc919ffb640 1 -- 172.21.15.8:0/2593941442 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920013470 con 0x7fc92406abe0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.812+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9240ade70 con 0x7fc92406abe0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.813+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92406e6a0 con 0x7fc92406abe0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.813+0000 7fc919ffb640 1 -- 172.21.15.8:0/2593941442 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9200135d0 con 0x7fc92406abe0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.814+0000 7fc919ffb640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc90806ae40 0x7fc90806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.814+0000 7fc919ffb640 1 -- 172.21.15.8:0/2593941442 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fc920089890 con 0x7fc92406abe0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.814+0000 7fc9289b7640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc90806ae40 0x7fc90806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.814+0000 7fc9289b7640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc90806ae40 0x7fc90806d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9240b2620 tx=0x7fc914007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.818+0000 7fc919ffb640 1 -- 172.21.15.8:0/2593941442 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc920054960 con 0x7fc92406abe0 2023-11-18T23:41:53.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.994+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc92404e920 con 0x7fc92406abe0 2023-11-18T23:41:53.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.995+0000 7fc919ffb640 1 -- 172.21.15.8:0/2593941442 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9200170a0 con 0x7fc92406abe0 2023-11-18T23:41:53.996 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc90806ae40 msgr2=0x7fc90806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc90806ae40 0x7fc90806d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9240b2620 tx=0x7fc914007d50 comp rx=0 tx=0).stop 2023-11-18T23:41:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc92406abe0 msgr2=0x7fc9241f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc92406abe0 0x7fc9241f21b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e960 tx=0x7fc92000ee20 comp rx=0 tx=0).stop 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 shutdown_connections 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc90806ae40 0x7fc90806d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9241465d0 0x7fc9241527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc924071d40 0x7fc9241522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 --2- 172.21.15.8:0/2593941442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc92406abe0 0x7fc9241f21b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 >> 172.21.15.8:0/2593941442 conn(0x7fc9240cc930 msgr2=0x7fc9240cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 shutdown_connections 2023-11-18T23:41:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:53.997+0000 7fc92b41c640 1 -- 172.21.15.8:0/2593941442 wait complete. 2023-11-18T23:41:54.009 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:54.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.116+0000 7fd6913dc640 1 Processor -- start 2023-11-18T23:41:54.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.116+0000 7fd6913dc640 1 -- start start 2023-11-18T23:41:54.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd6913dc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c1465d0 0x7fd68c0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd6913dc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd68c06abe0 0x7fd68c160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd6913dc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c0721d0 con 0x7fd68c071d40 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd6913dc640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c161d80 con 0x7fd68c06abe0 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd6913dc640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1612d0 con 0x7fd68c1465d0 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd68c06abe0 0x7fd68c160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd68c06abe0 0x7fd68c160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50746/0 (socket says 172.21.15.8:50746) 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68b7fe640 1 -- 172.21.15.8:0/4032986734 learned_addr learned my addr 172.21.15.8:0/4032986734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68affd640 1 --2- 172.21.15.8:0/4032986734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c1465d0 0x7fd68c0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68b7fe640 1 -- 172.21.15.8:0/4032986734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c1465d0 msgr2=0x7fd68c0b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68b7fe640 1 --2- 172.21.15.8:0/4032986734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c1465d0 0x7fd68c0b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68b7fe640 1 -- 172.21.15.8:0/4032986734 >> v1:172.21.15.116:6789/0 conn(0x7fd68c071d40 legacy=0x7fd68c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68b7fe640 1 -- 172.21.15.8:0/4032986734 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c0cf790 con 0x7fd68c06abe0 2023-11-18T23:41:54.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.117+0000 7fd68affd640 1 --2- 172.21.15.8:0/4032986734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c1465d0 0x7fd68c0b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.118+0000 7fd68b7fe640 1 --2- 172.21.15.8:0/4032986734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c06abe0 0x7fd68c160d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd684009e50 tx=0x7fd68402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486e8801ff8da779 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.118+0000 7fd68a7fc640 1 -- 172.21.15.8:0/4032986734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68402cb00 con 0x7fd68c06abe0 2023-11-18T23:41:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.118+0000 7fd68a7fc640 1 -- 172.21.15.8:0/4032986734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68402cc60 con 0x7fd68c06abe0 2023-11-18T23:41:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.118+0000 7fd68a7fc640 1 -- 172.21.15.8:0/4032986734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840343f0 con 0x7fd68c06abe0 2023-11-18T23:41:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.118+0000 7fd6913dc640 1 -- 172.21.15.8:0/4032986734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c06abe0 msgr2=0x7fd68c160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.118+0000 7fd6913dc640 1 --2- 172.21.15.8:0/4032986734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c06abe0 0x7fd68c160d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd684009e50 tx=0x7fd68402bf60 comp rx=0 tx=0).stop 2023-11-18T23:41:54.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.119+0000 7fd6913dc640 1 -- 172.21.15.8:0/4032986734 shutdown_connections 2023-11-18T23:41:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.119+0000 7fd6913dc640 1 --2- 172.21.15.8:0/4032986734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c06abe0 0x7fd68c160d90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.119+0000 7fd6913dc640 1 --2- 172.21.15.8:0/4032986734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c1465d0 0x7fd68c0b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.119+0000 7fd6913dc640 1 -- 172.21.15.8:0/4032986734 >> 172.21.15.8:0/4032986734 conn(0x7fd68c0cc930 msgr2=0x7fd68c0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.119+0000 7fd6913dc640 1 -- 172.21.15.8:0/4032986734 shutdown_connections 2023-11-18T23:41:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.119+0000 7fd6913dc640 1 -- 172.21.15.8:0/4032986734 wait complete. 2023-11-18T23:41:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 Processor -- start 2023-11-18T23:41:54.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 -- start start 2023-11-18T23:41:54.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c06abe0 0x7fd68c1e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd68c071d40 0x7fd68c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c1465d0 0x7fd68c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0ad1a0 con 0x7fd68c1465d0 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1e9a20 con 0x7fd68c071d40 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.120+0000 7fd6913dc640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1e87b0 con 0x7fd68c06abe0 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c1465d0 0x7fd68c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c1465d0 0x7fd68c15f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50752/0 (socket says 172.21.15.8:50752) 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 -- 172.21.15.8:0/3189229903 learned_addr learned my addr 172.21.15.8:0/3189229903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68affd640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c06abe0 0x7fd68c1e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd683fff640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd68c071d40 0x7fd68c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 -- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c06abe0 msgr2=0x7fd68c1e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c06abe0 0x7fd68c1e94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 -- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd68c071d40 msgr2=0x7fd68c0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd68c071d40 0x7fd68c0adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 -- 172.21.15.8:0/3189229903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684009b30 con 0x7fd68c1465d0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd683fff640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd68c071d40 0x7fd68c0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd68b7fe640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c1465d0 0x7fd68c15f920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd684009e50 tx=0x7fd684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd6837fe640 1 -- 172.21.15.8:0/3189229903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684009510 con 0x7fd68c1465d0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd6837fe640 1 -- 172.21.15.8:0/3189229903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68403e450 con 0x7fd68c1465d0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c1e8a90 con 0x7fd68c1465d0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd6837fe640 1 -- 172.21.15.8:0/3189229903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68403e800 con 0x7fd68c1465d0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.121+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c0ad720 con 0x7fd68c1465d0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.122+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c06e6a0 con 0x7fd68c1465d0 2023-11-18T23:41:54.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.123+0000 7fd6837fe640 1 -- 172.21.15.8:0/3189229903 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd68403e960 con 0x7fd68c1465d0 2023-11-18T23:41:54.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.123+0000 7fd6837fe640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd66c06ae70 0x7fd66c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.123+0000 7fd6837fe640 1 -- 172.21.15.8:0/3189229903 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fd6840ac2e0 con 0x7fd68c1465d0 2023-11-18T23:41:54.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.124+0000 7fd68affd640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd66c06ae70 0x7fd66c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.124+0000 7fd68affd640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd66c06ae70 0x7fd66c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0ce600 tx=0x7fd67c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.128+0000 7fd6837fe640 1 -- 172.21.15.8:0/3189229903 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd684077390 con 0x7fd68c1465d0 2023-11-18T23:41:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.321+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd68c0cd5c0 con 0x7fd68c1465d0 2023-11-18T23:41:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.322+0000 7fd6837fe640 1 -- 172.21.15.8:0/3189229903 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd68407a9b0 con 0x7fd68c1465d0 2023-11-18T23:41:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd66c06ae70 msgr2=0x7fd66c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd66c06ae70 0x7fd66c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0ce600 tx=0x7fd67c008040 comp rx=0 tx=0).stop 2023-11-18T23:41:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c1465d0 msgr2=0x7fd68c15f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c1465d0 0x7fd68c15f920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd684009e50 tx=0x7fd684004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 shutdown_connections 2023-11-18T23:41:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd66c06ae70 0x7fd66c06d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd68c1465d0 0x7fd68c15f920 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd68c071d40 0x7fd68c0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 --2- 172.21.15.8:0/3189229903 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd68c06abe0 0x7fd68c1e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 >> 172.21.15.8:0/3189229903 conn(0x7fd68c0cc930 msgr2=0x7fd68c0b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 shutdown_connections 2023-11-18T23:41:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.323+0000 7fd6913dc640 1 -- 172.21.15.8:0/3189229903 wait complete. 2023-11-18T23:41:54.335 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-18T23:41:54.336 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T23:41:54.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:54.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.460+0000 7f642b47c640 1 Processor -- start 2023-11-18T23:41:54.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.460+0000 7f642b47c640 1 -- start start 2023-11-18T23:41:54.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f642b47c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f642409a080 0x7f64240b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f642b47c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64240b0660 con 0x7f642415d900 2023-11-18T23:41:54.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f642b47c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642406c900 con 0x7f64240b2610 2023-11-18T23:41:54.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f642b47c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642406cbe0 con 0x7f642409a080 2023-11-18T23:41:54.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f6429218640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f642415d900 0x7f6424099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38686/0 (socket says 172.21.15.8:38686) 2023-11-18T23:41:54.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f6429218640 1 -- 172.21.15.8:0/1315589895 learned_addr learned my addr 172.21.15.8:0/1315589895 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:54.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142077248 0 0) 0x7f64240b0660 con 0x7f642415d900 2023-11-18T23:41:54.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f6428a17640 1 --2- 172.21.15.8:0/1315589895 >> v2:172.21.15.116:3300/0 conn(0x7f642409a080 0x7f64240b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.461+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f640c003520 con 0x7f642415d900 2023-11-18T23:41:54.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107465976 0 0) 0x7f640c003520 con 0x7f642415d900 2023-11-18T23:41:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 >> v2:172.21.15.116:3300/0 conn(0x7f642409a080 msgr2=0x7f64240b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 --2- 172.21.15.8:0/1315589895 >> v2:172.21.15.116:3300/0 conn(0x7f642409a080 0x7f64240b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 >> v1:172.21.15.116:6789/0 conn(0x7f64240b2610 legacy=0x7f64240b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642406cec0 con 0x7f642415d900 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f641c001670 con 0x7f642415d900 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 >> v1:172.21.15.8:6789/0 conn(0x7f642415d900 legacy=0x7f6424099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f640c003970 0x7f640c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f640c0047c0 0x7f640c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f640c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642406cbe0 con 0x7f640c005180 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c00c020 con 0x7f640c0047c0 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c00c1e0 con 0x7f640c003970 2023-11-18T23:41:54.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6429a19640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f640c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6428a17640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f640c0047c0 0x7f640c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6429218640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f640c003970 0x7f640c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6429a19640 1 -- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f640c003970 msgr2=0x7f640c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6429a19640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f640c003970 0x7f640c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6429a19640 1 -- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f640c0047c0 msgr2=0x7f640c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6429a19640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f640c0047c0 0x7f640c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.462+0000 7f6429a19640 1 -- 172.21.15.8:0/1315589895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c003520 con 0x7f640c005180 2023-11-18T23:41:54.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.463+0000 7f6429a19640 1 -- 172.21.15.8:0/1315589895 reap_dead start 2023-11-18T23:41:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.463+0000 7f6429a19640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f640c00b980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6414001e50 tx=0x7f640c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa66301eac45f59 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.463+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414003b70 con 0x7f640c005180 2023-11-18T23:41:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.463+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6414003d10 con 0x7f640c005180 2023-11-18T23:41:54.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.463+0000 7f6423fff640 1 -- 172.21.15.8:0/1315589895 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414005310 con 0x7f640c005180 2023-11-18T23:41:54.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.464+0000 7f642b47c640 1 -- 172.21.15.8:0/1315589895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 msgr2=0x7f640c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.464+0000 7f642b47c640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f640c00b980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6414001e50 tx=0x7f640c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.464+0000 7f642b47c640 1 -- 172.21.15.8:0/1315589895 shutdown_connections 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.464+0000 7f642b47c640 1 --2- 172.21.15.8:0/1315589895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f640c00b980 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.464+0000 7f642b47c640 1 -- 172.21.15.8:0/1315589895 >> 172.21.15.8:0/1315589895 conn(0x7f64240b2a70 msgr2=0x7f64240b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.464+0000 7f642b47c640 1 -- 172.21.15.8:0/1315589895 shutdown_connections 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.464+0000 7f642b47c640 1 -- 172.21.15.8:0/1315589895 wait complete. 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.465+0000 7f642b47c640 1 Processor -- start 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.465+0000 7f642b47c640 1 -- start start 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f642b47c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f64241e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f642b47c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64240b5dd0 0x7f64241e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f642b47c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f642415fee0 0x7f6424160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f642b47c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642415dce0 con 0x7f640c005180 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f642b47c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240b62d0 con 0x7f642415fee0 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f642b47c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240b65b0 con 0x7f64240b5dd0 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f64241e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f64241e73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50780/0 (socket says 172.21.15.8:50780) 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 -- 172.21.15.8:0/4148834713 learned_addr learned my addr 172.21.15.8:0/4148834713 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6428a17640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64240b5dd0 0x7f64241e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429a19640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f642415fee0 0x7f6424160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 -- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64240b5dd0 msgr2=0x7f64241e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64240b5dd0 0x7f64241e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 -- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f642415fee0 msgr2=0x7f6424160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f642415fee0 0x7f6424160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 -- 172.21.15.8:0/4148834713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240b6890 con 0x7f640c005180 2023-11-18T23:41:54.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6428a17640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64240b5dd0 0x7f64241e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:54.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429a19640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f642415fee0 0x7f6424160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:54.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6429218640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f64241e73a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f641c0070b0 tx=0x7f641c007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6421ffb640 1 -- 172.21.15.8:0/4148834713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00f9c0 con 0x7f640c005180 2023-11-18T23:41:54.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f6421ffb640 1 -- 172.21.15.8:0/4148834713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c00fb20 con 0x7f640c005180 2023-11-18T23:41:54.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.466+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642415df30 con 0x7f640c005180 2023-11-18T23:41:54.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.467+0000 7f6421ffb640 1 -- 172.21.15.8:0/4148834713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00fed0 con 0x7f640c005180 2023-11-18T23:41:54.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.467+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6424160ab0 con 0x7f640c005180 2023-11-18T23:41:54.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.468+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6424067420 con 0x7f640c005180 2023-11-18T23:41:54.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.468+0000 7f6421ffb640 1 -- 172.21.15.8:0/4148834713 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f641c01d460 con 0x7f640c005180 2023-11-18T23:41:54.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.468+0000 7f6421ffb640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f641006ae70 0x7f641006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.469+0000 7f6421ffb640 1 -- 172.21.15.8:0/4148834713 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f641c089880 con 0x7f640c005180 2023-11-18T23:41:54.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.469+0000 7f6428a17640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f641006ae70 0x7f641006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.469+0000 7f6428a17640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f641006ae70 0x7f641006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6418006b10 tx=0x7f6418008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.473+0000 7f6421ffb640 1 -- 172.21.15.8:0/4148834713 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f641c054890 con 0x7f640c005180 2023-11-18T23:41:54.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.650+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f642409a760 con 0x7f640c005180 2023-11-18T23:41:54.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.651+0000 7f6421ffb640 1 -- 172.21.15.8:0/4148834713 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16719 (secure 0 0 0) 0x7f641c057eb0 con 0x7f640c005180 2023-11-18T23:41:54.652 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:54.653 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":22,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:53.075510+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":1},{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f641006ae70 msgr2=0x7f641006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f641006ae70 0x7f641006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6418006b10 tx=0x7f6418008040 comp rx=0 tx=0).stop 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 msgr2=0x7f64241e73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f64241e73a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f641c0070b0 tx=0x7f641c007570 comp rx=0 tx=0).stop 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 shutdown_connections 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f641006ae70 0x7f641006d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f642415fee0 0x7f6424160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64240b5dd0 0x7f64241e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 --2- 172.21.15.8:0/4148834713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f640c005180 0x7f64241e73a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 >> 172.21.15.8:0/4148834713 conn(0x7f64240b2a70 msgr2=0x7f6424159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:54.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 shutdown_connections 2023-11-18T23:41:54.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.653+0000 7f642b47c640 1 -- 172.21.15.8:0/4148834713 wait complete. 2023-11-18T23:41:54.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:54.666 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:54.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.774+0000 7f6cad4e7640 1 Processor -- start 2023-11-18T23:41:54.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.774+0000 7f6cad4e7640 1 -- start start 2023-11-18T23:41:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.774+0000 7f6cad4e7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6ca813f750 0x7f6ca815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.774+0000 7f6cad4e7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80ce060 con 0x7f6ca8070630 2023-11-18T23:41:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.774+0000 7f6cad4e7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80ce340 con 0x7f6ca813fb30 2023-11-18T23:41:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.774+0000 7f6cad4e7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80cec70 con 0x7f6ca813f750 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca6ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6ca813f750 0x7f6ca815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca6ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6ca813f750 0x7f6ca815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50786/0 (socket says 172.21.15.8:50786) 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca77fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6ca8070630 0x7f6ca8070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38698/0 (socket says 172.21.15.8:38698) 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/2486567948 learned_addr learned my addr 172.21.15.8:0/2486567948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/2486567948 >> v1:172.21.15.116:6789/0 conn(0x7f6ca813fb30 legacy=0x7f6ca80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/2486567948 >> v1:172.21.15.8:6789/0 conn(0x7f6ca8070630 legacy=0x7f6ca8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/2486567948 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80ce620 con 0x7f6ca813f750 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.775+0000 7f6ca5ffb640 1 -- 172.21.15.8:0/2486567948 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050403215 0 0) 0x7f6ca80ce060 con 0x7f6ca8070630 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.776+0000 7f6ca6ffd640 1 --2- 172.21.15.8:0/2486567948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca815b0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11a1c2fadfbcacb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.776+0000 7f6ca5ffb640 1 -- 172.21.15.8:0/2486567948 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9802f840 con 0x7f6ca813f750 2023-11-18T23:41:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.776+0000 7f6ca5ffb640 1 -- 172.21.15.8:0/2486567948 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9802f9a0 con 0x7f6ca813f750 2023-11-18T23:41:54.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.776+0000 7f6ca5ffb640 1 -- 172.21.15.8:0/2486567948 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9802fd30 con 0x7f6ca813f750 2023-11-18T23:41:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.776+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2486567948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 msgr2=0x7f6ca815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.776+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2486567948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca815b0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9802ba20 comp rx=0 tx=0).stop 2023-11-18T23:41:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.777+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2486567948 shutdown_connections 2023-11-18T23:41:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.777+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2486567948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca815b0d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.777+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2486567948 >> 172.21.15.8:0/2486567948 conn(0x7f6ca806a8f0 msgr2=0x7f6ca806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.777+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2486567948 shutdown_connections 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.777+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2486567948 wait complete. 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.778+0000 7f6cad4e7640 1 Processor -- start 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.778+0000 7f6cad4e7640 1 -- start start 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6cad4e7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ca8070630 0x7f6ca8137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6cad4e7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca8158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6cad4e7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ca813fb30 0x7f6ca81586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6cad4e7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8139ab0 con 0x7f6ca813f750 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6cad4e7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8139d90 con 0x7f6ca8070630 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6cad4e7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca813a070 con 0x7f6ca813fb30 2023-11-18T23:41:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca8158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca8158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50790/0 (socket says 172.21.15.8:50790) 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 -- 172.21.15.8:0/2093261183 learned_addr learned my addr 172.21.15.8:0/2093261183 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca6ffd640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ca8070630 0x7f6ca8137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca77fe640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ca813fb30 0x7f6ca81586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 -- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ca813fb30 msgr2=0x7f6ca81586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ca813fb30 0x7f6ca81586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 -- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ca8070630 msgr2=0x7f6ca8137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ca8070630 0x7f6ca8137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 -- 172.21.15.8:0/2093261183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980094d0 con 0x7f6ca813f750 2023-11-18T23:41:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca6ffd640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ca8070630 0x7f6ca8137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca77fe640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ca813fb30 0x7f6ca81586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6ca67fc640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca8158170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c450 tx=0x7f6c9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6c8f7fe640 1 -- 172.21.15.8:0/2093261183 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c0052d0 con 0x7f6ca813f750 2023-11-18T23:41:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6c8f7fe640 1 -- 172.21.15.8:0/2093261183 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c005430 con 0x7f6ca813f750 2023-11-18T23:41:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca813a350 con 0x7f6ca813f750 2023-11-18T23:41:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.779+0000 7f6c8f7fe640 1 -- 172.21.15.8:0/2093261183 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c012870 con 0x7f6ca813f750 2023-11-18T23:41:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.780+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8138d30 con 0x7f6ca813f750 2023-11-18T23:41:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.780+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8154e50 con 0x7f6ca813f750 2023-11-18T23:41:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.781+0000 7f6c8f7fe640 1 -- 172.21.15.8:0/2093261183 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c9c0129d0 con 0x7f6ca813f750 2023-11-18T23:41:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.781+0000 7f6c8f7fe640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c9406ae40 0x7f6c9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.781+0000 7f6c8f7fe640 1 -- 172.21.15.8:0/2093261183 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f6c9c089280 con 0x7f6ca813f750 2023-11-18T23:41:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.782+0000 7f6ca6ffd640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c9406ae40 0x7f6c9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.782+0000 7f6ca6ffd640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c9406ae40 0x7f6c9406d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6c98036000 tx=0x7f6c98039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:54.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.786+0000 7f6c8f7fe640 1 -- 172.21.15.8:0/2093261183 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ca8154e50 con 0x7f6ca813f750 2023-11-18T23:41:54.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.960+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ca8154e50 con 0x7f6ca813f750 2023-11-18T23:41:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.960+0000 7f6c8f7fe640 1 -- 172.21.15.8:0/2093261183 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ca8154e50 con 0x7f6ca813f750 2023-11-18T23:41:54.962 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c9406ae40 msgr2=0x7f6c9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c9406ae40 0x7f6c9406d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6c98036000 tx=0x7f6c98039040 comp rx=0 tx=0).stop 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 msgr2=0x7f6ca8158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca8158170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c450 tx=0x7f6c9c00c910 comp rx=0 tx=0).stop 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 shutdown_connections 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f6c9406ae40 0x7f6c9406d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ca813fb30 0x7f6ca81586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca813f750 0x7f6ca8158170 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 --2- 172.21.15.8:0/2093261183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ca8070630 0x7f6ca8137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 >> 172.21.15.8:0/2093261183 conn(0x7f6ca806a8f0 msgr2=0x7f6ca815aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 shutdown_connections 2023-11-18T23:41:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:54.962+0000 7f6cad4e7640 1 -- 172.21.15.8:0/2093261183 wait complete. 2023-11-18T23:41:54.974 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:55.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.082+0000 7f67b5a56640 1 Processor -- start 2023-11-18T23:41:55.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.082+0000 7f67b5a56640 1 -- start start 2023-11-18T23:41:55.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67b5a56640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f67b00b2aa0 0x7f67b0168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67b5a56640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b00ce360 con 0x7f67b0160b70 2023-11-18T23:41:55.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67b5a56640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b00d19f0 con 0x7f67b00d1570 2023-11-18T23:41:55.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67b5a56640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b00cdd50 con 0x7f67b00b2aa0 2023-11-18T23:41:55.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67aeffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f67b0160b70 0x7f67b00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38700/0 (socket says 172.21.15.8:38700) 2023-11-18T23:41:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67aeffd640 1 -- 172.21.15.8:0/2368112496 learned_addr learned my addr 172.21.15.8:0/2368112496 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67af7fe640 1 --2- 172.21.15.8:0/2368112496 >> v2:172.21.15.116:3300/0 conn(0x7f67b00b2aa0 0x7f67b0168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.083+0000 7f67adffb640 1 -- 172.21.15.8:0/2368112496 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675600919 0 0) 0x7f67b00ce360 con 0x7f67b0160b70 2023-11-18T23:41:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.084+0000 7f67adffb640 1 -- 172.21.15.8:0/2368112496 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6798003520 con 0x7f67b0160b70 2023-11-18T23:41:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.084+0000 7f67adffb640 1 -- 172.21.15.8:0/2368112496 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2583368807 0 0) 0x7f6798003520 con 0x7f67b0160b70 2023-11-18T23:41:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.084+0000 7f67af7fe640 1 -- 172.21.15.8:0/2368112496 >> v1:172.21.15.116:6789/0 conn(0x7f67b00d1570 legacy=0x7f67b00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.084+0000 7f67af7fe640 1 -- 172.21.15.8:0/2368112496 >> v1:172.21.15.8:6789/0 conn(0x7f67b0160b70 legacy=0x7f67b00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.084+0000 7f67af7fe640 1 -- 172.21.15.8:0/2368112496 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b00b2ed0 con 0x7f67b00b2aa0 2023-11-18T23:41:55.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67af7fe640 1 --2- 172.21.15.8:0/2368112496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0168560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009d90 tx=0x7f67a802bc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3bcf9fd089075df server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67adffb640 1 -- 172.21.15.8:0/2368112496 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0001670 con 0x7f67b00b2aa0 2023-11-18T23:41:55.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67adffb640 1 -- 172.21.15.8:0/2368112496 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a802c7a0 con 0x7f67b00b2aa0 2023-11-18T23:41:55.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67adffb640 1 -- 172.21.15.8:0/2368112496 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a802cb10 con 0x7f67b00b2aa0 2023-11-18T23:41:55.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67b5a56640 1 -- 172.21.15.8:0/2368112496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 msgr2=0x7f67b0168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67b5a56640 1 --2- 172.21.15.8:0/2368112496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0168560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009d90 tx=0x7f67a802bc70 comp rx=0 tx=0).stop 2023-11-18T23:41:55.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67b5a56640 1 -- 172.21.15.8:0/2368112496 shutdown_connections 2023-11-18T23:41:55.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67b5a56640 1 --2- 172.21.15.8:0/2368112496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0168560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67b5a56640 1 -- 172.21.15.8:0/2368112496 >> 172.21.15.8:0/2368112496 conn(0x7f67b009c470 msgr2=0x7f67b00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:55.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67b5a56640 1 -- 172.21.15.8:0/2368112496 shutdown_connections 2023-11-18T23:41:55.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.085+0000 7f67b5a56640 1 -- 172.21.15.8:0/2368112496 wait complete. 2023-11-18T23:41:55.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 Processor -- start 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 -- start start 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67b00d1570 0x7f67b00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67b0160b70 0x7f67b00cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00c8890 con 0x7f67b0160b70 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00c9b60 con 0x7f67b00b2aa0 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.087+0000 7f67b5a56640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00c8ac0 con 0x7f67b00d1570 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67b0160b70 0x7f67b00cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67b0160b70 0x7f67b00cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50800/0 (socket says 172.21.15.8:50800) 2023-11-18T23:41:55.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 -- 172.21.15.8:0/664908526 learned_addr learned my addr 172.21.15.8:0/664908526 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67aeffd640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67ae7fc640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67b00d1570 0x7f67b00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 -- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67b00d1570 msgr2=0x7f67b00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67b00d1570 0x7f67b00c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 -- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 msgr2=0x7f67b0159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 -- 172.21.15.8:0/664908526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8009a70 con 0x7f67b0160b70 2023-11-18T23:41:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67aeffd640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:55.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67af7fe640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67b0160b70 0x7f67b00cbdb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009eb0 tx=0x7f67a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f6797fff640 1 -- 172.21.15.8:0/664908526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8035c10 con 0x7f67b0160b70 2023-11-18T23:41:55.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f6797fff640 1 -- 172.21.15.8:0/664908526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a8035d90 con 0x7f67b0160b70 2023-11-18T23:41:55.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b00c8da0 con 0x7f67b0160b70 2023-11-18T23:41:55.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f6797fff640 1 -- 172.21.15.8:0/664908526 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a803e650 con 0x7f67b0160b70 2023-11-18T23:41:55.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.088+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b00c9360 con 0x7f67b0160b70 2023-11-18T23:41:55.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.089+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b00a1150 con 0x7f67b0160b70 2023-11-18T23:41:55.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.090+0000 7f6797fff640 1 -- 172.21.15.8:0/664908526 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67a803b050 con 0x7f67b0160b70 2023-11-18T23:41:55.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.090+0000 7f6797fff640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f679c06ae40 0x7f679c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.090+0000 7f6797fff640 1 -- 172.21.15.8:0/664908526 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f67a80ab540 con 0x7f67b0160b70 2023-11-18T23:41:55.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.090+0000 7f67aeffd640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f679c06ae40 0x7f679c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.091+0000 7f67aeffd640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f679c06ae40 0x7f679c06d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f67a0001eb0 tx=0x7f67a0001d00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.095+0000 7f6797fff640 1 -- 172.21.15.8:0/664908526 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67a8076560 con 0x7f67b0160b70 2023-11-18T23:41:55.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.275+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67b00b22d0 con 0x7f67b0160b70 2023-11-18T23:41:55.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.275+0000 7f6797fff640 1 -- 172.21.15.8:0/664908526 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67a8079b80 con 0x7f67b0160b70 2023-11-18T23:41:55.277 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f679c06ae40 msgr2=0x7f679c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f679c06ae40 0x7f679c06d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f67a0001eb0 tx=0x7f67a0001d00 comp rx=0 tx=0).stop 2023-11-18T23:41:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67b0160b70 msgr2=0x7f67b00cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67b0160b70 0x7f67b00cbdb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009eb0 tx=0x7f67a8004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 shutdown_connections 2023-11-18T23:41:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f679c06ae40 0x7f679c06d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67b0160b70 0x7f67b00cbdb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67b00d1570 0x7f67b00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 --2- 172.21.15.8:0/664908526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67b00b2aa0 0x7f67b0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.277+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 >> 172.21.15.8:0/664908526 conn(0x7f67b009c470 msgr2=0x7f67b006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:55.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.278+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 shutdown_connections 2023-11-18T23:41:55.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.278+0000 7f67b5a56640 1 -- 172.21.15.8:0/664908526 wait complete. 2023-11-18T23:41:55.289 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.397+0000 7f23941e9640 1 Processor -- start 2023-11-18T23:41:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.397+0000 7f23941e9640 1 -- start start 2023-11-18T23:41:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f23941e9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 0x7f238c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f23941e9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f238c06bc50 0x7f238c06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f23941e9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c0b3590 con 0x7f238c099970 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f23941e9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c06b310 con 0x7f238c06bc50 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f23941e9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0cd3a0 con 0x7f238c0b6b50 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f2391784640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f238c099970 0x7f238c099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38708/0 (socket says 172.21.15.8:38708) 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f2391784640 1 -- 172.21.15.8:0/1468664441 learned_addr learned my addr 172.21.15.8:0/1468664441 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f2392786640 1 --2- 172.21.15.8:0/1468664441 >> v2:172.21.15.116:3300/0 conn(0x7f238c06bc50 0x7f238c06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f2391f85640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 0x7f238c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053275501 0 0) 0x7f238c0b3590 con 0x7f238c099970 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.398+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2374003520 con 0x7f238c099970 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 706721347 0 0) 0x7f2374003520 con 0x7f238c099970 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 msgr2=0x7f238c0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 0x7f238c0cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 >> v2:172.21.15.116:3300/0 conn(0x7f238c06bc50 msgr2=0x7f238c06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 --2- 172.21.15.8:0/1468664441 >> v2:172.21.15.116:3300/0 conn(0x7f238c06bc50 0x7f238c06c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0b37c0 con 0x7f238c099970 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f2380001670 con 0x7f238c099970 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 >> v1:172.21.15.8:6789/0 conn(0x7f238c099970 legacy=0x7f238c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f2374003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 0x7f23740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2374004d00 0x7f2374005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c06b310 con 0x7f2374003970 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2391f85640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f2374003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0cd3a0 con 0x7f2374004d00 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237400b980 con 0x7f238c0b6b50 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2391784640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 0x7f23740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2392786640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2374004d00 0x7f2374005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2391f85640 1 -- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 msgr2=0x7f23740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2391f85640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c0b6b50 0x7f23740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2391f85640 1 -- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2374004d00 msgr2=0x7f2374005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2391f85640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2374004d00 0x7f2374005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.399+0000 7f2391f85640 1 -- 172.21.15.8:0/1468664441 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2374003520 con 0x7f2374003970 2023-11-18T23:41:55.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.400+0000 7f2391f85640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f2374003d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f237c009fc0 tx=0x7f23740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355344ea8656a548 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.400+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c02cc20 con 0x7f2374003970 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.400+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00f040 con 0x7f2374003970 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.400+0000 7f2390f83640 1 -- 172.21.15.8:0/1468664441 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c034440 con 0x7f2374003970 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.401+0000 7f23941e9640 1 -- 172.21.15.8:0/1468664441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 msgr2=0x7f2374003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.401+0000 7f23941e9640 1 --2- 172.21.15.8:0/1468664441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f2374003d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f237c009fc0 tx=0x7f23740057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.401+0000 7f2392786640 1 -- 172.21.15.8:0/1468664441 reap_dead start 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.401+0000 7f23941e9640 1 -- 172.21.15.8:0/1468664441 shutdown_connections 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.401+0000 7f23941e9640 1 -- 172.21.15.8:0/1468664441 >> 172.21.15.8:0/1468664441 conn(0x7f238c0b2a70 msgr2=0x7f238c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.401+0000 7f23941e9640 1 -- 172.21.15.8:0/1468664441 shutdown_connections 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.401+0000 7f23941e9640 1 -- 172.21.15.8:0/1468664441 wait complete. 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.402+0000 7f23941e9640 1 Processor -- start 2023-11-18T23:41:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.402+0000 7f23941e9640 1 -- start start 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f238c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c14ad40 0x7f238c0c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c14d400 0x7f238c14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c1516e0 con 0x7f2374003970 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0cb200 con 0x7f238c14ad40 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c14ddc0 con 0x7f238c14d400 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f238c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f238c0cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50814/0 (socket says 172.21.15.8:50814) 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 -- 172.21.15.8:0/1385976265 learned_addr learned my addr 172.21.15.8:0/1385976265 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391784640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c14ad40 0x7f238c0c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2392786640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c14d400 0x7f238c14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 -- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c14d400 msgr2=0x7f238c14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c14d400 0x7f238c14d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 -- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c14ad40 msgr2=0x7f238c0c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c14ad40 0x7f238c0c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 -- 172.21.15.8:0/1385976265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0c74a0 con 0x7f2374003970 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391784640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c14ad40 0x7f238c0c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f2391f85640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f238c0cacc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f237c00e230 tx=0x7f237c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f238a7fc640 1 -- 172.21.15.8:0/1385976265 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c034bd0 con 0x7f2374003970 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f238a7fc640 1 -- 172.21.15.8:0/1385976265 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c034d30 con 0x7f2374003970 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c0c6ad0 con 0x7f2374003970 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f238a7fc640 1 -- 172.21.15.8:0/1385976265 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c034ea0 con 0x7f2374003970 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.403+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c0c61a0 con 0x7f2374003970 2023-11-18T23:41:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.404+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c0c7ea0 con 0x7f2374003970 2023-11-18T23:41:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.405+0000 7f238a7fc640 1 -- 172.21.15.8:0/1385976265 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f237c040450 con 0x7f2374003970 2023-11-18T23:41:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.405+0000 7f238a7fc640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f237806ae70 0x7f237806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.405+0000 7f238a7fc640 1 -- 172.21.15.8:0/1385976265 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f237c0abd20 con 0x7f2374003970 2023-11-18T23:41:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.405+0000 7f2391784640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f237806ae70 0x7f237806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.406+0000 7f2391784640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f237806ae70 0x7f237806d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2380000c00 tx=0x7f2380009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.409+0000 7f238a7fc640 1 -- 172.21.15.8:0/1385976265 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f237c076e60 con 0x7f2374003970 2023-11-18T23:41:55.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.584+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f238c0c74a0 con 0x7f2374003970 2023-11-18T23:41:55.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.584+0000 7f238a7fc640 1 -- 172.21.15.8:0/1385976265 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f238c0c74a0 con 0x7f2374003970 2023-11-18T23:41:55.586 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f237806ae70 msgr2=0x7f237806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f237806ae70 0x7f237806d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2380000c00 tx=0x7f2380009040 comp rx=0 tx=0).stop 2023-11-18T23:41:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 msgr2=0x7f238c0cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f238c0cacc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f237c00e230 tx=0x7f237c009750 comp rx=0 tx=0).stop 2023-11-18T23:41:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 shutdown_connections 2023-11-18T23:41:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f237806ae70 0x7f237806d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f238c14d400 0x7f238c14d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c14ad40 0x7f238c0c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 --2- 172.21.15.8:0/1385976265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2374003970 0x7f238c0cacc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 >> 172.21.15.8:0/1385976265 conn(0x7f238c0b2a70 msgr2=0x7f238c06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 shutdown_connections 2023-11-18T23:41:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.586+0000 7f23941e9640 1 -- 172.21.15.8:0/1385976265 wait complete. 2023-11-18T23:41:55.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T23:41:55.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.704+0000 7f856bd90640 1 Processor -- start 2023-11-18T23:41:55.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.705+0000 7f856bd90640 1 -- start start 2023-11-18T23:41:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.705+0000 7f856bd90640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8564144950 0x7f85640ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.705+0000 7f856bd90640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85641446f0 con 0x7f856406cfa0 2023-11-18T23:41:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.705+0000 7f856bd90640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856415ba80 con 0x7f8564144310 2023-11-18T23:41:55.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.705+0000 7f856bd90640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856415bd60 con 0x7f8564144950 2023-11-18T23:41:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.706+0000 7f856a32d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8564144950 0x7f85640ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.706+0000 7f856932b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f856406cfa0 0x7f856415ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38724/0 (socket says 172.21.15.8:38724) 2023-11-18T23:41:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.706+0000 7f856932b640 1 -- 172.21.15.8:0/3476700254 learned_addr learned my addr 172.21.15.8:0/3476700254 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.706+0000 7f856a32d640 1 -- 172.21.15.8:0/3476700254 >> v1:172.21.15.116:6789/0 conn(0x7f8564144310 legacy=0x7f856406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.706+0000 7f856a32d640 1 -- 172.21.15.8:0/3476700254 >> v1:172.21.15.8:6789/0 conn(0x7f856406cfa0 legacy=0x7f856415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.706+0000 7f856a32d640 1 -- 172.21.15.8:0/3476700254 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856415c040 con 0x7f8564144950 2023-11-18T23:41:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.706+0000 7f8568b2a640 1 -- 172.21.15.8:0/3476700254 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430626907 0 0) 0x7f85641446f0 con 0x7f856406cfa0 2023-11-18T23:41:55.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856a32d640 1 --2- 172.21.15.8:0/3476700254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144950 0x7f85640ce7e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f855c009d90 tx=0x7f855c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc70674a1d5c1b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f8568b2a640 1 -- 172.21.15.8:0/3476700254 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c02cc60 con 0x7f8564144950 2023-11-18T23:41:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f8568b2a640 1 -- 172.21.15.8:0/3476700254 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c02cdc0 con 0x7f8564144950 2023-11-18T23:41:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f8568b2a640 1 -- 172.21.15.8:0/3476700254 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c034660 con 0x7f8564144950 2023-11-18T23:41:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856bd90640 1 -- 172.21.15.8:0/3476700254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144950 msgr2=0x7f85640ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856bd90640 1 --2- 172.21.15.8:0/3476700254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144950 0x7f85640ce7e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f855c009d90 tx=0x7f855c02beb0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856bd90640 1 -- 172.21.15.8:0/3476700254 shutdown_connections 2023-11-18T23:41:55.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856bd90640 1 --2- 172.21.15.8:0/3476700254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144950 0x7f85640ce7e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856bd90640 1 -- 172.21.15.8:0/3476700254 >> 172.21.15.8:0/3476700254 conn(0x7f856406a8f0 msgr2=0x7f856406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:55.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856bd90640 1 -- 172.21.15.8:0/3476700254 shutdown_connections 2023-11-18T23:41:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.707+0000 7f856bd90640 1 -- 172.21.15.8:0/3476700254 wait complete. 2023-11-18T23:41:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 Processor -- start 2023-11-18T23:41:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 -- start start 2023-11-18T23:41:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f856406cfa0 0x7f856413ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144310 0x7f8564142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8564144950 0x7f85640ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564143940 con 0x7f8564144310 2023-11-18T23:41:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564070f90 con 0x7f8564144950 2023-11-18T23:41:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856bd90640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8564070380 con 0x7f856406cfa0 2023-11-18T23:41:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856932b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144310 0x7f8564142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856932b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144310 0x7f8564142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50826/0 (socket says 172.21.15.8:50826) 2023-11-18T23:41:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.709+0000 7f856932b640 1 -- 172.21.15.8:0/2813174811 learned_addr learned my addr 172.21.15.8:0/2813174811 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856a32d640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8564144950 0x7f85640ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f8569b2c640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f856406cfa0 0x7f856413ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856932b640 1 -- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f856406cfa0 msgr2=0x7f856413ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856932b640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f856406cfa0 0x7f856413ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856932b640 1 -- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8564144950 msgr2=0x7f85640ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856932b640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8564144950 0x7f85640ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856932b640 1 -- 172.21.15.8:0/2813174811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c009a70 con 0x7f8564144310 2023-11-18T23:41:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856a32d640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8564144950 0x7f85640ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856932b640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144310 0x7f8564142bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f855400c4d0 tx=0x7f855400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f855a7fc640 1 -- 172.21.15.8:0/2813174811 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540074e0 con 0x7f8564144310 2023-11-18T23:41:55.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f855a7fc640 1 -- 172.21.15.8:0/2813174811 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8554007660 con 0x7f8564144310 2023-11-18T23:41:55.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8564070660 con 0x7f8564144310 2023-11-18T23:41:55.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f855a7fc640 1 -- 172.21.15.8:0/2813174811 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554004a20 con 0x7f8564144310 2023-11-18T23:41:55.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.710+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8564070c20 con 0x7f8564144310 2023-11-18T23:41:55.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.711+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8564071100 con 0x7f8564144310 2023-11-18T23:41:55.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.712+0000 7f855a7fc640 1 -- 172.21.15.8:0/2813174811 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8554004b80 con 0x7f8564144310 2023-11-18T23:41:55.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.712+0000 7f855a7fc640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f854806ae40 0x7f854806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:55.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.712+0000 7f855a7fc640 1 -- 172.21.15.8:0/2813174811 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f85540887a0 con 0x7f8564144310 2023-11-18T23:41:55.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.712+0000 7f8569b2c640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f854806ae40 0x7f854806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:55.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.713+0000 7f8569b2c640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f854806ae40 0x7f854806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85640ccf30 tx=0x7f8560009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:55.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.716+0000 7f855a7fc640 1 -- 172.21.15.8:0/2813174811 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8554053850 con 0x7f8564144310 2023-11-18T23:41:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.906+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8564072ae0 con 0x7f8564144310 2023-11-18T23:41:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.906+0000 7f855a7fc640 1 -- 172.21.15.8:0/2813174811 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8554018080 con 0x7f8564144310 2023-11-18T23:41:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-11-18T23:41:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f854806ae40 msgr2=0x7f854806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f854806ae40 0x7f854806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85640ccf30 tx=0x7f8560009040 comp rx=0 tx=0).stop 2023-11-18T23:41:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144310 msgr2=0x7f8564142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144310 0x7f8564142bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f855400c4d0 tx=0x7f855400c990 comp rx=0 tx=0).stop 2023-11-18T23:41:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 shutdown_connections 2023-11-18T23:41:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f854806ae40 0x7f854806d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8564144950 0x7f85640ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8564144310 0x7f8564142bc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 --2- 172.21.15.8:0/2813174811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f856406cfa0 0x7f856413ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 >> 172.21.15.8:0/2813174811 conn(0x7f856406a8f0 msgr2=0x7f85640afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 shutdown_connections 2023-11-18T23:41:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:55.908+0000 7f856bd90640 1 -- 172.21.15.8:0/2813174811 wait complete. 2023-11-18T23:41:55.920 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi116.front.sepia.ceph.com... 2023-11-18T23:41:55.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:55.921 DEBUG:teuthology.orchestra.run.smithi116:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-18T23:41:55.952 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:41:55.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-11-18T23:41:55.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:41:55.953 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-18T23:41:56.010 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-18T23:41:56.010 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.115+0000 7efd60761640 1 Processor -- start 2023-11-18T23:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.115+0000 7efd60761640 1 -- start start 2023-11-18T23:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.116+0000 7efd60761640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.116+0000 7efd60761640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efd580cf890 0x7efd580b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.116+0000 7efd60761640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd580d0070 con 0x7efd58099970 2023-11-18T23:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.116+0000 7efd60761640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580cbb50 con 0x7efd580cf890 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.116+0000 7efd60761640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580cfd90 con 0x7efd5809a530 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5e4fd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efd58099970 0x7efd58099d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38734/0 (socket says 172.21.15.8:38734) 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5e4fd640 1 -- 172.21.15.8:0/3388312744 learned_addr learned my addr 172.21.15.8:0/3388312744 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5ecfe640 1 --2- 172.21.15.8:0/3388312744 >> v2:172.21.15.8:3300/0 conn(0x7efd580cf890 0x7efd580b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5dcfc640 1 --2- 172.21.15.8:0/3388312744 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5d4fb640 1 -- 172.21.15.8:0/3388312744 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093351874 0 0) 0x7efd50001110 con 0x7efd58099970 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5d4fb640 1 -- 172.21.15.8:0/3388312744 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd40003520 con 0x7efd58099970 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5ecfe640 1 -- 172.21.15.8:0/3388312744 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 msgr2=0x7efd580cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5ecfe640 1 --2- 172.21.15.8:0/3388312744 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5ecfe640 1 -- 172.21.15.8:0/3388312744 >> v1:172.21.15.8:6789/0 conn(0x7efd58099970 legacy=0x7efd58099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.117+0000 7efd5ecfe640 1 -- 172.21.15.8:0/3388312744 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580cbdf0 con 0x7efd580cf890 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.118+0000 7efd5ecfe640 1 --2- 172.21.15.8:0/3388312744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd580b0780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd48009d90 tx=0x7efd4802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cd2a06bfd4d09 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.118+0000 7efd5d4fb640 1 -- 172.21.15.8:0/3388312744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4802cc50 con 0x7efd580cf890 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.118+0000 7efd5d4fb640 1 -- 172.21.15.8:0/3388312744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4802cdb0 con 0x7efd580cf890 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.118+0000 7efd5d4fb640 1 -- 172.21.15.8:0/3388312744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48034660 con 0x7efd580cf890 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.118+0000 7efd60761640 1 -- 172.21.15.8:0/3388312744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 msgr2=0x7efd580b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.118+0000 7efd60761640 1 --2- 172.21.15.8:0/3388312744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd580b0780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd48009d90 tx=0x7efd4802bea0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.119+0000 7efd60761640 1 -- 172.21.15.8:0/3388312744 shutdown_connections 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.119+0000 7efd60761640 1 --2- 172.21.15.8:0/3388312744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd580b0780 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.119+0000 7efd60761640 1 --2- 172.21.15.8:0/3388312744 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.119+0000 7efd60761640 1 -- 172.21.15.8:0/3388312744 >> 172.21.15.8:0/3388312744 conn(0x7efd580b2a70 msgr2=0x7efd580b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:56.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.119+0000 7efd60761640 1 -- 172.21.15.8:0/3388312744 shutdown_connections 2023-11-18T23:41:56.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.119+0000 7efd60761640 1 -- 172.21.15.8:0/3388312744 wait complete. 2023-11-18T23:41:56.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.120+0000 7efd60761640 1 Processor -- start 2023-11-18T23:41:56.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.120+0000 7efd60761640 1 -- start start 2023-11-18T23:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.120+0000 7efd60761640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd58099970 0x7efd581e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.120+0000 7efd60761640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.120+0000 7efd60761640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd581e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd60761640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581e53b0 con 0x7efd580cf890 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd60761640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581e61f0 con 0x7efd58099970 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd60761640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd581e55e0 con 0x7efd5809a530 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd581e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd581e4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50836/0 (socket says 172.21.15.8:50836) 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 -- 172.21.15.8:0/630452461 learned_addr learned my addr 172.21.15.8:0/630452461 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5dcfc640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5e4fd640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd58099970 0x7efd581e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 -- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 msgr2=0x7efd580c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 -- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd58099970 msgr2=0x7efd581e6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd58099970 0x7efd581e6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 -- 172.21.15.8:0/630452461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48009a70 con 0x7efd580cf890 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5dcfc640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5e4fd640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd58099970 0x7efd581e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd5ecfe640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd581e4e70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd48009eb0 tx=0x7efd48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd56ffd640 1 -- 172.21.15.8:0/630452461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4803e610 con 0x7efd580cf890 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd56ffd640 1 -- 172.21.15.8:0/630452461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4803e770 con 0x7efd580cf890 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd581e58c0 con 0x7efd580cf890 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd56ffd640 1 -- 172.21.15.8:0/630452461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4803eb20 con 0x7efd580cf890 2023-11-18T23:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.121+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd581e5e80 con 0x7efd580cf890 2023-11-18T23:41:56.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.122+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd581e6360 con 0x7efd580cf890 2023-11-18T23:41:56.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.123+0000 7efd56ffd640 1 -- 172.21.15.8:0/630452461 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd4803b050 con 0x7efd580cf890 2023-11-18T23:41:56.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.123+0000 7efd56ffd640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7efd4406ae40 0x7efd4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.123+0000 7efd56ffd640 1 -- 172.21.15.8:0/630452461 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7efd480ab840 con 0x7efd580cf890 2023-11-18T23:41:56.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.124+0000 7efd5e4fd640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7efd4406ae40 0x7efd4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.124+0000 7efd5e4fd640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7efd4406ae40 0x7efd4406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd50007fd0 tx=0x7efd50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.128+0000 7efd56ffd640 1 -- 172.21.15.8:0/630452461 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd48076860 con 0x7efd580cf890 2023-11-18T23:41:56.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.339+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd58067420 con 0x7efd580cf890 2023-11-18T23:41:56.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.339+0000 7efd56ffd640 1 -- 172.21.15.8:0/630452461 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7efd4804d090 con 0x7efd580cf890 2023-11-18T23:41:56.341 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:56.341 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:56.342 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7efd4406ae40 msgr2=0x7efd4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7efd4406ae40 0x7efd4406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd50007fd0 tx=0x7efd50009040 comp rx=0 tx=0).stop 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 msgr2=0x7efd581e4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd581e4e70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd48009eb0 tx=0x7efd48004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 shutdown_connections 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7efd4406ae40 0x7efd4406d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd580cf890 0x7efd581e4e70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd5809a530 0x7efd580c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 --2- 172.21.15.8:0/630452461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd58099970 0x7efd581e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 >> 172.21.15.8:0/630452461 conn(0x7efd580b2a70 msgr2=0x7efd5806e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:56.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 shutdown_connections 2023-11-18T23:41:56.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.341+0000 7efd60761640 1 -- 172.21.15.8:0/630452461 wait complete. 2023-11-18T23:41:56.353 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.459+0000 7fd7e1161640 1 Processor -- start 2023-11-18T23:41:56.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.459+0000 7fd7e1161640 1 -- start start 2023-11-18T23:41:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7e1161640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7e1161640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc06ae70 con 0x7fd7dc144a50 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7e1161640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc0b2ee0 con 0x7fd7dc0b4d50 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7e1161640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc0b34a0 con 0x7fd7dc06a4d0 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7dad9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd7dc144a50 0x7fd7dc15f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38736/0 (socket says 172.21.15.8:38736) 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7dad9d640 1 -- 172.21.15.8:0/2156180525 learned_addr learned my addr 172.21.15.8:0/2156180525 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7da59c640 1 --2- 172.21.15.8:0/2156180525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613243865 0 0) 0x7fd7dc06ae70 con 0x7fd7dc144a50 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c8003520 con 0x7fd7dc144a50 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166197664 0 0) 0x7fd7dc0b2ee0 con 0x7fd7dc0b4d50 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7dc06ae70 con 0x7fd7dc0b4d50 2023-11-18T23:41:56.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7da59c640 1 -- 172.21.15.8:0/2156180525 >> v1:172.21.15.116:6789/0 conn(0x7fd7dc0b4d50 legacy=0x7fd7dc0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7da59c640 1 -- 172.21.15.8:0/2156180525 >> v1:172.21.15.8:6789/0 conn(0x7fd7dc144a50 legacy=0x7fd7dc15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 135599134 0 0) 0x7fd7c8003520 con 0x7fd7dc144a50 2023-11-18T23:41:56.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.460+0000 7fd7da59c640 1 -- 172.21.15.8:0/2156180525 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc144e30 con 0x7fd7dc06a4d0 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.461+0000 7fd7da59c640 1 --2- 172.21.15.8:0/2156180525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc06a930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40097d0 tx=0x7fd7c402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a73ea54d688c3e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.461+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4001670 con 0x7fd7dc06a4d0 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c402e050 con 0x7fd7dc06a4d0 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7d9d9b640 1 -- 172.21.15.8:0/2156180525 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4030730 con 0x7fd7dc06a4d0 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7e1161640 1 -- 172.21.15.8:0/2156180525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 msgr2=0x7fd7dc06a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7e1161640 1 --2- 172.21.15.8:0/2156180525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc06a930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40097d0 tx=0x7fd7c402b800 comp rx=0 tx=0).stop 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7e1161640 1 -- 172.21.15.8:0/2156180525 shutdown_connections 2023-11-18T23:41:56.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7e1161640 1 --2- 172.21.15.8:0/2156180525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc06a930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7e1161640 1 -- 172.21.15.8:0/2156180525 >> 172.21.15.8:0/2156180525 conn(0x7fd7dc0cc930 msgr2=0x7fd7dc0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7e1161640 1 -- 172.21.15.8:0/2156180525 shutdown_connections 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.462+0000 7fd7e1161640 1 -- 172.21.15.8:0/2156180525 wait complete. 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 Processor -- start 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 -- start start 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc1392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7dc0b4d50 0x7fd7dc1373c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7dc144a50 0x7fd7dc143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc137900 con 0x7fd7dc144a50 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc13c7e0 con 0x7fd7dc0b4d50 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7e1161640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc13d080 con 0x7fd7dc06a4d0 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.464+0000 7fd7db59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7dc144a50 0x7fd7dc143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7dc144a50 0x7fd7dc143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50850/0 (socket says 172.21.15.8:50850) 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 -- 172.21.15.8:0/3848441572 learned_addr learned my addr 172.21.15.8:0/3848441572 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7da59c640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7dc0b4d50 0x7fd7dc1373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7dad9d640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc1392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 -- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 msgr2=0x7fd7dc1392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc1392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 -- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7dc0b4d50 msgr2=0x7fd7dc1373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7dc0b4d50 0x7fd7dc1373c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 -- 172.21.15.8:0/3848441572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4009400 con 0x7fd7dc144a50 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7db59e640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7dc144a50 0x7fd7dc143600 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c710 tx=0x7fd7cc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7d37fe640 1 -- 172.21.15.8:0/3848441572 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc003b70 con 0x7fd7dc144a50 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7d37fe640 1 -- 172.21.15.8:0/3848441572 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc003cd0 con 0x7fd7dc144a50 2023-11-18T23:41:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7d37fe640 1 -- 172.21.15.8:0/3848441572 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00aa50 con 0x7fd7dc144a50 2023-11-18T23:41:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc1440c0 con 0x7fd7dc144a50 2023-11-18T23:41:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.465+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7dc13cd10 con 0x7fd7dc144a50 2023-11-18T23:41:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.466+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7dc0cc590 con 0x7fd7dc144a50 2023-11-18T23:41:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.467+0000 7fd7d37fe640 1 -- 172.21.15.8:0/3848441572 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7cc00abb0 con 0x7fd7dc144a50 2023-11-18T23:41:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.467+0000 7fd7d37fe640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd7bc06ae40 0x7fd7bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.467+0000 7fd7d37fe640 1 -- 172.21.15.8:0/3848441572 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fd7cc0894c0 con 0x7fd7dc144a50 2023-11-18T23:41:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.467+0000 7fd7dad9d640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd7bc06ae40 0x7fd7bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.468+0000 7fd7dad9d640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd7bc06ae40 0x7fd7bc06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4000f60 tx=0x7fd7d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.471+0000 7fd7d37fe640 1 -- 172.21.15.8:0/3848441572 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7dc0cc590 con 0x7fd7dc144a50 2023-11-18T23:41:56.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.652+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7dc0cc590 con 0x7fd7dc144a50 2023-11-18T23:41:56.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.653+0000 7fd7d37fe640 1 -- 172.21.15.8:0/3848441572 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16719 (secure 0 0 0) 0x7fd7dc0cc590 con 0x7fd7dc144a50 2023-11-18T23:41:56.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:56.654 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":22,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:53.075510+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":1},{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd7bc06ae40 msgr2=0x7fd7bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd7bc06ae40 0x7fd7bc06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4000f60 tx=0x7fd7d4009040 comp rx=0 tx=0).stop 2023-11-18T23:41:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7dc144a50 msgr2=0x7fd7dc143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7dc144a50 0x7fd7dc143600 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c710 tx=0x7fd7cc00cbd0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 shutdown_connections 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd7bc06ae40 0x7fd7bc06d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7dc144a50 0x7fd7dc143600 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7dc0b4d50 0x7fd7dc1373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 --2- 172.21.15.8:0/3848441572 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd7dc06a4d0 0x7fd7dc1392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 >> 172.21.15.8:0/3848441572 conn(0x7fd7dc0cc930 msgr2=0x7fd7dc0cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 shutdown_connections 2023-11-18T23:41:56.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.655+0000 7fd7e1161640 1 -- 172.21.15.8:0/3848441572 wait complete. 2023-11-18T23:41:56.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T23:41:09.408082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T23:41:10.292278+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:41:56.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:41:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.775+0000 7f38490bb640 1 Processor -- start 2023-11-18T23:41:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.775+0000 7f38490bb640 1 -- start start 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f38490bb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3844160b70 0x7f38440d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f38490bb640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f38440b2aa0 0x7f38440ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f38490bb640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38440ce360 con 0x7f38440ced30 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f38490bb640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38440b2f20 con 0x7f38440b2aa0 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f38490bb640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38440cdd50 con 0x7f3844160b70 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f384259c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f38440b2aa0 0x7f38440ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f384259c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f38440b2aa0 0x7f38440ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50856/0 (socket says 172.21.15.8:50856) 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f384359e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f38440ced30 0x7f38440cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38750/0 (socket says 172.21.15.8:38750) 2023-11-18T23:41:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f384259c640 1 -- 172.21.15.8:0/3843788686 learned_addr learned my addr 172.21.15.8:0/3843788686 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.776+0000 7f3842d9d640 1 --2- 172.21.15.8:0/3843788686 >> v2:172.21.15.116:3300/0 conn(0x7f3844160b70 0x7f38440d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f384259c640 1 -- 172.21.15.8:0/3843788686 >> v2:172.21.15.116:3300/0 conn(0x7f3844160b70 msgr2=0x7f38440d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f384259c640 1 --2- 172.21.15.8:0/3843788686 >> v2:172.21.15.116:3300/0 conn(0x7f3844160b70 0x7f38440d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f384259c640 1 -- 172.21.15.8:0/3843788686 >> v1:172.21.15.8:6789/0 conn(0x7f38440ced30 legacy=0x7f38440cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f384259c640 1 -- 172.21.15.8:0/3843788686 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440d1c70 con 0x7f38440b2aa0 2023-11-18T23:41:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f3841d9b640 1 -- 172.21.15.8:0/3843788686 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091953137 0 0) 0x7f38440ce360 con 0x7f38440ced30 2023-11-18T23:41:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f3842d9d640 1 --2- 172.21.15.8:0/3843788686 >> v2:172.21.15.116:3300/0 conn(0x7f3844160b70 0x7f38440d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:56.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f384259c640 1 --2- 172.21.15.8:0/3843788686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38440b2aa0 0x7f38440ce7f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f384408ca80 tx=0x7f382c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68a25d85550370c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.777+0000 7f3841d9b640 1 -- 172.21.15.8:0/3843788686 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c030860 con 0x7f38440b2aa0 2023-11-18T23:41:56.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f3841d9b640 1 -- 172.21.15.8:0/3843788686 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0309c0 con 0x7f38440b2aa0 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f3841d9b640 1 -- 172.21.15.8:0/3843788686 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c030d50 con 0x7f38440b2aa0 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 -- 172.21.15.8:0/3843788686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38440b2aa0 msgr2=0x7f38440ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 --2- 172.21.15.8:0/3843788686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38440b2aa0 0x7f38440ce7f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f384408ca80 tx=0x7f382c02b9a0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 -- 172.21.15.8:0/3843788686 shutdown_connections 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 --2- 172.21.15.8:0/3843788686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38440b2aa0 0x7f38440ce7f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 --2- 172.21.15.8:0/3843788686 >> v2:172.21.15.116:3300/0 conn(0x7f3844160b70 0x7f38440d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 -- 172.21.15.8:0/3843788686 >> 172.21.15.8:0/3843788686 conn(0x7f384409c470 msgr2=0x7f38440d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 -- 172.21.15.8:0/3843788686 shutdown_connections 2023-11-18T23:41:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.778+0000 7f38490bb640 1 -- 172.21.15.8:0/3843788686 wait complete. 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 Processor -- start 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 -- start start 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38440b2aa0 0x7f384415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38440ced30 0x7f384414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3844160b70 0x7f38440cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844160460 con 0x7f3844160b70 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384415e6b0 con 0x7f38440b2aa0 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f38490bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384414f460 con 0x7f38440ced30 2023-11-18T23:41:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f384359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3844160b70 0x7f38440cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f384359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3844160b70 0x7f38440cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50872/0 (socket says 172.21.15.8:50872) 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.780+0000 7f384359e640 1 -- 172.21.15.8:0/4200862195 learned_addr learned my addr 172.21.15.8:0/4200862195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f3842d9d640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38440b2aa0 0x7f384415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f384259c640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38440ced30 0x7f384414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f384359e640 1 -- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38440ced30 msgr2=0x7f384414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f384359e640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38440ced30 0x7f384414ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f384359e640 1 -- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38440b2aa0 msgr2=0x7f384415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f384359e640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38440b2aa0 0x7f384415e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f384359e640 1 -- 172.21.15.8:0/4200862195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c0094d0 con 0x7f3844160b70 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f3842d9d640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38440b2aa0 0x7f384415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f384359e640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3844160b70 0x7f38440cbac0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f383c00c480 tx=0x7f383c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f383b7fe640 1 -- 172.21.15.8:0/4200862195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c0074e0 con 0x7f3844160b70 2023-11-18T23:41:56.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f383b7fe640 1 -- 172.21.15.8:0/4200862195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c007660 con 0x7f3844160b70 2023-11-18T23:41:56.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384415da10 con 0x7f3844160b70 2023-11-18T23:41:56.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f383b7fe640 1 -- 172.21.15.8:0/4200862195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c004a20 con 0x7f3844160b70 2023-11-18T23:41:56.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.781+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384409f930 con 0x7f3844160b70 2023-11-18T23:41:56.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.782+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384409f4b0 con 0x7f3844160b70 2023-11-18T23:41:56.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.783+0000 7f383b7fe640 1 -- 172.21.15.8:0/4200862195 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f383c004b80 con 0x7f3844160b70 2023-11-18T23:41:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.783+0000 7f383b7fe640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f382406ae40 0x7f382406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.783+0000 7f383b7fe640 1 -- 172.21.15.8:0/4200862195 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f383c0887b0 con 0x7f3844160b70 2023-11-18T23:41:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.783+0000 7f3842d9d640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f382406ae40 0x7f382406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.784+0000 7f3842d9d640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f382406ae40 0x7f382406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38340044f0 tx=0x7f3834003a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.788+0000 7f383b7fe640 1 -- 172.21.15.8:0/4200862195 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f384409f4b0 con 0x7f3844160b70 2023-11-18T23:41:56.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.963+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f384409f4b0 con 0x7f3844160b70 2023-11-18T23:41:56.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.963+0000 7f383b7fe640 1 -- 172.21.15.8:0/4200862195 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f384409f4b0 con 0x7f3844160b70 2023-11-18T23:41:56.965 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:41:56.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f382406ae40 msgr2=0x7f382406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f382406ae40 0x7f382406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38340044f0 tx=0x7f3834003a30 comp rx=0 tx=0).stop 2023-11-18T23:41:56.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3844160b70 msgr2=0x7f38440cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:56.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3844160b70 0x7f38440cbac0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f383c00c480 tx=0x7f383c00c940 comp rx=0 tx=0).stop 2023-11-18T23:41:56.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 shutdown_connections 2023-11-18T23:41:56.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f382406ae40 0x7f382406d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3844160b70 0x7f38440cbac0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38440ced30 0x7f384414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 --2- 172.21.15.8:0/4200862195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38440b2aa0 0x7f384415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:56.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 >> 172.21.15.8:0/4200862195 conn(0x7f384409c470 msgr2=0x7f38440b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:56.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 shutdown_connections 2023-11-18T23:41:56.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:56.965+0000 7f38490bb640 1 -- 172.21.15.8:0/4200862195 wait complete. 2023-11-18T23:41:56.978 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T23:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.085+0000 7f4462f97640 1 Processor -- start 2023-11-18T23:41:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.085+0000 7f4462f97640 1 -- start start 2023-11-18T23:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4462f97640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f445c06f0d0 0x7f445c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4462f97640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0b3440 0x7f445c0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4462f97640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f445c160d70 0x7f445c161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4462f97640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c161740 con 0x7f445c06f0d0 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4462f97640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0b38d0 con 0x7f445c160d70 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4462f97640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0b3bb0 con 0x7f445c0b3440 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4460d33640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f445c06f0d0 0x7f445c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4460d33640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f445c06f0d0 0x7f445c0b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50880/0 (socket says 172.21.15.8:50880) 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4460d33640 1 -- 172.21.15.8:0/3170239646 learned_addr learned my addr 172.21.15.8:0/3170239646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4453fff640 1 --2- 172.21.15.8:0/3170239646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0b3440 0x7f445c0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.086+0000 7f4461534640 1 --2- 172.21.15.8:0/3170239646 >> v2:172.21.15.116:3300/0 conn(0x7f445c160d70 0x7f445c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4460d33640 1 -- 172.21.15.8:0/3170239646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0b3440 msgr2=0x7f445c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4460d33640 1 --2- 172.21.15.8:0/3170239646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0b3440 0x7f445c0ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4460d33640 1 -- 172.21.15.8:0/3170239646 >> v2:172.21.15.116:3300/0 conn(0x7f445c160d70 msgr2=0x7f445c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4460d33640 1 --2- 172.21.15.8:0/3170239646 >> v2:172.21.15.116:3300/0 conn(0x7f445c160d70 0x7f445c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4460d33640 1 -- 172.21.15.8:0/3170239646 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0b3e90 con 0x7f445c06f0d0 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4453fff640 1 --2- 172.21.15.8:0/3170239646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0b3440 0x7f445c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4461534640 1 --2- 172.21.15.8:0/3170239646 >> v2:172.21.15.116:3300/0 conn(0x7f445c160d70 0x7f445c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.087+0000 7f4460d33640 1 --2- 172.21.15.8:0/3170239646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c0b4970 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f445c0ae470 tx=0x7f445802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d3ce82f3ea3406 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f44537fe640 1 -- 172.21.15.8:0/3170239646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458031870 con 0x7f445c06f0d0 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f44537fe640 1 -- 172.21.15.8:0/3170239646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44580319d0 con 0x7f445c06f0d0 2023-11-18T23:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f44537fe640 1 -- 172.21.15.8:0/3170239646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458031d60 con 0x7f445c06f0d0 2023-11-18T23:41:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 -- 172.21.15.8:0/3170239646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 msgr2=0x7f445c0b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 --2- 172.21.15.8:0/3170239646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c0b4970 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f445c0ae470 tx=0x7f445802b910 comp rx=0 tx=0).stop 2023-11-18T23:41:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 -- 172.21.15.8:0/3170239646 shutdown_connections 2023-11-18T23:41:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 --2- 172.21.15.8:0/3170239646 >> v2:172.21.15.116:3300/0 conn(0x7f445c160d70 0x7f445c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 --2- 172.21.15.8:0/3170239646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0b3440 0x7f445c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 --2- 172.21.15.8:0/3170239646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c0b4970 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 -- 172.21.15.8:0/3170239646 >> 172.21.15.8:0/3170239646 conn(0x7f445c0b1670 msgr2=0x7f445c0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 -- 172.21.15.8:0/3170239646 shutdown_connections 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.088+0000 7f4462f97640 1 -- 172.21.15.8:0/3170239646 wait complete. 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.089+0000 7f4462f97640 1 Processor -- start 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.089+0000 7f4462f97640 1 -- start start 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4462f97640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4462f97640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f445c160d70 0x7f445c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4462f97640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0ce7b0 0x7f445c1f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4462f97640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c06e0b0 con 0x7f445c06f0d0 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4462f97640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c06d4a0 con 0x7f445c160d70 2023-11-18T23:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4462f97640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c06d780 con 0x7f445c0ce7b0 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4460d33640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4460d33640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50882/0 (socket says 172.21.15.8:50882) 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.090+0000 7f4460d33640 1 -- 172.21.15.8:0/276760813 learned_addr learned my addr 172.21.15.8:0/276760813 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4461534640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0ce7b0 0x7f445c1f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4453fff640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f445c160d70 0x7f445c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4460d33640 1 -- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0ce7b0 msgr2=0x7f445c1f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4460d33640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0ce7b0 0x7f445c1f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4460d33640 1 -- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f445c160d70 msgr2=0x7f445c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4460d33640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f445c160d70 0x7f445c0ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4460d33640 1 -- 172.21.15.8:0/276760813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44580094d0 con 0x7f445c06f0d0 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4460d33640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c151da0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f445802b950 tx=0x7f44580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f44517fa640 1 -- 172.21.15.8:0/276760813 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445803ad30 con 0x7f445c06f0d0 2023-11-18T23:41:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f44517fa640 1 -- 172.21.15.8:0/276760813 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44580443f0 con 0x7f445c06f0d0 2023-11-18T23:41:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c06da60 con 0x7f445c06f0d0 2023-11-18T23:41:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f44517fa640 1 -- 172.21.15.8:0/276760813 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580447a0 con 0x7f445c06f0d0 2023-11-18T23:41:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.091+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c1f71a0 con 0x7f445c06f0d0 2023-11-18T23:41:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.092+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c0adb80 con 0x7f445c06f0d0 2023-11-18T23:41:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.093+0000 7f44517fa640 1 -- 172.21.15.8:0/276760813 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f445804d450 con 0x7f445c06f0d0 2023-11-18T23:41:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.093+0000 7f44517fa640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f444806ae40 0x7f444806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.093+0000 7f44517fa640 1 -- 172.21.15.8:0/276760813 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f445802d040 con 0x7f445c06f0d0 2023-11-18T23:41:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.093+0000 7f4453fff640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f444806ae40 0x7f444806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.094+0000 7f4453fff640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f444806ae40 0x7f444806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f445c0676a0 tx=0x7f444c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.098+0000 7f44517fa640 1 -- 172.21.15.8:0/276760813 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4458076bb0 con 0x7f445c06f0d0 2023-11-18T23:41:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.273+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f445c072720 con 0x7f445c06f0d0 2023-11-18T23:41:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.274+0000 7f44517fa640 1 -- 172.21.15.8:0/276760813 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44580350a0 con 0x7f445c06f0d0 2023-11-18T23:41:57.275 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-11-18T23:41:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f444806ae40 msgr2=0x7f444806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f444806ae40 0x7f444806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f445c0676a0 tx=0x7f444c008040 comp rx=0 tx=0).stop 2023-11-18T23:41:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 msgr2=0x7f445c151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c151da0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f445802b950 tx=0x7f44580046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 shutdown_connections 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f444806ae40 0x7f444806d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f445c0ce7b0 0x7f445c1f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f445c160d70 0x7f445c0ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 --2- 172.21.15.8:0/276760813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f445c06f0d0 0x7f445c151da0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 >> 172.21.15.8:0/276760813 conn(0x7f445c0b1670 msgr2=0x7f445c15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 shutdown_connections 2023-11-18T23:41:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.276+0000 7f4462f97640 1 -- 172.21.15.8:0/276760813 wait complete. 2023-11-18T23:41:57.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T23:41:57.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.396+0000 7f8e2f67c640 1 Processor -- start 2023-11-18T23:41:57.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.396+0000 7f8e2f67c640 1 -- start start 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2f67c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8e2815e810 0x7f8e280ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2f67c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8e2815ebf0 0x7f8e28099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2f67c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280cd170 con 0x7f8e280cd540 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2f67c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280b2260 con 0x7f8e2815ebf0 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2f67c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280b37b0 con 0x7f8e2815e810 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2cc17640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8e2815ebf0 0x7f8e28099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2cc17640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8e2815ebf0 0x7f8e28099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50888/0 (socket says 172.21.15.8:50888) 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2cc17640 1 -- 172.21.15.8:0/3081251544 learned_addr learned my addr 172.21.15.8:0/3081251544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2d418640 1 --2- 172.21.15.8:0/3081251544 >> v2:172.21.15.116:3300/0 conn(0x7f8e2815e810 0x7f8e280ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2cc17640 1 -- 172.21.15.8:0/3081251544 >> v2:172.21.15.116:3300/0 conn(0x7f8e2815e810 msgr2=0x7f8e280ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:57.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2cc17640 1 --2- 172.21.15.8:0/3081251544 >> v2:172.21.15.116:3300/0 conn(0x7f8e2815e810 0x7f8e280ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2cc17640 1 -- 172.21.15.8:0/3081251544 >> v1:172.21.15.8:6789/0 conn(0x7f8e280cd540 legacy=0x7f8e28099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e2cc17640 1 -- 172.21.15.8:0/3081251544 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280cc720 con 0x7f8e2815ebf0 2023-11-18T23:41:57.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.397+0000 7f8e1ffff640 1 -- 172.21.15.8:0/3081251544 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654062757 0 0) 0x7f8e280cd170 con 0x7f8e280cd540 2023-11-18T23:41:57.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.398+0000 7f8e2cc17640 1 --2- 172.21.15.8:0/3081251544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815ebf0 0x7f8e28099970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8e28071720 tx=0x7f8e1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdddf1017484a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.398+0000 7f8e1ffff640 1 -- 172.21.15.8:0/3081251544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18030860 con 0x7f8e2815ebf0 2023-11-18T23:41:57.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.398+0000 7f8e1ffff640 1 -- 172.21.15.8:0/3081251544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e180309c0 con 0x7f8e2815ebf0 2023-11-18T23:41:57.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.398+0000 7f8e1ffff640 1 -- 172.21.15.8:0/3081251544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18030d50 con 0x7f8e2815ebf0 2023-11-18T23:41:57.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 -- 172.21.15.8:0/3081251544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815ebf0 msgr2=0x7f8e28099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/3081251544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815ebf0 0x7f8e28099970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8e28071720 tx=0x7f8e1802b9a0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 -- 172.21.15.8:0/3081251544 shutdown_connections 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/3081251544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815ebf0 0x7f8e28099970 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/3081251544 >> v2:172.21.15.116:3300/0 conn(0x7f8e2815e810 0x7f8e280ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 -- 172.21.15.8:0/3081251544 >> 172.21.15.8:0/3081251544 conn(0x7f8e280b2a70 msgr2=0x7f8e280b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 -- 172.21.15.8:0/3081251544 shutdown_connections 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.399+0000 7f8e2f67c640 1 -- 172.21.15.8:0/3081251544 wait complete. 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.400+0000 7f8e2f67c640 1 Processor -- start 2023-11-18T23:41:57.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.400+0000 7f8e2f67c640 1 -- start start 2023-11-18T23:41:57.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2f67c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8e280cd540 0x7f8e280c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2f67c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815e810 0x7f8e280c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2f67c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e2815ebf0 0x7f8e28151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2f67c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2806c340 con 0x7f8e2815e810 2023-11-18T23:41:57.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2f67c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280c9d30 con 0x7f8e2815ebf0 2023-11-18T23:41:57.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2f67c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28151a40 con 0x7f8e280cd540 2023-11-18T23:41:57.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815e810 0x7f8e280c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815e810 0x7f8e280c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50904/0 (socket says 172.21.15.8:50904) 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 -- 172.21.15.8:0/765374032 learned_addr learned my addr 172.21.15.8:0/765374032 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2dc19640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e2815ebf0 0x7f8e28151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 -- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8e280cd540 msgr2=0x7f8e280c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8e280cd540 0x7f8e280c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 -- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e2815ebf0 msgr2=0x7f8e28151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e2815ebf0 0x7f8e28151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 -- 172.21.15.8:0/765374032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180094d0 con 0x7f8e2815e810 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2cc17640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815e810 0x7f8e280c97f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8e18000c00 tx=0x7f8e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e1dffb640 1 -- 172.21.15.8:0/765374032 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1803e070 con 0x7f8e2815e810 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e1dffb640 1 -- 172.21.15.8:0/765374032 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e18004030 con 0x7f8e2815e810 2023-11-18T23:41:57.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e280c8750 con 0x7f8e2815e810 2023-11-18T23:41:57.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.401+0000 7f8e1dffb640 1 -- 172.21.15.8:0/765374032 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e180043c0 con 0x7f8e2815e810 2023-11-18T23:41:57.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.402+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e280c8d10 con 0x7f8e2815e810 2023-11-18T23:41:57.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.402+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2809ef40 con 0x7f8e2815e810 2023-11-18T23:41:57.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.403+0000 7f8e1dffb640 1 -- 172.21.15.8:0/765374032 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e18042070 con 0x7f8e2815e810 2023-11-18T23:41:57.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.403+0000 7f8e1dffb640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8e0c06ae40 0x7f8e0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.403+0000 7f8e1dffb640 1 -- 172.21.15.8:0/765374032 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f8e180ab6d0 con 0x7f8e2815e810 2023-11-18T23:41:57.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.404+0000 7f8e2d418640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8e0c06ae40 0x7f8e0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.404+0000 7f8e2d418640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8e0c06ae40 0x7f8e0c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098f0 tx=0x7f8e24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.408+0000 7f8e1dffb640 1 -- 172.21.15.8:0/765374032 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e18076770 con 0x7f8e2815e810 2023-11-18T23:41:57.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.583+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e280b3590 con 0x7f8e2815e810 2023-11-18T23:41:57.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.583+0000 7f8e1dffb640 1 -- 172.21.15.8:0/765374032 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e18034020 con 0x7f8e2815e810 2023-11-18T23:41:57.585 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8e0c06ae40 msgr2=0x7f8e0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8e0c06ae40 0x7f8e0c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098f0 tx=0x7f8e24008040 comp rx=0 tx=0).stop 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815e810 msgr2=0x7f8e280c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815e810 0x7f8e280c97f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8e18000c00 tx=0x7f8e180046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 shutdown_connections 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f8e0c06ae40 0x7f8e0c06d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e2815ebf0 0x7f8e28151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e2815e810 0x7f8e280c97f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 --2- 172.21.15.8:0/765374032 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8e280cd540 0x7f8e280c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 >> 172.21.15.8:0/765374032 conn(0x7f8e280b2a70 msgr2=0x7f8e28099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 shutdown_connections 2023-11-18T23:41:57.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.585+0000 7f8e2f67c640 1 -- 172.21.15.8:0/765374032 wait complete. 2023-11-18T23:41:57.597 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:57.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.702+0000 7f9b7ab41640 1 Processor -- start 2023-11-18T23:41:57.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.702+0000 7f9b7ab41640 1 -- start start 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.703+0000 7f9b7ab41640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9b7415d3e0 0x7f9b740ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.703+0000 7f9b7ab41640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 0x7f9b740b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.703+0000 7f9b7ab41640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740b5f90 con 0x7f9b740ced30 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.703+0000 7f9b7ab41640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740cf170 con 0x7f9b7415d3e0 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.703+0000 7f9b7ab41640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740b61e0 con 0x7f9b740d1e30 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.703+0000 7f9b73fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9b740ced30 0x7f9b740d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49114/0 (socket says 172.21.15.8:49114) 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.703+0000 7f9b73fff640 1 -- 172.21.15.8:0/3633691413 learned_addr learned my addr 172.21.15.8:0/3633691413 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41177666 0 0) 0x7f9b740b5f90 con 0x7f9b740ced30 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c003520 con 0x7f9b740ced30 2023-11-18T23:41:57.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b788dd640 1 --2- 172.21.15.8:0/3633691413 >> v2:172.21.15.116:3300/0 conn(0x7f9b7415d3e0 0x7f9b740ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b790de640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 0x7f9b740b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3637686500 0 0) 0x7f9b5c003520 con 0x7f9b740ced30 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 msgr2=0x7f9b740b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 0x7f9b740b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 >> v2:172.21.15.116:3300/0 conn(0x7f9b7415d3e0 msgr2=0x7f9b740ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 --2- 172.21.15.8:0/3633691413 >> v2:172.21.15.116:3300/0 conn(0x7f9b7415d3e0 0x7f9b740ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740b64c0 con 0x7f9b740ced30 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f9b68001670 con 0x7f9b740ced30 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 >> v1:172.21.15.8:6789/0 conn(0x7f9b740ced30 legacy=0x7f9b740d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 0x7f9b5c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c003ef0 0x7f9b5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740cf170 con 0x7f9b5c004d00 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740b61e0 con 0x7f9b5c003ef0 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c00b980 con 0x7f9b740d1e30 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b790de640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b788dd640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 0x7f9b5c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b73fff640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c003ef0 0x7f9b5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.704+0000 7f9b790de640 1 -- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 msgr2=0x7f9b5c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b790de640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b740d1e30 0x7f9b5c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b790de640 1 -- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c003ef0 msgr2=0x7f9b5c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b790de640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c003ef0 0x7f9b5c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b790de640 1 -- 172.21.15.8:0/3633691413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c003520 con 0x7f9b5c004d00 2023-11-18T23:41:57.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b790de640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b5c005180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b740cdc70 tx=0x7f9b5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538536b44f8189f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6402c650 con 0x7f9b5c004d00 2023-11-18T23:41:57.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6402c7b0 con 0x7f9b5c004d00 2023-11-18T23:41:57.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.705+0000 7f9b737fe640 1 -- 172.21.15.8:0/3633691413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6402cb60 con 0x7f9b5c004d00 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.706+0000 7f9b7ab41640 1 -- 172.21.15.8:0/3633691413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 msgr2=0x7f9b5c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.706+0000 7f9b7ab41640 1 --2- 172.21.15.8:0/3633691413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b5c005180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b740cdc70 tx=0x7f9b5c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.706+0000 7f9b790de640 1 -- 172.21.15.8:0/3633691413 reap_dead start 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.706+0000 7f9b7ab41640 1 -- 172.21.15.8:0/3633691413 shutdown_connections 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.706+0000 7f9b7ab41640 1 -- 172.21.15.8:0/3633691413 >> 172.21.15.8:0/3633691413 conn(0x7f9b7409c480 msgr2=0x7f9b740d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.706+0000 7f9b7ab41640 1 -- 172.21.15.8:0/3633691413 shutdown_connections 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.706+0000 7f9b7ab41640 1 -- 172.21.15.8:0/3633691413 wait complete. 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.707+0000 7f9b7ab41640 1 Processor -- start 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.707+0000 7f9b7ab41640 1 -- start start 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b7ab41640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b7414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b7ab41640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b7414b510 0x7f9b740cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b7ab41640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7409cdf0 0x7f9b7409d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b7ab41640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7414c620 con 0x7f9b5c004d00 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b7ab41640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7414ba10 con 0x7f9b7409cdf0 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b7ab41640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7414bcf0 con 0x7f9b7414b510 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b7414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b7414ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41630/0 (socket says 172.21.15.8:41630) 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 -- 172.21.15.8:0/737786519 learned_addr learned my addr 172.21.15.8:0/737786519 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 -- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b7414b510 msgr2=0x7f9b740cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b7414b510 0x7f9b740cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 -- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7409cdf0 msgr2=0x7f9b7409d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7409cdf0 0x7f9b7409d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.708+0000 7f9b788dd640 1 -- 172.21.15.8:0/737786519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7414bfd0 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.709+0000 7f9b788dd640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b7414ac70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c011e30 tx=0x7f9b6c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.709+0000 7f9b717fa640 1 -- 172.21.15.8:0/737786519 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00e040 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.709+0000 7f9b717fa640 1 -- 172.21.15.8:0/737786519 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00f040 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.709+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7414c2b0 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.709+0000 7f9b717fa640 1 -- 172.21.15.8:0/737786519 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c009c00 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.709+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b740ccb80 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.710+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b74067420 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.710+0000 7f9b717fa640 1 -- 172.21.15.8:0/737786519 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b6c015850 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.711+0000 7f9b717fa640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9b6006ae70 0x7f9b6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.711+0000 7f9b717fa640 1 -- 172.21.15.8:0/737786519 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f9b6c08a580 con 0x7f9b5c004d00 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.711+0000 7f9b73fff640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9b6006ae70 0x7f9b6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:57.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.711+0000 7f9b73fff640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9b6006ae70 0x7f9b6006d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b680079d0 tx=0x7f9b68007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:57.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.715+0000 7f9b717fa640 1 -- 172.21.15.8:0/737786519 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b6c055630 con 0x7f9b5c004d00 2023-11-18T23:41:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.929+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b740d1500 con 0x7f9b5c004d00 2023-11-18T23:41:57.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.930+0000 7f9b717fa640 1 -- 172.21.15.8:0/737786519 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f9b6c058c50 con 0x7f9b5c004d00 2023-11-18T23:41:57.931 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:57.931 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9b6006ae70 msgr2=0x7f9b6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9b6006ae70 0x7f9b6006d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b680079d0 tx=0x7f9b68007960 comp rx=0 tx=0).stop 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 msgr2=0x7f9b7414ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b7414ac70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c011e30 tx=0x7f9b6c00f580 comp rx=0 tx=0).stop 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 shutdown_connections 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9b6006ae70 0x7f9b6006d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7409cdf0 0x7f9b7409d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b7414b510 0x7f9b740cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 --2- 172.21.15.8:0/737786519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b5c004d00 0x7f9b7414ac70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 >> 172.21.15.8:0/737786519 conn(0x7f9b7409c480 msgr2=0x7f9b7406b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 shutdown_connections 2023-11-18T23:41:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:57.932+0000 7f9b7ab41640 1 -- 172.21.15.8:0/737786519 wait complete. 2023-11-18T23:41:57.944 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:58.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.049+0000 7f4b3a501640 1 Processor -- start 2023-11-18T23:41:58.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.049+0000 7f4b3a501640 1 -- start start 2023-11-18T23:41:58.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b3a501640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b3415d900 0x7f4b34099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b3a501640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b2610 0x7f4b34099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b3a501640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340b0660 con 0x7f4b340b00c0 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b3a501640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3406c900 con 0x7f4b3415d900 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b3a501640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3406cbe0 con 0x7f4b340b2610 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b33fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b3415d900 0x7f4b34099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b33fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b3415d900 0x7f4b34099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41644/0 (socket says 172.21.15.8:41644) 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b33fff640 1 -- 172.21.15.8:0/2900866674 learned_addr learned my addr 172.21.15.8:0/2900866674 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b337fe640 1 --2- 172.21.15.8:0/2900866674 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b2610 0x7f4b34099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b33fff640 1 -- 172.21.15.8:0/2900866674 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b2610 msgr2=0x7f4b34099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b33fff640 1 --2- 172.21.15.8:0/2900866674 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b2610 0x7f4b34099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b33fff640 1 -- 172.21.15.8:0/2900866674 >> v1:172.21.15.116:6789/0 conn(0x7f4b340b00c0 legacy=0x7f4b340cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:58.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.050+0000 7f4b33fff640 1 -- 172.21.15.8:0/2900866674 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3406cec0 con 0x7f4b3415d900 2023-11-18T23:41:58.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.051+0000 7f4b33fff640 1 --2- 172.21.15.8:0/2900866674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b34099970 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009870 tx=0x7f4b2802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2791aad87a88d7f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.051+0000 7f4b32ffd640 1 -- 172.21.15.8:0/2900866674 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28031640 con 0x7f4b3415d900 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.051+0000 7f4b32ffd640 1 -- 172.21.15.8:0/2900866674 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b280317a0 con 0x7f4b3415d900 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.051+0000 7f4b32ffd640 1 -- 172.21.15.8:0/2900866674 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28031b30 con 0x7f4b3415d900 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 -- 172.21.15.8:0/2900866674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 msgr2=0x7f4b34099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 --2- 172.21.15.8:0/2900866674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b34099970 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009870 tx=0x7f4b2802b8f0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 -- 172.21.15.8:0/2900866674 shutdown_connections 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 --2- 172.21.15.8:0/2900866674 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b2610 0x7f4b34099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 --2- 172.21.15.8:0/2900866674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b34099970 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 -- 172.21.15.8:0/2900866674 >> 172.21.15.8:0/2900866674 conn(0x7f4b340b2a70 msgr2=0x7f4b340b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:58.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 -- 172.21.15.8:0/2900866674 shutdown_connections 2023-11-18T23:41:58.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.052+0000 7f4b3a501640 1 -- 172.21.15.8:0/2900866674 wait complete. 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.053+0000 7f4b3a501640 1 Processor -- start 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.053+0000 7f4b3a501640 1 -- start start 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b3a501640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b00c0 0x7f4b34158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b3a501640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b340b2610 0x7f4b34160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b3a501640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b340cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b3a501640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b6a30 con 0x7f4b3415d900 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b3a501640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b5c10 con 0x7f4b340b2610 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b3a501640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b5eb0 con 0x7f4b340b00c0 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b340cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b340cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41660/0 (socket says 172.21.15.8:41660) 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 -- 172.21.15.8:0/1209821769 learned_addr learned my addr 172.21.15.8:0/1209821769 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b33fff640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b00c0 0x7f4b34158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b337fe640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b340b2610 0x7f4b34160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 -- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b00c0 msgr2=0x7f4b34158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b00c0 0x7f4b34158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 -- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b340b2610 msgr2=0x7f4b34160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b340b2610 0x7f4b34160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 -- 172.21.15.8:0/1209821769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280094d0 con 0x7f4b3415d900 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b337fe640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b340b2610 0x7f4b34160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b38a9e640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b340cc1f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00b970 tx=0x7f4b2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b30ff9640 1 -- 172.21.15.8:0/1209821769 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00cb40 con 0x7f4b3415d900 2023-11-18T23:41:58.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.054+0000 7f4b30ff9640 1 -- 172.21.15.8:0/1209821769 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00cca0 con 0x7f4b3415d900 2023-11-18T23:41:58.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.055+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b340b6190 con 0x7f4b3415d900 2023-11-18T23:41:58.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.055+0000 7f4b30ff9640 1 -- 172.21.15.8:0/1209821769 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c014680 con 0x7f4b3415d900 2023-11-18T23:41:58.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.055+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b340b6750 con 0x7f4b3415d900 2023-11-18T23:41:58.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.056+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3415e4d0 con 0x7f4b3415d900 2023-11-18T23:41:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.056+0000 7f4b30ff9640 1 -- 172.21.15.8:0/1209821769 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b2c01d3b0 con 0x7f4b3415d900 2023-11-18T23:41:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.056+0000 7f4b30ff9640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4b2006ae40 0x7f4b2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.056+0000 7f4b30ff9640 1 -- 172.21.15.8:0/1209821769 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f4b2c089530 con 0x7f4b3415d900 2023-11-18T23:41:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.057+0000 7f4b33fff640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4b2006ae40 0x7f4b2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.057+0000 7f4b33fff640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4b2006ae40 0x7f4b2006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4b28036000 tx=0x7f4b2803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.061+0000 7f4b30ff9640 1 -- 172.21.15.8:0/1209821769 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b3415e4d0 con 0x7f4b3415d900 2023-11-18T23:41:58.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.239+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b3415e4d0 con 0x7f4b3415d900 2023-11-18T23:41:58.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.240+0000 7f4b30ff9640 1 -- 172.21.15.8:0/1209821769 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16719 (secure 0 0 0) 0x7f4b3415e4d0 con 0x7f4b3415d900 2023-11-18T23:41:58.242 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:58.242 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":22,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:53.075510+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":1},{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4b2006ae40 msgr2=0x7f4b2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4b2006ae40 0x7f4b2006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4b28036000 tx=0x7f4b2803c040 comp rx=0 tx=0).stop 2023-11-18T23:41:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 msgr2=0x7f4b340cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b340cc1f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00b970 tx=0x7f4b2c00be30 comp rx=0 tx=0).stop 2023-11-18T23:41:58.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 shutdown_connections 2023-11-18T23:41:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4b2006ae40 0x7f4b2006d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b3415d900 0x7f4b340cc1f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b340b2610 0x7f4b34160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 --2- 172.21.15.8:0/1209821769 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b340b00c0 0x7f4b34158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 >> 172.21.15.8:0/1209821769 conn(0x7f4b340b2a70 msgr2=0x7f4b3406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 shutdown_connections 2023-11-18T23:41:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.243+0000 7f4b3a501640 1 -- 172.21.15.8:0/1209821769 wait complete. 2023-11-18T23:41:58.255 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T23:41:58.255 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:58.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.360+0000 7fc0084c2640 1 Processor -- start 2023-11-18T23:41:58.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.360+0000 7fc0084c2640 1 -- start start 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc0084c2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0000ce860 0x7fc00006e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc0084c2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc00015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc0084c2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00015dc20 con 0x7fc000159c90 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc0084c2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc000071ca0 con 0x7fc0000ce860 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc0084c2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc000071090 con 0x7fc00015d280 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc00625e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0000ce860 0x7fc00006e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc00625e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0000ce860 0x7fc00006e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41670/0 (socket says 172.21.15.8:41670) 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.361+0000 7fc00625e640 1 -- 172.21.15.8:0/3252224095 learned_addr learned my addr 172.21.15.8:0/3252224095 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.362+0000 7fc00625e640 1 -- 172.21.15.8:0/3252224095 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 msgr2=0x7fc00015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:58.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.362+0000 7fc005a5d640 1 --2- 172.21.15.8:0/3252224095 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc00015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.362+0000 7fc00625e640 1 --2- 172.21.15.8:0/3252224095 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc00015d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.362+0000 7fc00625e640 1 -- 172.21.15.8:0/3252224095 >> v1:172.21.15.116:6789/0 conn(0x7fc000159c90 legacy=0x7fc00015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:58.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.362+0000 7fc00625e640 1 -- 172.21.15.8:0/3252224095 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000071370 con 0x7fc0000ce860 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.362+0000 7fc00625e640 1 --2- 172.21.15.8:0/3252224095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0000ce860 0x7fc00006e050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbff800d150 tx=0x7fbff802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112eebbc7a31ed44 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.362+0000 7fc00525c640 1 -- 172.21.15.8:0/3252224095 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff802ee90 con 0x7fc0000ce860 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc00525c640 1 -- 172.21.15.8:0/3252224095 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8032070 con 0x7fc0000ce860 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc00525c640 1 -- 172.21.15.8:0/3252224095 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8038620 con 0x7fc0000ce860 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 -- 172.21.15.8:0/3252224095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0000ce860 msgr2=0x7fc00006e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 --2- 172.21.15.8:0/3252224095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0000ce860 0x7fc00006e050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbff800d150 tx=0x7fbff802e0e0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 -- 172.21.15.8:0/3252224095 shutdown_connections 2023-11-18T23:41:58.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 --2- 172.21.15.8:0/3252224095 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc00015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 --2- 172.21.15.8:0/3252224095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0000ce860 0x7fc00006e050 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 -- 172.21.15.8:0/3252224095 >> 172.21.15.8:0/3252224095 conn(0x7fc0000b0af0 msgr2=0x7fc0000b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:58.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 -- 172.21.15.8:0/3252224095 shutdown_connections 2023-11-18T23:41:58.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.363+0000 7fc0084c2640 1 -- 172.21.15.8:0/3252224095 wait complete. 2023-11-18T23:41:58.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.364+0000 7fc0084c2640 1 Processor -- start 2023-11-18T23:41:58.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.364+0000 7fc0084c2640 1 -- start start 2023-11-18T23:41:58.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc0084c2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0000ce860 0x7fc00013d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc0084c2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc000159c90 0x7fc00014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc0084c2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc0000cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc0084c2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000cd660 con 0x7fc000159c90 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc0084c2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000cc790 con 0x7fc0000ce860 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc0084c2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000cc9e0 con 0x7fc00015d280 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc005a5d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc000159c90 0x7fc00014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc005a5d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc000159c90 0x7fc00014e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41686/0 (socket says 172.21.15.8:41686) 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc005a5d640 1 -- 172.21.15.8:0/2018936303 learned_addr learned my addr 172.21.15.8:0/2018936303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc00625e640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0000ce860 0x7fc00013d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc006a5f640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc0000cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc005a5d640 1 -- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 msgr2=0x7fc0000cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.365+0000 7fc005a5d640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc0000cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fc005a5d640 1 -- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0000ce860 msgr2=0x7fc00013d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fc005a5d640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0000ce860 0x7fc00013d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fc005a5d640 1 -- 172.21.15.8:0/2018936303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff800bd40 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fc006a5f640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc0000cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fc005a5d640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc000159c90 0x7fc00014e560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c7f0 tx=0x7fbff400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fbffeffd640 1 -- 172.21.15.8:0/2018936303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4004220 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fbffeffd640 1 -- 172.21.15.8:0/2018936303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4004380 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fbffeffd640 1 -- 172.21.15.8:0/2018936303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4007840 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0000cccc0 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.366+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0000cd280 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.367+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc000067420 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.367+0000 7fbffeffd640 1 -- 172.21.15.8:0/2018936303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbff40079a0 con 0x7fc000159c90 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.368+0000 7fbffeffd640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbfec06ae40 0x7fbfec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.368+0000 7fbffeffd640 1 -- 172.21.15.8:0/2018936303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fbff4089280 con 0x7fc000159c90 2023-11-18T23:41:58.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.368+0000 7fc00625e640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbfec06ae40 0x7fbfec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.368+0000 7fc00625e640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbfec06ae40 0x7fbfec06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbff8039000 tx=0x7fbff8034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.372+0000 7fbffeffd640 1 -- 172.21.15.8:0/2018936303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbff4054350 con 0x7fc000159c90 2023-11-18T23:41:58.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.589+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0001599d0 con 0x7fc000159c90 2023-11-18T23:41:58.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.590+0000 7fbffeffd640 1 -- 172.21.15.8:0/2018936303 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fbff4057970 con 0x7fc000159c90 2023-11-18T23:41:58.591 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:58.592 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:58.592 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:58.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbfec06ae40 msgr2=0x7fbfec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbfec06ae40 0x7fbfec06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbff8039000 tx=0x7fbff8034000 comp rx=0 tx=0).stop 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc000159c90 msgr2=0x7fc00014e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc000159c90 0x7fc00014e560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c7f0 tx=0x7fbff400ccb0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 shutdown_connections 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbfec06ae40 0x7fbfec06d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc00015d280 0x7fc0000cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc000159c90 0x7fc00014e560 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 --2- 172.21.15.8:0/2018936303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0000ce860 0x7fc00013d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 >> 172.21.15.8:0/2018936303 conn(0x7fc0000b0af0 msgr2=0x7fc00015a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 shutdown_connections 2023-11-18T23:41:58.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.592+0000 7fc0084c2640 1 -- 172.21.15.8:0/2018936303 wait complete. 2023-11-18T23:41:58.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:41:58.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.710+0000 7f3b3ae15640 1 Processor -- start 2023-11-18T23:41:58.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.710+0000 7f3b3ae15640 1 -- start start 2023-11-18T23:41:58.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.710+0000 7f3b3ae15640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3b341465d0 0x7f3b340b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.710+0000 7f3b3ae15640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3b34071d40 0x7f3b34160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.710+0000 7f3b3ae15640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340721d0 con 0x7f3b3406a4d0 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.710+0000 7f3b3ae15640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b34161d80 con 0x7f3b341465d0 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b3ae15640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b341612d0 con 0x7f3b34071d40 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b38bb1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3b341465d0 0x7f3b340b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b38bb1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3b341465d0 0x7f3b340b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41692/0 (socket says 172.21.15.8:41692) 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2515374292 learned_addr learned my addr 172.21.15.8:0/2515374292 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b393b2640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3b3406a4d0 0x7f3b3406a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49120/0 (socket says 172.21.15.8:49120) 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b33fff640 1 --2- 172.21.15.8:0/2515374292 >> v2:172.21.15.116:3300/0 conn(0x7f3b34071d40 0x7f3b34160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2515374292 >> v2:172.21.15.116:3300/0 conn(0x7f3b34071d40 msgr2=0x7f3b34160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b38bb1640 1 --2- 172.21.15.8:0/2515374292 >> v2:172.21.15.116:3300/0 conn(0x7f3b34071d40 0x7f3b34160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2515374292 >> v1:172.21.15.8:6789/0 conn(0x7f3b3406a4d0 legacy=0x7f3b3406a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2515374292 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340cf790 con 0x7f3b341465d0 2023-11-18T23:41:58.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b33fff640 1 --2- 172.21.15.8:0/2515374292 >> v2:172.21.15.116:3300/0 conn(0x7f3b34071d40 0x7f3b34160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:58.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.711+0000 7f3b337fe640 1 -- 172.21.15.8:0/2515374292 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423980609 0 0) 0x7f3b340721d0 con 0x7f3b3406a4d0 2023-11-18T23:41:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b38bb1640 1 --2- 172.21.15.8:0/2515374292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b341465d0 0x7f3b340b2ee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b3406b1d0 tx=0x7f3b2c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b34b0e913fd964 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b337fe640 1 -- 172.21.15.8:0/2515374292 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c02cb20 con 0x7f3b341465d0 2023-11-18T23:41:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b337fe640 1 -- 172.21.15.8:0/2515374292 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c02cc80 con 0x7f3b341465d0 2023-11-18T23:41:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b337fe640 1 -- 172.21.15.8:0/2515374292 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0343f0 con 0x7f3b341465d0 2023-11-18T23:41:58.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2515374292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b341465d0 msgr2=0x7f3b340b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2515374292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b341465d0 0x7f3b340b2ee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b3406b1d0 tx=0x7f3b2c02bf80 comp rx=0 tx=0).stop 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2515374292 shutdown_connections 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2515374292 >> v2:172.21.15.116:3300/0 conn(0x7f3b34071d40 0x7f3b34160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2515374292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b341465d0 0x7f3b340b2ee0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.712+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2515374292 >> 172.21.15.8:0/2515374292 conn(0x7f3b340cc930 msgr2=0x7f3b340ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.713+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2515374292 shutdown_connections 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.713+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2515374292 wait complete. 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.714+0000 7f3b3ae15640 1 Processor -- start 2023-11-18T23:41:58.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.714+0000 7f3b3ae15640 1 -- start start 2023-11-18T23:41:58.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b3ae15640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b3406a4d0 0x7f3b340c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b3ae15640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b34071d40 0x7f3b341f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b3ae15640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b341465d0 0x7f3b341f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b3ae15640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340aef90 con 0x7f3b3406a4d0 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b3ae15640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340ae6f0 con 0x7f3b34071d40 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b3ae15640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340ae9d0 con 0x7f3b341465d0 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b3406a4d0 0x7f3b340c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b3406a4d0 0x7f3b340c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41694/0 (socket says 172.21.15.8:41694) 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2321317351 learned_addr learned my addr 172.21.15.8:0/2321317351 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b33fff640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b34071d40 0x7f3b341f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b393b2640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b341465d0 0x7f3b341f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b341465d0 msgr2=0x7f3b341f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b341465d0 0x7f3b341f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b34071d40 msgr2=0x7f3b341f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b34071d40 0x7f3b341f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 -- 172.21.15.8:0/2321317351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009b30 con 0x7f3b3406a4d0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b38bb1640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b3406a4d0 0x7f3b340c5720 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c000f80 tx=0x7f3b2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b317fa640 1 -- 172.21.15.8:0/2321317351 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c009510 con 0x7f3b3406a4d0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.715+0000 7f3b317fa640 1 -- 172.21.15.8:0/2321317351 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c03e450 con 0x7f3b3406a4d0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.716+0000 7f3b317fa640 1 -- 172.21.15.8:0/2321317351 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c03e800 con 0x7f3b3406a4d0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.716+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b340aecb0 con 0x7f3b3406a4d0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.716+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b341f3a60 con 0x7f3b3406a4d0 2023-11-18T23:41:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.717+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b340b3e20 con 0x7f3b3406a4d0 2023-11-18T23:41:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.717+0000 7f3b317fa640 1 -- 172.21.15.8:0/2321317351 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b2c03e960 con 0x7f3b3406a4d0 2023-11-18T23:41:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.717+0000 7f3b317fa640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3b2006ae70 0x7f3b2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.717+0000 7f3b317fa640 1 -- 172.21.15.8:0/2321317351 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f3b2c0ac130 con 0x7f3b3406a4d0 2023-11-18T23:41:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.718+0000 7f3b33fff640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3b2006ae70 0x7f3b2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:58.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.718+0000 7f3b33fff640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3b2006ae70 0x7f3b2006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b340af7e0 tx=0x7f3b28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.722+0000 7f3b317fa640 1 -- 172.21.15.8:0/2321317351 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b340b3e20 con 0x7f3b3406a4d0 2023-11-18T23:41:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.934+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b340b3e20 con 0x7f3b3406a4d0 2023-11-18T23:41:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.934+0000 7f3b317fa640 1 -- 172.21.15.8:0/2321317351 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f3b340b3e20 con 0x7f3b3406a4d0 2023-11-18T23:41:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:58.936 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2989745672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2989745672},{"type":"v1","addr":"172.21.15.116:6836","nonce":2989745672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/775293437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":775293437},{"type":"v1","addr":"172.21.15.8:6833","nonce":775293437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2077067555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2077067555},{"type":"v1","addr":"172.21.15.8:6835","nonce":2077067555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:41:11.303324+0000","modified":"2023-11-18T23:41:14.320612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6837/362949934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":362949934},{"type":"v1","addr":"172.21.15.116:6837","nonce":362949934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T23:41:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-11-18T23:41:58.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3b2006ae70 msgr2=0x7f3b2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3b2006ae70 0x7f3b2006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b340af7e0 tx=0x7f3b28008040 comp rx=0 tx=0).stop 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b3406a4d0 msgr2=0x7f3b340c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b3406a4d0 0x7f3b340c5720 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c000f80 tx=0x7f3b2c004a40 comp rx=0 tx=0).stop 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 shutdown_connections 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3b2006ae70 0x7f3b2006d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b341465d0 0x7f3b341f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b34071d40 0x7f3b341f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 --2- 172.21.15.8:0/2321317351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b3406a4d0 0x7f3b340c5720 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 >> 172.21.15.8:0/2321317351 conn(0x7f3b340cc930 msgr2=0x7f3b3406ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 shutdown_connections 2023-11-18T23:41:58.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:58.937+0000 7f3b3ae15640 1 -- 172.21.15.8:0/2321317351 wait complete. 2023-11-18T23:41:58.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:41:59.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.055+0000 7f4de0997640 1 Processor -- start 2023-11-18T23:41:59.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.055+0000 7f4de0997640 1 -- start start 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4de0997640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ddc09a080 0x7f4ddc0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4de0997640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ddc0b2610 0x7f4ddc0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4de0997640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0b0660 con 0x7f4ddc15d900 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4de0997640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc06c900 con 0x7f4ddc0b2610 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4de0997640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc06cbe0 con 0x7f4ddc09a080 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4ddad9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ddc0b2610 0x7f4ddc0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4ddad9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ddc0b2610 0x7f4ddc0b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41698/0 (socket says 172.21.15.8:41698) 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4dda59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4ddc15d900 0x7f4ddc099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49122/0 (socket says 172.21.15.8:49122) 2023-11-18T23:41:59.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4ddad9d640 1 -- 172.21.15.8:0/1620954674 learned_addr learned my addr 172.21.15.8:0/1620954674 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4dd9d9b640 1 --2- 172.21.15.8:0/1620954674 >> v2:172.21.15.116:3300/0 conn(0x7f4ddc09a080 0x7f4ddc0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4ddad9d640 1 -- 172.21.15.8:0/1620954674 >> v2:172.21.15.116:3300/0 conn(0x7f4ddc09a080 msgr2=0x7f4ddc0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4ddad9d640 1 --2- 172.21.15.8:0/1620954674 >> v2:172.21.15.116:3300/0 conn(0x7f4ddc09a080 0x7f4ddc0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4ddad9d640 1 -- 172.21.15.8:0/1620954674 >> v1:172.21.15.8:6789/0 conn(0x7f4ddc15d900 legacy=0x7f4ddc099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4ddad9d640 1 -- 172.21.15.8:0/1620954674 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc06cec0 con 0x7f4ddc0b2610 2023-11-18T23:41:59.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.056+0000 7f4dd959a640 1 -- 172.21.15.8:0/1620954674 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953620260 0 0) 0x7f4ddc0b0660 con 0x7f4ddc15d900 2023-11-18T23:41:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.057+0000 7f4ddad9d640 1 --2- 172.21.15.8:0/1620954674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0b2610 0x7f4ddc0b1310 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0719a0 tx=0x7f4dd402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11e22957e6b322c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.057+0000 7f4dd959a640 1 -- 172.21.15.8:0/1620954674 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4030860 con 0x7f4ddc0b2610 2023-11-18T23:41:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.057+0000 7f4dd959a640 1 -- 172.21.15.8:0/1620954674 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd40309c0 con 0x7f4ddc0b2610 2023-11-18T23:41:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.057+0000 7f4dd959a640 1 -- 172.21.15.8:0/1620954674 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4030d50 con 0x7f4ddc0b2610 2023-11-18T23:41:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 -- 172.21.15.8:0/1620954674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0b2610 msgr2=0x7f4ddc0b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 --2- 172.21.15.8:0/1620954674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0b2610 0x7f4ddc0b1310 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0719a0 tx=0x7f4dd402b9a0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 -- 172.21.15.8:0/1620954674 shutdown_connections 2023-11-18T23:41:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 --2- 172.21.15.8:0/1620954674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc0b2610 0x7f4ddc0b1310 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 --2- 172.21.15.8:0/1620954674 >> v2:172.21.15.116:3300/0 conn(0x7f4ddc09a080 0x7f4ddc0b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 -- 172.21.15.8:0/1620954674 >> 172.21.15.8:0/1620954674 conn(0x7f4ddc0b2a70 msgr2=0x7f4ddc0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 -- 172.21.15.8:0/1620954674 shutdown_connections 2023-11-18T23:41:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.058+0000 7f4de0997640 1 -- 172.21.15.8:0/1620954674 wait complete. 2023-11-18T23:41:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.059+0000 7f4de0997640 1 Processor -- start 2023-11-18T23:41:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.059+0000 7f4de0997640 1 -- start start 2023-11-18T23:41:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4de0997640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ddc09a080 0x7f4ddc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4de0997640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ddc0b2610 0x7f4ddc1f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4de0997640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc15d900 0x7f4ddc1f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4de0997640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1f40a0 con 0x7f4ddc15d900 2023-11-18T23:41:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4de0997640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1f2f60 con 0x7f4ddc09a080 2023-11-18T23:41:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4de0997640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc06e970 con 0x7f4ddc0b2610 2023-11-18T23:41:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4ddad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc15d900 0x7f4ddc1f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4ddad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc15d900 0x7f4ddc1f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41714/0 (socket says 172.21.15.8:41714) 2023-11-18T23:41:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4ddad9d640 1 -- 172.21.15.8:0/381571596 learned_addr learned my addr 172.21.15.8:0/381571596 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:59.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4dd9d9b640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ddc0b2610 0x7f4ddc1f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.060+0000 7f4dda59c640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ddc09a080 0x7f4ddc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4ddad9d640 1 -- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ddc0b2610 msgr2=0x7f4ddc1f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4ddad9d640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ddc0b2610 0x7f4ddc1f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4ddad9d640 1 -- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ddc09a080 msgr2=0x7f4ddc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4ddad9d640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ddc09a080 0x7f4ddc06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4ddad9d640 1 -- 172.21.15.8:0/381571596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40094d0 con 0x7f4ddc15d900 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4ddad9d640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc15d900 0x7f4ddc1f2a20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40090b0 tx=0x7f4dd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4dd2ffd640 1 -- 172.21.15.8:0/381571596 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4039c90 con 0x7f4ddc15d900 2023-11-18T23:41:59.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4dd2ffd640 1 -- 172.21.15.8:0/381571596 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4039df0 con 0x7f4ddc15d900 2023-11-18T23:41:59.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc06ec50 con 0x7f4ddc15d900 2023-11-18T23:41:59.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4dd2ffd640 1 -- 172.21.15.8:0/381571596 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4043640 con 0x7f4ddc15d900 2023-11-18T23:41:59.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.061+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc06f210 con 0x7f4ddc15d900 2023-11-18T23:41:59.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.062+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc067420 con 0x7f4ddc15d900 2023-11-18T23:41:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.062+0000 7f4dd2ffd640 1 -- 172.21.15.8:0/381571596 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4dd40437a0 con 0x7f4ddc15d900 2023-11-18T23:41:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.063+0000 7f4dd2ffd640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4dbc06ae40 0x7f4dbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.063+0000 7f4dd2ffd640 1 -- 172.21.15.8:0/381571596 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f4dd403e070 con 0x7f4ddc15d900 2023-11-18T23:41:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.063+0000 7f4dda59c640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4dbc06ae40 0x7f4dbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.064+0000 7f4dda59c640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4dbc06ae40 0x7f4dbc06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0012e0 tx=0x7f4dcc001630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.068+0000 7f4dd2ffd640 1 -- 172.21.15.8:0/381571596 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4dd40777d0 con 0x7f4ddc15d900 2023-11-18T23:41:59.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.248+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ddc0d0b70 con 0x7f4ddc15d900 2023-11-18T23:41:59.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.249+0000 7f4dd2ffd640 1 -- 172.21.15.8:0/381571596 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16719 (secure 0 0 0) 0x7f4dd407adf0 con 0x7f4ddc15d900 2023-11-18T23:41:59.250 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:41:59.250 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":22,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:41:53.075510+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:41:09.408082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T23:41:10.292278+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":1},{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:41:59.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4dbc06ae40 msgr2=0x7f4dbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4dbc06ae40 0x7f4dbc06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0012e0 tx=0x7f4dcc001630 comp rx=0 tx=0).stop 2023-11-18T23:41:59.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc15d900 msgr2=0x7f4ddc1f2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc15d900 0x7f4ddc1f2a20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40090b0 tx=0x7f4dd4004730 comp rx=0 tx=0).stop 2023-11-18T23:41:59.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 shutdown_connections 2023-11-18T23:41:59.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4dbc06ae40 0x7f4dbc06d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ddc15d900 0x7f4ddc1f2a20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ddc0b2610 0x7f4ddc1f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 --2- 172.21.15.8:0/381571596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ddc09a080 0x7f4ddc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 >> 172.21.15.8:0/381571596 conn(0x7f4ddc0b2a70 msgr2=0x7f4ddc0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:59.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 shutdown_connections 2023-11-18T23:41:59.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.251+0000 7f4de0997640 1 -- 172.21.15.8:0/381571596 wait complete. 2023-11-18T23:41:59.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-18T23:41:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.369+0000 7f28fdc51640 1 Processor -- start 2023-11-18T23:41:59.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.369+0000 7f28fdc51640 1 -- start start 2023-11-18T23:41:59.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28fdc51640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f28f813f750 0x7f28f815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28fdc51640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f80ce060 con 0x7f28f813fb30 2023-11-18T23:41:59.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28fdc51640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f80ce340 con 0x7f28f8070630 2023-11-18T23:41:59.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28fdc51640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80cec70 con 0x7f28f813f750 2023-11-18T23:41:59.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28f77fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f28f813f750 0x7f28f815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28f6ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f28f813fb30 0x7f28f80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49138/0 (socket says 172.21.15.8:49138) 2023-11-18T23:41:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28f77fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f28f813f750 0x7f28f815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41726/0 (socket says 172.21.15.8:41726) 2023-11-18T23:41:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28f6ffd640 1 -- 172.21.15.8:0/3958034370 learned_addr learned my addr 172.21.15.8:0/3958034370 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28f77fe640 1 -- 172.21.15.8:0/3958034370 >> v1:172.21.15.116:6789/0 conn(0x7f28f8070630 legacy=0x7f28f8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28f77fe640 1 -- 172.21.15.8:0/3958034370 >> v1:172.21.15.8:6789/0 conn(0x7f28f813fb30 legacy=0x7f28f80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.370+0000 7f28f77fe640 1 -- 172.21.15.8:0/3958034370 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80ce620 con 0x7f28f813f750 2023-11-18T23:41:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.371+0000 7f28f77fe640 1 --2- 172.21.15.8:0/3958034370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f813f750 0x7f28f815b0d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f28e80097a0 tx=0x7f28e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b462bf5cb04bb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.371+0000 7f28f67fc640 1 -- 172.21.15.8:0/3958034370 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8031830 con 0x7f28f813f750 2023-11-18T23:41:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.371+0000 7f28f67fc640 1 -- 172.21.15.8:0/3958034370 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8031990 con 0x7f28f813f750 2023-11-18T23:41:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.371+0000 7f28f67fc640 1 -- 172.21.15.8:0/3958034370 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8031d20 con 0x7f28f813f750 2023-11-18T23:41:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.372+0000 7f28fdc51640 1 -- 172.21.15.8:0/3958034370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f813f750 msgr2=0x7f28f815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.372+0000 7f28fdc51640 1 --2- 172.21.15.8:0/3958034370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f813f750 0x7f28f815b0d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f28e80097a0 tx=0x7f28e802b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.372+0000 7f28fdc51640 1 -- 172.21.15.8:0/3958034370 shutdown_connections 2023-11-18T23:41:59.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.372+0000 7f28fdc51640 1 --2- 172.21.15.8:0/3958034370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f813f750 0x7f28f815b0d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.372+0000 7f28fdc51640 1 -- 172.21.15.8:0/3958034370 >> 172.21.15.8:0/3958034370 conn(0x7f28f806a8f0 msgr2=0x7f28f806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:59.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.372+0000 7f28fdc51640 1 -- 172.21.15.8:0/3958034370 shutdown_connections 2023-11-18T23:41:59.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.372+0000 7f28fdc51640 1 -- 172.21.15.8:0/3958034370 wait complete. 2023-11-18T23:41:59.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.373+0000 7f28fdc51640 1 Processor -- start 2023-11-18T23:41:59.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.373+0000 7f28fdc51640 1 -- start start 2023-11-18T23:41:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28fdc51640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f8070630 0x7f28f81f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28fdc51640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28f813f750 0x7f28f80ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28fdc51640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28f813fb30 0x7f28f815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28fdc51640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f815c6b0 con 0x7f28f8070630 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28fdc51640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81f1930 con 0x7f28f813f750 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28fdc51640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f815baa0 con 0x7f28f813fb30 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f8070630 0x7f28f81f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f8070630 0x7f28f81f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41736/0 (socket says 172.21.15.8:41736) 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 -- 172.21.15.8:0/2868182366 learned_addr learned my addr 172.21.15.8:0/2868182366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 -- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28f813fb30 msgr2=0x7f28f815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28f813fb30 0x7f28f815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f6ffd640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28f813f750 0x7f28f80ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 -- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28f813f750 msgr2=0x7f28f80ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28f813f750 0x7f28f80ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 -- 172.21.15.8:0/2868182366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8009400 con 0x7f28f8070630 2023-11-18T23:41:59.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f6ffd640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28f813f750 0x7f28f80ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:41:59.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28f77fe640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f8070630 0x7f28f81f13f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f28e80098c0 tx=0x7f28e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.374+0000 7f28dffff640 1 -- 172.21.15.8:0/2868182366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e803ba70 con 0x7f28f8070630 2023-11-18T23:41:59.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.375+0000 7f28dffff640 1 -- 172.21.15.8:0/2868182366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e803bbd0 con 0x7f28f8070630 2023-11-18T23:41:59.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.375+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f815bd80 con 0x7f28f8070630 2023-11-18T23:41:59.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.375+0000 7f28dffff640 1 -- 172.21.15.8:0/2868182366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80453f0 con 0x7f28f8070630 2023-11-18T23:41:59.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.375+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f815c340 con 0x7f28f8070630 2023-11-18T23:41:59.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.376+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f8072ae0 con 0x7f28f8070630 2023-11-18T23:41:59.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.376+0000 7f28dffff640 1 -- 172.21.15.8:0/2868182366 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28e804e450 con 0x7f28f8070630 2023-11-18T23:41:59.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.376+0000 7f28dffff640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f28e406ae40 0x7f28e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.377+0000 7f28dffff640 1 -- 172.21.15.8:0/2868182366 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f28e80ab940 con 0x7f28f8070630 2023-11-18T23:41:59.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.377+0000 7f28f6ffd640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f28e406ae40 0x7f28e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.377+0000 7f28f6ffd640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f28e406ae40 0x7f28e406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f28f81e5840 tx=0x7f28ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.381+0000 7f28dffff640 1 -- 172.21.15.8:0/2868182366 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28e8076960 con 0x7f28f8070630 2023-11-18T23:41:59.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.597+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f28f804e920 con 0x7f28f8070630 2023-11-18T23:41:59.599 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-11-18T23:41:59.598+0000 7ff6caacb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-18T23:41:59.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.599+0000 7f28dffff640 1 -- 172.21.15.8:0/2868182366 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f28e8079f80 con 0x7f28f8070630 2023-11-18T23:41:59.600 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T23:41:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f28e406ae40 msgr2=0x7f28e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f28e406ae40 0x7f28e406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f28f81e5840 tx=0x7f28ec009040 comp rx=0 tx=0).stop 2023-11-18T23:41:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f8070630 msgr2=0x7f28f81f13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f8070630 0x7f28f81f13f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f28e80098c0 tx=0x7f28e80046c0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 shutdown_connections 2023-11-18T23:41:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f28e406ae40 0x7f28e406d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28f813fb30 0x7f28f815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.601+0000 7f28fdc51640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28f813f750 0x7f28f80ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.602+0000 7f28fdc51640 1 --2- 172.21.15.8:0/2868182366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28f8070630 0x7f28f81f13f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.602+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 >> 172.21.15.8:0/2868182366 conn(0x7f28f806a8f0 msgr2=0x7f28f806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.602+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 shutdown_connections 2023-11-18T23:41:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.602+0000 7f28fdc51640 1 -- 172.21.15.8:0/2868182366 wait complete. 2023-11-18T23:41:59.606 INFO:tasks.ceph.mds.d.smithi116.stderr: -2746> 2023-11-18T23:41:14.913+0000 7fab654bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T23:41:59.614 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-18T23:41:59.635 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2023-11-18T23:41:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.722+0000 7fcca0883640 1 Processor -- start 2023-11-18T23:41:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.722+0000 7fcca0883640 1 -- start start 2023-11-18T23:41:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcca0883640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcc9c0cc170 0x7fcc9c0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcca0883640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c06a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcca0883640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c0cf510 con 0x7fcc9c0ce0d0 2023-11-18T23:41:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcca0883640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c0ce990 con 0x7fcc9c0cc170 2023-11-18T23:41:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcca0883640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0cec70 con 0x7fcc9c15f2a0 2023-11-18T23:41:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcc9a59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcc9c0cc170 0x7fcc9c0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcc99d9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcc9c0ce0d0 0x7fcc9c15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49146/0 (socket says 172.21.15.8:49146) 2023-11-18T23:41:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcc99d9b640 1 -- 172.21.15.8:0/2604474049 learned_addr learned my addr 172.21.15.8:0/2604474049 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:41:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.723+0000 7fcc9ad9d640 1 --2- 172.21.15.8:0/2604474049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.724+0000 7fcc9a59c640 1 -- 172.21.15.8:0/2604474049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 msgr2=0x7fcc9c06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:41:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.724+0000 7fcc9a59c640 1 --2- 172.21.15.8:0/2604474049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c06a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.724+0000 7fcc9a59c640 1 -- 172.21.15.8:0/2604474049 >> v1:172.21.15.8:6789/0 conn(0x7fcc9c0ce0d0 legacy=0x7fcc9c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.724+0000 7fcc9a59c640 1 -- 172.21.15.8:0/2604474049 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0cef50 con 0x7fcc9c0cc170 2023-11-18T23:41:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.724+0000 7fcc9959a640 1 -- 172.21.15.8:0/2604474049 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672340062 0 0) 0x7fcc9c0cf510 con 0x7fcc9c0ce0d0 2023-11-18T23:41:59.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.724+0000 7fcc9a59c640 1 --2- 172.21.15.8:0/2604474049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c0cc550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097a0 tx=0x7fcc9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e1fd3f3feb1f78 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.724+0000 7fcc9959a640 1 -- 172.21.15.8:0/2604474049 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94031830 con 0x7fcc9c0cc170 2023-11-18T23:41:59.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcc9959a640 1 -- 172.21.15.8:0/2604474049 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc94031990 con 0x7fcc9c0cc170 2023-11-18T23:41:59.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcc9959a640 1 -- 172.21.15.8:0/2604474049 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94031d20 con 0x7fcc9c0cc170 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 -- 172.21.15.8:0/2604474049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 msgr2=0x7fcc9c0cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 --2- 172.21.15.8:0/2604474049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c0cc550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097a0 tx=0x7fcc9402b8d0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 -- 172.21.15.8:0/2604474049 shutdown_connections 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 --2- 172.21.15.8:0/2604474049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c06a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 --2- 172.21.15.8:0/2604474049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c0cc550 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 -- 172.21.15.8:0/2604474049 >> 172.21.15.8:0/2604474049 conn(0x7fcc9c0b1670 msgr2=0x7fcc9c0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 -- 172.21.15.8:0/2604474049 shutdown_connections 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.725+0000 7fcca0883640 1 -- 172.21.15.8:0/2604474049 wait complete. 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 Processor -- start 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 -- start start 2023-11-18T23:41:59.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c13cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc9c0ce0d0 0x7fcc9c0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c1f63e0 con 0x7fcc9c0cc170 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b4900 con 0x7fcc9c0ce0d0 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcca0883640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b3cf0 con 0x7fcc9c15f2a0 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcc9a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c13cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcc9a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c13cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41752/0 (socket says 172.21.15.8:41752) 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.727+0000 7fcc9a59c640 1 -- 172.21.15.8:0/2001201746 learned_addr learned my addr 172.21.15.8:0/2001201746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc9ad9d640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc99d9b640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc9c0ce0d0 0x7fcc9c0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc9a59c640 1 -- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 msgr2=0x7fcc9c15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc9a59c640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c15a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc9a59c640 1 -- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc9c0ce0d0 msgr2=0x7fcc9c0b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc9a59c640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc9c0ce0d0 0x7fcc9c0b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc9a59c640 1 -- 172.21.15.8:0/2001201746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94009400 con 0x7fcc9c0cc170 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc99d9b640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc9c0ce0d0 0x7fcc9c0b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc9a59c640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c13cc50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcc940098c0 tx=0x7fcc940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc92ffd640 1 -- 172.21.15.8:0/2001201746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9403ba70 con 0x7fcc9c0cc170 2023-11-18T23:41:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc92ffd640 1 -- 172.21.15.8:0/2001201746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9403bbf0 con 0x7fcc9c0cc170 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c0b3fd0 con 0x7fcc9c0cc170 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcc92ffd640 1 -- 172.21.15.8:0/2001201746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940453f0 con 0x7fcc9c0cc170 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.728+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c0b4590 con 0x7fcc9c0cc170 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.729+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c072720 con 0x7fcc9c0cc170 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.730+0000 7fcc92ffd640 1 -- 172.21.15.8:0/2001201746 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc9404e450 con 0x7fcc9c0cc170 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.730+0000 7fcc92ffd640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fcc7c06ae40 0x7fcc7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.730+0000 7fcc92ffd640 1 -- 172.21.15.8:0/2001201746 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5927+0+0 (secure 0 0 0) 0x7fcc940ab980 con 0x7fcc9c0cc170 2023-11-18T23:41:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.730+0000 7fcc99d9b640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fcc7c06ae40 0x7fcc7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:41:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.731+0000 7fcc99d9b640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fcc7c06ae40 0x7fcc7c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0cd270 tx=0x7fcc84007c30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:41:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.734+0000 7fcc92ffd640 1 -- 172.21.15.8:0/2001201746 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc94076a70 con 0x7fcc9c0cc170 2023-11-18T23:41:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:41:59.949+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcc9c04e920 con 0x7fcc9c0cc170 2023-11-18T23:42:00.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.601+0000 7fcc92ffd640 1 -- 172.21.15.8:0/2001201746 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcc940350a0 con 0x7fcc9c0cc170 2023-11-18T23:42:00.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fcc7c06ae40 msgr2=0x7fcc7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fcc7c06ae40 0x7fcc7c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0cd270 tx=0x7fcc84007c30 comp rx=0 tx=0).stop 2023-11-18T23:42:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 msgr2=0x7fcc9c13cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c13cc50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcc940098c0 tx=0x7fcc940046c0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 shutdown_connections 2023-11-18T23:42:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fcc7c06ae40 0x7fcc7c06d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc9c15f2a0 0x7fcc9c15a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc9c0ce0d0 0x7fcc9c0b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 --2- 172.21.15.8:0/2001201746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c0cc170 0x7fcc9c13cc50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 >> 172.21.15.8:0/2001201746 conn(0x7fcc9c0b1670 msgr2=0x7fcc9c15b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 shutdown_connections 2023-11-18T23:42:00.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.604+0000 7fcca0883640 1 -- 172.21.15.8:0/2001201746 wait complete. 2023-11-18T23:42:00.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-18T23:42:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.736+0000 7f3c48b24640 1 Processor -- start 2023-11-18T23:42:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.736+0000 7f3c48b24640 1 -- start start 2023-11-18T23:42:00.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c48b24640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3c440b46f0 0x7f3c440ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c48b24640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440b3540 con 0x7f3c440aec00 2023-11-18T23:42:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c48b24640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440ce910 con 0x7f3c4415b0d0 2023-11-18T23:42:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c48b24640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440ceed0 con 0x7f3c440b46f0 2023-11-18T23:42:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c41d9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3c440aec00 0x7f3c440b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49156/0 (socket says 172.21.15.8:49156) 2023-11-18T23:42:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c41d9b640 1 -- 172.21.15.8:0/3133374486 learned_addr learned my addr 172.21.15.8:0/3133374486 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c42d9d640 1 --2- 172.21.15.8:0/3133374486 >> v2:172.21.15.116:3300/0 conn(0x7f3c440b46f0 0x7f3c440ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325953407 0 0) 0x7f3c440b3540 con 0x7f3c440aec00 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.737+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c30003520 con 0x7f3c440aec00 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1355797872 0 0) 0x7f3c30003520 con 0x7f3c440aec00 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 >> v2:172.21.15.116:3300/0 conn(0x7f3c440b46f0 msgr2=0x7f3c440ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 --2- 172.21.15.8:0/3133374486 >> v2:172.21.15.116:3300/0 conn(0x7f3c440b46f0 0x7f3c440ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 >> v1:172.21.15.116:6789/0 conn(0x7f3c4415b0d0 legacy=0x7f3c4406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440cebf0 con 0x7f3c440aec00 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f3c2c001670 con 0x7f3c440aec00 2023-11-18T23:42:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 >> v1:172.21.15.8:6789/0 conn(0x7f3c440aec00 legacy=0x7f3c440b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c30003970 0x7f3c30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c30005180 0x7f3c3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440ceed0 con 0x7f3c300047c0 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3000c020 con 0x7f3c30005180 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3000c1e0 con 0x7f3c30003970 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c41d9b640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c42d9d640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c30005180 0x7f3c3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c4259c640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c30003970 0x7f3c30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c41d9b640 1 -- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c30003970 msgr2=0x7f3c30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c41d9b640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c30003970 0x7f3c30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c41d9b640 1 -- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c30005180 msgr2=0x7f3c3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c41d9b640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c30005180 0x7f3c3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c42d9d640 1 -- 172.21.15.8:0/3133374486 reap_dead start 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.738+0000 7f3c41d9b640 1 -- 172.21.15.8:0/3133374486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30003520 con 0x7f3c300047c0 2023-11-18T23:42:00.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.739+0000 7f3c41d9b640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00c240 tx=0x7f3c300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73588b27a6d2425 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.739+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c005ad0 con 0x7f3c300047c0 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.739+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c005c30 con 0x7f3c300047c0 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.739+0000 7f3c4159a640 1 -- 172.21.15.8:0/3133374486 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c02ca90 con 0x7f3c300047c0 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.740+0000 7f3c48b24640 1 -- 172.21.15.8:0/3133374486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c300047c0 msgr2=0x7f3c30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.740+0000 7f3c48b24640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00c240 tx=0x7f3c300057f0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.740+0000 7f3c48b24640 1 -- 172.21.15.8:0/3133374486 shutdown_connections 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.740+0000 7f3c48b24640 1 --2- 172.21.15.8:0/3133374486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.740+0000 7f3c48b24640 1 -- 172.21.15.8:0/3133374486 >> 172.21.15.8:0/3133374486 conn(0x7f3c440cc0e0 msgr2=0x7f3c440cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:00.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.740+0000 7f3c48b24640 1 -- 172.21.15.8:0/3133374486 shutdown_connections 2023-11-18T23:42:00.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.740+0000 7f3c48b24640 1 -- 172.21.15.8:0/3133374486 wait complete. 2023-11-18T23:42:00.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.741+0000 7f3c48b24640 1 Processor -- start 2023-11-18T23:42:00.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.741+0000 7f3c48b24640 1 -- start start 2023-11-18T23:42:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c48b24640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c300047c0 0x7f3c440add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c48b24640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441f4d60 0x7f3c441f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c48b24640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c440cb470 0x7f3c440cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c48b24640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440ab6f0 con 0x7f3c441f4d60 2023-11-18T23:42:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c48b24640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440ab990 con 0x7f3c440cb470 2023-11-18T23:42:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c48b24640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440abc70 con 0x7f3c300047c0 2023-11-18T23:42:00.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441f4d60 0x7f3c441f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441f4d60 0x7f3c441f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41762/0 (socket says 172.21.15.8:41762) 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 -- 172.21.15.8:0/2331510090 learned_addr learned my addr 172.21.15.8:0/2331510090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c42d9d640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c440cb470 0x7f3c440cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c4259c640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c300047c0 0x7f3c440add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 -- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c300047c0 msgr2=0x7f3c440add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c300047c0 0x7f3c440add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 -- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c440cb470 msgr2=0x7f3c440cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:00.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c440cb470 0x7f3c440cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.742+0000 7f3c41d9b640 1 -- 172.21.15.8:0/2331510090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440abf50 con 0x7f3c441f4d60 2023-11-18T23:42:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.743+0000 7f3c41d9b640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441f4d60 0x7f3c441f43c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c001930 tx=0x7f3c2c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.743+0000 7f3c3affd640 1 -- 172.21.15.8:0/2331510090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c03c040 con 0x7f3c441f4d60 2023-11-18T23:42:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.743+0000 7f3c3affd640 1 -- 172.21.15.8:0/2331510090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c02cd20 con 0x7f3c441f4d60 2023-11-18T23:42:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.743+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c440ac230 con 0x7f3c441f4d60 2023-11-18T23:42:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.743+0000 7f3c3affd640 1 -- 172.21.15.8:0/2331510090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c007290 con 0x7f3c441f4d60 2023-11-18T23:42:00.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.743+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c440ae270 con 0x7f3c441f4d60 2023-11-18T23:42:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.744+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c44067420 con 0x7f3c441f4d60 2023-11-18T23:42:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.744+0000 7f3c3affd640 1 -- 172.21.15.8:0/2331510090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c2c032070 con 0x7f3c441f4d60 2023-11-18T23:42:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.745+0000 7f3c3affd640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3c2406ae40 0x7f3c2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.745+0000 7f3c3affd640 1 -- 172.21.15.8:0/2331510090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5927+0+0 (secure 0 0 0) 0x7f3c2c0aaae0 con 0x7f3c441f4d60 2023-11-18T23:42:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.745+0000 7f3c4259c640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3c2406ae40 0x7f3c2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.745+0000 7f3c4259c640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3c2406ae40 0x7f3c2406d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c000c00 tx=0x7f3c3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:00.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.749+0000 7f3c3affd640 1 -- 172.21.15.8:0/2331510090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c2c075ab0 con 0x7f3c441f4d60 2023-11-18T23:42:00.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:00.929+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c4415eaf0 con 0x7f3c441f4d60 2023-11-18T23:42:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.602+0000 7f3c3affd640 1 -- 172.21.15.8:0/2331510090 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3c2c0790d0 con 0x7f3c441f4d60 2023-11-18T23:42:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2023-11-18T23:42:01.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3c2406ae40 msgr2=0x7f3c2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:01.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3c2406ae40 0x7f3c2406d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c000c00 tx=0x7f3c3c009040 comp rx=0 tx=0).stop 2023-11-18T23:42:01.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441f4d60 msgr2=0x7f3c441f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:01.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441f4d60 0x7f3c441f43c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c001930 tx=0x7f3c2c02e070 comp rx=0 tx=0).stop 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 shutdown_connections 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f3c2406ae40 0x7f3c2406d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c440cb470 0x7f3c440cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441f4d60 0x7f3c441f43c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 --2- 172.21.15.8:0/2331510090 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c300047c0 0x7f3c440add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 >> 172.21.15.8:0/2331510090 conn(0x7f3c440cc0e0 msgr2=0x7f3c4415a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 shutdown_connections 2023-11-18T23:42:01.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.606+0000 7f3c48b24640 1 -- 172.21.15.8:0/2331510090 wait complete. 2023-11-18T23:42:01.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-18T23:42:01.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.738+0000 7f86615a9640 1 Processor -- start 2023-11-18T23:42:01.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.738+0000 7f86615a9640 1 -- start start 2023-11-18T23:42:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f86615a9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 0x7f865c0722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f86615a9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f865c157ad0 0x7f865c1616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f86615a9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c160f40 con 0x7f865c0b3170 2023-11-18T23:42:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f86615a9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c0b3740 con 0x7f865c157ad0 2023-11-18T23:42:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f86615a9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0b3a20 con 0x7f865c1576f0 2023-11-18T23:42:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f865b7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f865c0b3170 0x7f865c06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49160/0 (socket says 172.21.15.8:49160) 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f865b7fe640 1 -- 172.21.15.8:0/4292684223 learned_addr learned my addr 172.21.15.8:0/4292684223 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f8653fff640 1 --2- 172.21.15.8:0/4292684223 >> v2:172.21.15.116:3300/0 conn(0x7f865c157ad0 0x7f865c1616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f865affd640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 0x7f865c0722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809145427 0 0) 0x7f865c160f40 con 0x7f865c0b3170 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.739+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8648003520 con 0x7f865c0b3170 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 760658909 0 0) 0x7f8648003520 con 0x7f865c0b3170 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 msgr2=0x7f865c0722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 0x7f865c0722e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 >> v2:172.21.15.116:3300/0 conn(0x7f865c157ad0 msgr2=0x7f865c1616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 --2- 172.21.15.8:0/4292684223 >> v2:172.21.15.116:3300/0 conn(0x7f865c157ad0 0x7f865c1616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c1611b0 con 0x7f865c0b3170 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f86540019f0 con 0x7f865c0b3170 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865affd640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 0x7f865c0722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f8653fff640 1 --2- 172.21.15.8:0/4292684223 >> v2:172.21.15.116:3300/0 conn(0x7f865c157ad0 0x7f865c1616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 >> v1:172.21.15.8:6789/0 conn(0x7f865c0b3170 legacy=0x7f865c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8648003970 0x7f8648003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f8648004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 0x7f8648005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0b3740 con 0x7f86480047c0 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0b3a20 con 0x7f8648003970 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864800b980 con 0x7f865c1576f0 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f8653fff640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f8648004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865affd640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8648003970 0x7f8648003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f865b7fe640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 0x7f8648005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f8653fff640 1 -- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 msgr2=0x7f8648005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f8653fff640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c1576f0 0x7f8648005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f8653fff640 1 -- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8648003970 msgr2=0x7f8648003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f8653fff640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8648003970 0x7f8648003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.740+0000 7f8653fff640 1 -- 172.21.15.8:0/4292684223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009400 con 0x7f86480047c0 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.741+0000 7f8653fff640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f8648004c40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8644009c60 tx=0x7f86480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6620d2f851a7a36 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.741+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864402c950 con 0x7f86480047c0 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.741+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864402cab0 con 0x7f86480047c0 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.741+0000 7f865a7fc640 1 -- 172.21.15.8:0/4292684223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864402ce60 con 0x7f86480047c0 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.742+0000 7f86615a9640 1 -- 172.21.15.8:0/4292684223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 msgr2=0x7f8648004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.742+0000 7f86615a9640 1 --2- 172.21.15.8:0/4292684223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f8648004c40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8644009c60 tx=0x7f86480057f0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.742+0000 7f865b7fe640 1 -- 172.21.15.8:0/4292684223 reap_dead start 2023-11-18T23:42:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.742+0000 7f86615a9640 1 -- 172.21.15.8:0/4292684223 shutdown_connections 2023-11-18T23:42:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.742+0000 7f86615a9640 1 -- 172.21.15.8:0/4292684223 >> 172.21.15.8:0/4292684223 conn(0x7f865c06c050 msgr2=0x7f865c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.742+0000 7f86615a9640 1 -- 172.21.15.8:0/4292684223 shutdown_connections 2023-11-18T23:42:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.742+0000 7f86615a9640 1 -- 172.21.15.8:0/4292684223 wait complete. 2023-11-18T23:42:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.743+0000 7f86615a9640 1 Processor -- start 2023-11-18T23:42:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.743+0000 7f86615a9640 1 -- start start 2023-11-18T23:42:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86615a9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f865c1f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86615a9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f865c1410e0 0x7f865c153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86615a9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c06f290 0x7f865c06f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86615a9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c06fc50 con 0x7f86480047c0 2023-11-18T23:42:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86615a9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c153fb0 con 0x7f865c1410e0 2023-11-18T23:42:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86615a9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c154290 con 0x7f865c06f290 2023-11-18T23:42:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f865c1f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f865c1f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41776/0 (socket says 172.21.15.8:41776) 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 -- 172.21.15.8:0/717661125 learned_addr learned my addr 172.21.15.8:0/717661125 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f8653fff640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f865c1410e0 0x7f865c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865b7fe640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c06f290 0x7f865c06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 -- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c06f290 msgr2=0x7f865c06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c06f290 0x7f865c06f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 -- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f865c1410e0 msgr2=0x7f865c153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f865c1410e0 0x7f865c153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 -- 172.21.15.8:0/717661125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c154570 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f865affd640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f865c1f26d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f864c011cd0 tx=0x7f864c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86537fe640 1 -- 172.21.15.8:0/717661125 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00fd20 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86537fe640 1 -- 172.21.15.8:0/717661125 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00fe80 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c154850 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.744+0000 7f86537fe640 1 -- 172.21.15.8:0/717661125 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c004240 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.745+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c153d60 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.745+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c1549e0 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.746+0000 7f86537fe640 1 -- 172.21.15.8:0/717661125 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f864c0043a0 con 0x7f86480047c0 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.746+0000 7f86537fe640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f863c06ae70 0x7f863c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.746+0000 7f86537fe640 1 -- 172.21.15.8:0/717661125 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5489+0+0 (secure 0 0 0) 0x7f864c089ae0 con 0x7f86480047c0 2023-11-18T23:42:01.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.747+0000 7f8653fff640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f863c06ae70 0x7f863c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:01.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.747+0000 7f8653fff640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f863c06ae70 0x7f863c06d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8644036000 tx=0x7f8644030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:01.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.751+0000 7f86537fe640 1 -- 172.21.15.8:0/717661125 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f864c054d10 con 0x7f86480047c0 2023-11-18T23:42:01.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:01.928+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f865c067420 con 0x7f86480047c0 2023-11-18T23:42:02.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.930+0000 7f86537fe640 1 -- 172.21.15.8:0/717661125 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f864c022070 con 0x7f86480047c0 2023-11-18T23:42:02.932 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2023-11-18T23:42:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f863c06ae70 msgr2=0x7f863c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f863c06ae70 0x7f863c06d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8644036000 tx=0x7f8644030000 comp rx=0 tx=0).stop 2023-11-18T23:42:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 msgr2=0x7f865c1f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f865c1f26d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f864c011cd0 tx=0x7f864c00f610 comp rx=0 tx=0).stop 2023-11-18T23:42:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 shutdown_connections 2023-11-18T23:42:02.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f863c06ae70 0x7f863c06d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:02.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f865c06f290 0x7f865c06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:02.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f865c1410e0 0x7f865c153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:02.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 --2- 172.21.15.8:0/717661125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86480047c0 0x7f865c1f26d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:02.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 >> 172.21.15.8:0/717661125 conn(0x7f865c06c050 msgr2=0x7f865c06a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:02.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 shutdown_connections 2023-11-18T23:42:02.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:02.934+0000 7f86615a9640 1 -- 172.21.15.8:0/717661125 wait complete. 2023-11-18T23:42:02.950 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T23:42:02.950 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-18T23:42:02.951 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-18T23:42:02.951 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:42:02.951 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T23:42:02.951 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-18T23:42:02.951 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-18T23:42:02.951 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:42:02.952 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T23:42:02.952 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-18T23:42:02.952 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-18T23:42:02.952 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:42:02.952 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T23:42:02.952 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-18T23:42:02.952 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-18T23:42:02.952 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T23:42:02.962 INFO:tasks.ceph.mds.a:Stopped 2023-11-18T23:42:02.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-18T23:42:02.963 INFO:tasks.ceph.mds.c:Stopped 2023-11-18T23:42:02.963 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-18T23:42:02.965 INFO:tasks.ceph.mds.b:Stopped 2023-11-18T23:42:02.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-18T23:42:02.966 INFO:tasks.ceph.mds.d:Stopped 2023-11-18T23:42:02.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-18T23:42:03.004 INFO:tasks.ceph.mds.a:Started 2023-11-18T23:42:03.005 DEBUG:teuthology.parallel:result is None 2023-11-18T23:42:03.005 INFO:tasks.ceph.mds.c:Started 2023-11-18T23:42:03.006 DEBUG:teuthology.parallel:result is None 2023-11-18T23:42:03.008 INFO:tasks.ceph.mds.b:Started 2023-11-18T23:42:03.008 DEBUG:teuthology.parallel:result is None 2023-11-18T23:42:03.008 INFO:tasks.ceph.mds.d:Started 2023-11-18T23:42:03.008 DEBUG:teuthology.parallel:result is None 2023-11-18T23:42:03.009 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-18T23:42:03.087 INFO:tasks.ceph.mds.b.smithi116.stdout:starting mds.b at 2023-11-18T23:42:03.088 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2023-11-18T23:42:03.094 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-11-18T23:42:03.094 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-11-18T23:42:03.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.127+0000 7f82ce705640 1 Processor -- start 2023-11-18T23:42:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.127+0000 7f82ce705640 1 -- start start 2023-11-18T23:42:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82ce705640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f82c813f750 0x7f82c815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82ce705640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813fb30 0x7f82c80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82ce705640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82c815db40 0x7f82c815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82ce705640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80cec70 con 0x7f82c815db40 2023-11-18T23:42:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82ce705640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80ce060 con 0x7f82c813f750 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82ce705640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80ce340 con 0x7f82c813fb30 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82ccca2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82c815db40 0x7f82c815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82c77fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813fb30 0x7f82c80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82c7fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f82c813f750 0x7f82c815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.128+0000 7f82c7fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f82c813f750 0x7f82c815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.8:40578/0 (socket says 172.21.15.8:40578) 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.129+0000 7f82ccca2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f82c815db40 0x7f82c815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41820/0 (socket says 172.21.15.8:41820) 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.129+0000 7f82c7fff640 1 -- 172.21.15.8:0/1023172808 learned_addr learned my addr 172.21.15.8:0/1023172808 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.129+0000 7f82c7fff640 1 -- 172.21.15.8:0/1023172808 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813fb30 msgr2=0x7f82c80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.129+0000 7f82c7fff640 1 --2- 172.21.15.8:0/1023172808 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813fb30 0x7f82c80cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.129+0000 7f82c7fff640 1 -- 172.21.15.8:0/1023172808 >> v2:172.21.15.8:3300/0 conn(0x7f82c815db40 msgr2=0x7f82c815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.129+0000 7f82c7fff640 1 --2- 172.21.15.8:0/1023172808 >> v2:172.21.15.8:3300/0 conn(0x7f82c815db40 0x7f82c815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.129+0000 7f82c7fff640 1 -- 172.21.15.8:0/1023172808 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80ce620 con 0x7f82c813f750 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82c7fff640 1 --2- 172.21.15.8:0/1023172808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813f750 0x7f82c815b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f82c8071f40 tx=0x7f82b802fd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73bafc082331849 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82c6ffd640 1 -- 172.21.15.8:0/1023172808 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8030ad0 con 0x7f82c813f750 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82c6ffd640 1 -- 172.21.15.8:0/1023172808 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8030c30 con 0x7f82c813f750 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82c6ffd640 1 -- 172.21.15.8:0/1023172808 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8038440 con 0x7f82c813f750 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 -- 172.21.15.8:0/1023172808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813f750 msgr2=0x7f82c815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 --2- 172.21.15.8:0/1023172808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813f750 0x7f82c815b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f82c8071f40 tx=0x7f82b802fd20 comp rx=0 tx=0).stop 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 -- 172.21.15.8:0/1023172808 shutdown_connections 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 --2- 172.21.15.8:0/1023172808 >> v2:172.21.15.8:3300/0 conn(0x7f82c815db40 0x7f82c815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 --2- 172.21.15.8:0/1023172808 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813fb30 0x7f82c80cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 --2- 172.21.15.8:0/1023172808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813f750 0x7f82c815b0d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 -- 172.21.15.8:0/1023172808 >> 172.21.15.8:0/1023172808 conn(0x7f82c806a8f0 msgr2=0x7f82c806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 -- 172.21.15.8:0/1023172808 shutdown_connections 2023-11-18T23:42:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.130+0000 7f82ce705640 1 -- 172.21.15.8:0/1023172808 wait complete. 2023-11-18T23:42:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.132+0000 7f82ce705640 1 Processor -- start 2023-11-18T23:42:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.132+0000 7f82ce705640 1 -- start start 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.132+0000 7f82ce705640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813f750 0x7f82c815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.132+0000 7f82ce705640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813fb30 0x7f82c81f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ce705640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c815db40 0x7f82c81f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ce705640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8155440 con 0x7f82c815db40 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ce705640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c815d0b0 con 0x7f82c813fb30 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ce705640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c815bad0 con 0x7f82c813f750 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ccca2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c815db40 0x7f82c81f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ccca2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c815db40 0x7f82c81f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41828/0 (socket says 172.21.15.8:41828) 2023-11-18T23:42:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c7fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813f750 0x7f82c815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ccca2640 1 -- 172.21.15.8:0/3734100898 learned_addr learned my addr 172.21.15.8:0/3734100898 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c77fe640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813fb30 0x7f82c81f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c7fff640 1 -- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813fb30 msgr2=0x7f82c81f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c7fff640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813fb30 0x7f82c81f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c7fff640 1 -- 172.21.15.8:0/3734100898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c815db40 msgr2=0x7f82c81f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c7fff640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c815db40 0x7f82c81f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c7fff640 1 -- 172.21.15.8:0/3734100898 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80094d0 con 0x7f82c813f750 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82ccca2640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c815db40 0x7f82c81f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c77fe640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813fb30 0x7f82c81f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.133+0000 7f82c7fff640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813f750 0x7f82c815cb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82b8037000 tx=0x7f82b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.134+0000 7f82c4ff9640 1 -- 172.21.15.8:0/3734100898 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8043640 con 0x7f82c813f750 2023-11-18T23:42:03.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.134+0000 7f82c4ff9640 1 -- 172.21.15.8:0/3734100898 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b80437e0 con 0x7f82c813f750 2023-11-18T23:42:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.134+0000 7f82c4ff9640 1 -- 172.21.15.8:0/3734100898 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8043b90 con 0x7f82c813f750 2023-11-18T23:42:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.134+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c815bdb0 con 0x7f82c813f750 2023-11-18T23:42:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.134+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c815c370 con 0x7f82c813f750 2023-11-18T23:42:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.135+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c8072ae0 con 0x7f82c813f750 2023-11-18T23:42:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.136+0000 7f82c4ff9640 1 -- 172.21.15.8:0/3734100898 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82b803f040 con 0x7f82c813f750 2023-11-18T23:42:03.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.137+0000 7f82c4ff9640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f82b406ae40 0x7f82b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.137+0000 7f82c4ff9640 1 -- 172.21.15.8:0/3734100898 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f82b80af6e0 con 0x7f82c813f750 2023-11-18T23:42:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.138+0000 7f82c77fe640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f82b406ae40 0x7f82b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.138+0000 7f82c77fe640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f82b406ae40 0x7f82b406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f82c8068710 tx=0x7f82bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:03.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.141+0000 7f82c4ff9640 1 -- 172.21.15.8:0/3734100898 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82b807abc0 con 0x7f82c813f750 2023-11-18T23:42:03.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.335+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f82c804e920 con 0x7f82c813f750 2023-11-18T23:42:03.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.941+0000 7f82c4ff9640 1 -- 172.21.15.8:0/3734100898 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f82b807e1e0 con 0x7f82c813f750 2023-11-18T23:42:03.943 INFO:teuthology.orchestra.run.smithi008.stderr: removed all blocklist entries 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.944+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f82b406ae40 msgr2=0x7f82b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.944+0000 7f82ce705640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f82b406ae40 0x7f82b406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f82c8068710 tx=0x7f82bc009190 comp rx=0 tx=0).stop 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.944+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813f750 msgr2=0x7f82c815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.944+0000 7f82ce705640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813f750 0x7f82c815cb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82b8037000 tx=0x7f82b80046c0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.944+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 shutdown_connections 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.944+0000 7f82ce705640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f82b406ae40 0x7f82b406d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.944+0000 7f82ce705640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c815db40 0x7f82c81f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.945+0000 7f82ce705640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c813fb30 0x7f82c81f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.945+0000 7f82ce705640 1 --2- 172.21.15.8:0/3734100898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f82c813f750 0x7f82c815cb70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:03.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.945+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 >> 172.21.15.8:0/3734100898 conn(0x7f82c806a8f0 msgr2=0x7f82c80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:03.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.945+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 shutdown_connections 2023-11-18T23:42:03.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:03.945+0000 7f82ce705640 1 -- 172.21.15.8:0/3734100898 wait complete. 2023-11-18T23:42:03.960 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-18T23:42:04.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.069+0000 7f2340365640 1 Processor -- start 2023-11-18T23:42:04.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.069+0000 7f2340365640 1 -- start start 2023-11-18T23:42:04.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f2340365640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f233815d800 0x7f233806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f2340365640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233806e9e0 con 0x7f233806a8b0 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f2340365640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233806de60 con 0x7f23380b2690 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f2340365640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233806d2e0 con 0x7f233815d800 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233e902640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f233806a8b0 0x7f233806ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49178/0 (socket says 172.21.15.8:49178) 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233e902640 1 -- 172.21.15.8:0/138522519 learned_addr learned my addr 172.21.15.8:0/138522519 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233d900640 1 --2- 172.21.15.8:0/138522519 >> v2:172.21.15.116:3300/0 conn(0x7f233815d800 0x7f233806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233d0ff640 1 -- 172.21.15.8:0/138522519 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039777987 0 0) 0x7f233806e9e0 con 0x7f233806a8b0 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233d0ff640 1 -- 172.21.15.8:0/138522519 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2324003520 con 0x7f233806a8b0 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233d0ff640 1 -- 172.21.15.8:0/138522519 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472677811 0 0) 0x7f2324003520 con 0x7f233806a8b0 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233d900640 1 -- 172.21.15.8:0/138522519 >> v1:172.21.15.116:6789/0 conn(0x7f23380b2690 legacy=0x7f23380b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233d900640 1 -- 172.21.15.8:0/138522519 >> v1:172.21.15.8:6789/0 conn(0x7f233806a8b0 legacy=0x7f233806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.070+0000 7f233d900640 1 -- 172.21.15.8:0/138522519 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233806d5c0 con 0x7f233815d800 2023-11-18T23:42:04.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.071+0000 7f233d900640 1 --2- 172.21.15.8:0/138522519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f233806cc50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23280097a0 tx=0x7f232802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c701b711e7307dd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.071+0000 7f233d0ff640 1 -- 172.21.15.8:0/138522519 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300019f0 con 0x7f233815d800 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.071+0000 7f233d0ff640 1 -- 172.21.15.8:0/138522519 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232802e050 con 0x7f233815d800 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.071+0000 7f233d0ff640 1 -- 172.21.15.8:0/138522519 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328030710 con 0x7f233815d800 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.072+0000 7f2340365640 1 -- 172.21.15.8:0/138522519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 msgr2=0x7f233806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.072+0000 7f2340365640 1 --2- 172.21.15.8:0/138522519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f233806cc50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23280097a0 tx=0x7f232802b790 comp rx=0 tx=0).stop 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.072+0000 7f2340365640 1 -- 172.21.15.8:0/138522519 shutdown_connections 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.072+0000 7f2340365640 1 --2- 172.21.15.8:0/138522519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f233806cc50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.072+0000 7f2340365640 1 -- 172.21.15.8:0/138522519 >> 172.21.15.8:0/138522519 conn(0x7f23380cf6a0 msgr2=0x7f23380cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.072+0000 7f2340365640 1 -- 172.21.15.8:0/138522519 shutdown_connections 2023-11-18T23:42:04.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.072+0000 7f2340365640 1 -- 172.21.15.8:0/138522519 wait complete. 2023-11-18T23:42:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.073+0000 7f2340365640 1 Processor -- start 2023-11-18T23:42:04.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.073+0000 7f2340365640 1 -- start start 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f2340365640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f233806a8b0 0x7f2338151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f2340365640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23380b2690 0x7f23380c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f2340365640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f23380cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f2340365640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c5660 con 0x7f23380b2690 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f2340365640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c4a50 con 0x7f233815d800 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f2340365640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c4d30 con 0x7f233806a8b0 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233d900640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23380b2690 0x7f23380c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233d900640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23380b2690 0x7f23380c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41832/0 (socket says 172.21.15.8:41832) 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233d900640 1 -- 172.21.15.8:0/3913222029 learned_addr learned my addr 172.21.15.8:0/3913222029 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:04.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233e902640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f23380cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233e101640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f233806a8b0 0x7f2338151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233d900640 1 -- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f233806a8b0 msgr2=0x7f2338151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233d900640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f233806a8b0 0x7f2338151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233d900640 1 -- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 msgr2=0x7f23380cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.074+0000 7f233d900640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f23380cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f233d900640 1 -- 172.21.15.8:0/3913222029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328009400 con 0x7f23380b2690 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f233e902640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f23380cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f233e101640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f233806a8b0 0x7f2338151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f233d900640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23380b2690 0x7f23380c5af0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2328000c00 tx=0x7f23280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f232effd640 1 -- 172.21.15.8:0/3913222029 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232803d830 con 0x7f23380b2690 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f232effd640 1 -- 172.21.15.8:0/3913222029 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232803d990 con 0x7f23380b2690 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23380c5010 con 0x7f23380b2690 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f232effd640 1 -- 172.21.15.8:0/3913222029 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232803dd40 con 0x7f23380b2690 2023-11-18T23:42:04.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.075+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23381518a0 con 0x7f23380b2690 2023-11-18T23:42:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.076+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23380c5810 con 0x7f23380b2690 2023-11-18T23:42:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.077+0000 7f232effd640 1 -- 172.21.15.8:0/3913222029 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2328032400 con 0x7f23380b2690 2023-11-18T23:42:04.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.077+0000 7f232effd640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f231c06ae40 0x7f231c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.077+0000 7f232effd640 1 -- 172.21.15.8:0/3913222029 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23280ab290 con 0x7f23380b2690 2023-11-18T23:42:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.077+0000 7f233e101640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f231c06ae40 0x7f231c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.078+0000 7f233e101640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f231c06ae40 0x7f231c06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f23381f6600 tx=0x7f2334009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.082+0000 7f232effd640 1 -- 172.21.15.8:0/3913222029 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23380c5810 con 0x7f23380b2690 2023-11-18T23:42:04.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.324+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2338154750 con 0x7f23380b2690 2023-11-18T23:42:04.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.324+0000 7f232effd640 1 -- 172.21.15.8:0/3913222029 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2328076720 con 0x7f23380b2690 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: "auth_dump": [ 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.a", 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1llJF1lBRAAL5Z1HqSg7cZ3qtjKimJrFA==", 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.326 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.b", 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1llle7AEhAAHi2RUW5BB5a4vXphW/ALKA==", 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-11-18T23:42:04.327 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.c", 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1ll7E9mDRAATrIeinLTQ+sYnt8GrozzXw==", 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.d", 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1lluS8mGhAAFbmuZIx8Q6TGO7+MnSg3zw==", 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.329 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.0", 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBhS1llMgdHBxAAK6i2OLPrmVUcDO/EKdVfNw==", 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.1", 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBkS1llOFtyBhAA0qITFutD1bIAiivFwc7Y5A==", 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.2", 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBnS1llypnDBRAA909zPp13+rfqUi2p1GlnDw==", 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.3", 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBqS1llei3aBBAAJExvT2KNzaW+MRytjytBrQ==", 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.4", 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBwS1llmgowDBAAcaWlB0NBKb3JmrXUrzn//A==", 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.332 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.5", 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBzS1ll4PxjChAALB5TsdIzkXkh6TRvdhVBUA==", 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.6", 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB2S1llGeMoCRAAkC0vF/EHce1yMSn7vEYFLA==", 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.7", 2023-11-18T23:42:04.334 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB5S1lluagABxAAJK8+7xOBv9GcVNE8C0EAFQ==", 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.0", 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1llAtO6HhAAmnJ2CjYeVW/+aFk46V8/ag==", 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.335 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.1", 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1llCywqJhAABvMC0nxxcyudTnZ5kiYpeA==", 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.2", 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1ll332MIhAAh2y0x9zjV7q6Petzf9Zevg==", 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.337 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.3", 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1llUen/KxAAxn6wdpBrfGo/WN2+kaFibw==", 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.admin", 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBeS1llm7ikIhAA0EPHZPDIhUMhx8eYs2+2KA==", 2023-11-18T23:42:04.338 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mds", 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB/S1ll07t5BhAA8McnbK3RqFS5LxX/DSEboQ==", 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mds" 2023-11-18T23:42:04.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mgr", 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB/S1llpsR5BhAA8m6ub4NC2bbd0WA9N7KArA==", 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-osd", 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB/S1llQ8x5BhAAAdqsbWFF8Iyf1HQFKG4zlw==", 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.340 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-osd" 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd", 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB/S1llydN5BhAAa9o6Kv5wPvv9FK8hnVSddQ==", 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB/S1lloNt5BhAADDl36+kYvozFjS6MUmzC1g==", 2023-11-18T23:42:04.341 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rgw", 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB/S1llaeN5BhAAh6VA0HMXDslgY7joD7SibQ==", 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.x", 2023-11-18T23:42:04.342 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfS1llNP6BARAAZZC8g8qPIHbQNIy+zKPoGA==", 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.y", 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBeS1llotXdOBAArTNfRg614mXOCcEWleQoPQ==", 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:04.344 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-11-18T23:42:04.344 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f231c06ae40 msgr2=0x7f231c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f231c06ae40 0x7f231c06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f23381f6600 tx=0x7f2334009040 comp rx=0 tx=0).stop 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23380b2690 msgr2=0x7f23380c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23380b2690 0x7f23380c5af0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2328000c00 tx=0x7f23280046c0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 shutdown_connections 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f231c06ae40 0x7f231c06d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f233815d800 0x7f23380cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23380b2690 0x7f23380c5af0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 --2- 172.21.15.8:0/3913222029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f233806a8b0 0x7f2338151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 >> 172.21.15.8:0/3913222029 conn(0x7f23380cf6a0 msgr2=0x7f233815f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:04.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 shutdown_connections 2023-11-18T23:42:04.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.326+0000 7f2340365640 1 -- 172.21.15.8:0/3913222029 wait complete. 2023-11-18T23:42:04.347 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-18T23:42:04.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.453+0000 7f0b5196c640 1 Processor -- start 2023-11-18T23:42:04.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.453+0000 7f0b5196c640 1 -- start start 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b5196c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b4c160b70 0x7f0b4c0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b5196c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0b4c0b2aa0 0x7f0b4c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b5196c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c0ce360 con 0x7f0b4c0ced30 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b5196c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c0b2f20 con 0x7f0b4c160b70 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b5196c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c0cdd50 con 0x7f0b4c0b2aa0 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b4affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b4c160b70 0x7f0b4c0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b4b7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0b4c0ced30 0x7f0b4c0cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49182/0 (socket says 172.21.15.8:49182) 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b4b7fe640 1 -- 172.21.15.8:0/2321537414 learned_addr learned my addr 172.21.15.8:0/2321537414 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:04.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.454+0000 7f0b4a7fc640 1 --2- 172.21.15.8:0/2321537414 >> v2:172.21.15.116:3300/0 conn(0x7f0b4c0b2aa0 0x7f0b4c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.455+0000 7f0b4affd640 1 -- 172.21.15.8:0/2321537414 >> v2:172.21.15.116:3300/0 conn(0x7f0b4c0b2aa0 msgr2=0x7f0b4c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:04.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.455+0000 7f0b4affd640 1 --2- 172.21.15.8:0/2321537414 >> v2:172.21.15.116:3300/0 conn(0x7f0b4c0b2aa0 0x7f0b4c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.455+0000 7f0b4affd640 1 -- 172.21.15.8:0/2321537414 >> v1:172.21.15.8:6789/0 conn(0x7f0b4c0ced30 legacy=0x7f0b4c0cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.455+0000 7f0b4affd640 1 -- 172.21.15.8:0/2321537414 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0d1c70 con 0x7f0b4c160b70 2023-11-18T23:42:04.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.455+0000 7f0b49ffb640 1 -- 172.21.15.8:0/2321537414 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740570355 0 0) 0x7f0b4c0ce360 con 0x7f0b4c0ced30 2023-11-18T23:42:04.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.455+0000 7f0b4affd640 1 --2- 172.21.15.8:0/2321537414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c160b70 0x7f0b4c0d1570 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0d2e30 tx=0x7f0b4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2a01524ed56c17 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.455+0000 7f0b49ffb640 1 -- 172.21.15.8:0/2321537414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44031830 con 0x7f0b4c160b70 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b49ffb640 1 -- 172.21.15.8:0/2321537414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44031990 con 0x7f0b4c160b70 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b49ffb640 1 -- 172.21.15.8:0/2321537414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44031d20 con 0x7f0b4c160b70 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 -- 172.21.15.8:0/2321537414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c160b70 msgr2=0x7f0b4c0d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 --2- 172.21.15.8:0/2321537414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c160b70 0x7f0b4c0d1570 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0d2e30 tx=0x7f0b4402b8d0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 -- 172.21.15.8:0/2321537414 shutdown_connections 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 --2- 172.21.15.8:0/2321537414 >> v2:172.21.15.116:3300/0 conn(0x7f0b4c0b2aa0 0x7f0b4c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 --2- 172.21.15.8:0/2321537414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c160b70 0x7f0b4c0d1570 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 -- 172.21.15.8:0/2321537414 >> 172.21.15.8:0/2321537414 conn(0x7f0b4c09c470 msgr2=0x7f0b4c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 -- 172.21.15.8:0/2321537414 shutdown_connections 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.456+0000 7f0b5196c640 1 -- 172.21.15.8:0/2321537414 wait complete. 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.457+0000 7f0b5196c640 1 Processor -- start 2023-11-18T23:42:04.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.457+0000 7f0b5196c640 1 -- start start 2023-11-18T23:42:04.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b5196c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b4c0b2aa0 0x7f0b4c0b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b5196c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c0ced30 0x7f0b4c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b5196c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c160b70 0x7f0b4c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b5196c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0b6550 con 0x7f0b4c0ced30 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b5196c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0cd0a0 con 0x7f0b4c160b70 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b5196c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c159d80 con 0x7f0b4c0b2aa0 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b4a7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c0ced30 0x7f0b4c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b4a7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c0ced30 0x7f0b4c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41856/0 (socket says 172.21.15.8:41856) 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.458+0000 7f0b4a7fc640 1 -- 172.21.15.8:0/3063338776 learned_addr learned my addr 172.21.15.8:0/3063338776 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b4a7fc640 1 -- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b4c0b2aa0 msgr2=0x7f0b4c0b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b4a7fc640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b4c0b2aa0 0x7f0b4c0b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b4a7fc640 1 -- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c160b70 msgr2=0x7f0b4c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b4b7fe640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c160b70 0x7f0b4c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b4a7fc640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c160b70 0x7f0b4c0cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b4a7fc640 1 -- 172.21.15.8:0/3063338776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44009400 con 0x7f0b4c0ced30 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b4a7fc640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c0ced30 0x7f0b4c159840 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000d800 tx=0x7f0b4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b33fff640 1 -- 172.21.15.8:0/3063338776 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000b6c0 con 0x7f0b4c0ced30 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b33fff640 1 -- 172.21.15.8:0/3063338776 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000b820 con 0x7f0b4c0ced30 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c0ccb10 con 0x7f0b4c0ced30 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b33fff640 1 -- 172.21.15.8:0/3063338776 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000bbb0 con 0x7f0b4c0ced30 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.459+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c0b5e90 con 0x7f0b4c0ced30 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.460+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c0b5cf0 con 0x7f0b4c0ced30 2023-11-18T23:42:04.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.460+0000 7f0b33fff640 1 -- 172.21.15.8:0/3063338776 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b4000bd10 con 0x7f0b4c0ced30 2023-11-18T23:42:04.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.461+0000 7f0b33fff640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0b3806ae40 0x7f0b3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.461+0000 7f0b33fff640 1 -- 172.21.15.8:0/3063338776 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0b400897a0 con 0x7f0b4c0ced30 2023-11-18T23:42:04.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.461+0000 7f0b4affd640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0b3806ae40 0x7f0b3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.462+0000 7f0b4affd640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0b3806ae40 0x7f0b3806d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b44036000 tx=0x7f0b44030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.465+0000 7f0b33fff640 1 -- 172.21.15.8:0/3063338776 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b4c0b5cf0 con 0x7f0b4c0ced30 2023-11-18T23:42:04.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.713+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f0b4c0b5cf0 con 0x7f0b4c0ced30 2023-11-18T23:42:04.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.715+0000 7f0b33fff640 1 -- 172.21.15.8:0/3063338776 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0b4c0b5cf0 con 0x7f0b4c0ced30 2023-11-18T23:42:04.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0b3806ae40 msgr2=0x7f0b3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0b3806ae40 0x7f0b3806d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b44036000 tx=0x7f0b44030000 comp rx=0 tx=0).stop 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c0ced30 msgr2=0x7f0b4c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c0ced30 0x7f0b4c159840 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000d800 tx=0x7f0b4000dcc0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 shutdown_connections 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f0b3806ae40 0x7f0b3806d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c160b70 0x7f0b4c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b4c0ced30 0x7f0b4c159840 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 --2- 172.21.15.8:0/3063338776 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b4c0b2aa0 0x7f0b4c0b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 >> 172.21.15.8:0/3063338776 conn(0x7f0b4c09c470 msgr2=0x7f0b4c0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 shutdown_connections 2023-11-18T23:42:04.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.717+0000 7f0b5196c640 1 -- 172.21.15.8:0/3063338776 wait complete. 2023-11-18T23:42:04.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-18T23:42:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.835+0000 7f3205c44640 1 Processor -- start 2023-11-18T23:42:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.835+0000 7f3205c44640 1 -- start start 2023-11-18T23:42:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f3205c44640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f32000b6b50 0x7f32000cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f3205c44640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3200099970 0x7f3200099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f3205c44640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32000b3590 con 0x7f32000cc390 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f3205c44640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320006b310 con 0x7f32000b6b50 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f3205c44640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320009a2d0 con 0x7f3200099970 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31ff7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f32000b6b50 0x7f32000cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31ff7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f32000b6b50 0x7f32000cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41860/0 (socket says 172.21.15.8:41860) 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31ff7fe640 1 -- 172.21.15.8:0/3894750429 learned_addr learned my addr 172.21.15.8:0/3894750429 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31feffd640 1 --2- 172.21.15.8:0/3894750429 >> v2:172.21.15.116:3300/0 conn(0x7f3200099970 0x7f3200099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31ff7fe640 1 -- 172.21.15.8:0/3894750429 >> v2:172.21.15.116:3300/0 conn(0x7f3200099970 msgr2=0x7f3200099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31ff7fe640 1 --2- 172.21.15.8:0/3894750429 >> v2:172.21.15.116:3300/0 conn(0x7f3200099970 0x7f3200099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31ff7fe640 1 -- 172.21.15.8:0/3894750429 >> v1:172.21.15.116:6789/0 conn(0x7f32000cc390 legacy=0x7f32000cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31ff7fe640 1 -- 172.21.15.8:0/3894750429 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000b37c0 con 0x7f32000b6b50 2023-11-18T23:42:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.836+0000 7f31feffd640 1 --2- 172.21.15.8:0/3894750429 >> v2:172.21.15.116:3300/0 conn(0x7f3200099970 0x7f3200099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:04.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.837+0000 7f31ff7fe640 1 --2- 172.21.15.8:0/3894750429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000b6b50 0x7f32000cfd40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f32000719a0 tx=0x7f31f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a54a0d1cac40a7e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.837+0000 7f31fe7fc640 1 -- 172.21.15.8:0/3894750429 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0030860 con 0x7f32000b6b50 2023-11-18T23:42:04.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.837+0000 7f31fe7fc640 1 -- 172.21.15.8:0/3894750429 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00309c0 con 0x7f32000b6b50 2023-11-18T23:42:04.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.837+0000 7f31fe7fc640 1 -- 172.21.15.8:0/3894750429 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0030d50 con 0x7f32000b6b50 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 -- 172.21.15.8:0/3894750429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000b6b50 msgr2=0x7f32000cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 --2- 172.21.15.8:0/3894750429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000b6b50 0x7f32000cfd40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f32000719a0 tx=0x7f31f002b9a0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 -- 172.21.15.8:0/3894750429 shutdown_connections 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 --2- 172.21.15.8:0/3894750429 >> v2:172.21.15.116:3300/0 conn(0x7f3200099970 0x7f3200099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 --2- 172.21.15.8:0/3894750429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32000b6b50 0x7f32000cfd40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 -- 172.21.15.8:0/3894750429 >> 172.21.15.8:0/3894750429 conn(0x7f32000b2a70 msgr2=0x7f32000b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 -- 172.21.15.8:0/3894750429 shutdown_connections 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.838+0000 7f3205c44640 1 -- 172.21.15.8:0/3894750429 wait complete. 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.839+0000 7f3205c44640 1 Processor -- start 2023-11-18T23:42:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.839+0000 7f3205c44640 1 -- start start 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f3205c44640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3200099970 0x7f320009e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f3205c44640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32000b6b50 0x7f320009ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f3205c44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32000cc390 0x7f32001533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f3205c44640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320009b280 con 0x7f3200099970 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f3205c44640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320009b550 con 0x7f32000cc390 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f3205c44640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320009b830 con 0x7f32000b6b50 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3200099970 0x7f320009e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3200099970 0x7f320009e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41872/0 (socket says 172.21.15.8:41872) 2023-11-18T23:42:04.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 -- 172.21.15.8:0/1613549632 learned_addr learned my addr 172.21.15.8:0/1613549632 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31fffff640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32000cc390 0x7f32001533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 -- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32000b6b50 msgr2=0x7f320009ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32000b6b50 0x7f320009ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 -- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32000cc390 msgr2=0x7f32001533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32000cc390 0x7f32001533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 -- 172.21.15.8:0/1613549632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f00094d0 con 0x7f3200099970 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31ff7fe640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3200099970 0x7f320009e910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f31f0000c00 tx=0x7f31f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.840+0000 7f31e7fff640 1 -- 172.21.15.8:0/1613549632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0039d40 con 0x7f3200099970 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.841+0000 7f31e7fff640 1 -- 172.21.15.8:0/1613549632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0043400 con 0x7f3200099970 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.841+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320009bb10 con 0x7f3200099970 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.841+0000 7f31e7fff640 1 -- 172.21.15.8:0/1613549632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0039ea0 con 0x7f3200099970 2023-11-18T23:42:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.841+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320009c0d0 con 0x7f3200099970 2023-11-18T23:42:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.841+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320009ef40 con 0x7f3200099970 2023-11-18T23:42:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.842+0000 7f31e7fff640 1 -- 172.21.15.8:0/1613549632 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31f00437b0 con 0x7f3200099970 2023-11-18T23:42:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.842+0000 7f31e7fff640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f31ec06ae40 0x7f31ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.842+0000 7f31e7fff640 1 -- 172.21.15.8:0/1613549632 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31f003e070 con 0x7f3200099970 2023-11-18T23:42:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.843+0000 7f31feffd640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f31ec06ae40 0x7f31ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.843+0000 7f31feffd640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f31ec06ae40 0x7f31ec06d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:04.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:04.847+0000 7f31e7fff640 1 -- 172.21.15.8:0/1613549632 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31f0077ac0 con 0x7f3200099970 2023-11-18T23:42:05.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.097+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f320004e920 con 0x7f3200099970 2023-11-18T23:42:05.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.099+0000 7f31e7fff640 1 -- 172.21.15.8:0/1613549632 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f31f007b0e0 con 0x7f3200099970 2023-11-18T23:42:05.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f31ec06ae40 msgr2=0x7f31ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f31ec06ae40 0x7f31ec06d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4008040 comp rx=0 tx=0).stop 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3200099970 msgr2=0x7f320009e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3200099970 0x7f320009e910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f31f0000c00 tx=0x7f31f0004730 comp rx=0 tx=0).stop 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 shutdown_connections 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f31ec06ae40 0x7f31ec06d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32000cc390 0x7f32001533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32000b6b50 0x7f320009ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 --2- 172.21.15.8:0/1613549632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3200099970 0x7f320009e910 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 >> 172.21.15.8:0/1613549632 conn(0x7f32000b2a70 msgr2=0x7f32000cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 shutdown_connections 2023-11-18T23:42:05.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.101+0000 7f3205c44640 1 -- 172.21.15.8:0/1613549632 wait complete. 2023-11-18T23:42:05.113 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-18T23:42:05.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.220+0000 7f1992e6f640 1 Processor -- start 2023-11-18T23:42:05.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.220+0000 7f1992e6f640 1 -- start start 2023-11-18T23:42:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.220+0000 7f1992e6f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c0b6b50 0x7f198c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.220+0000 7f1992e6f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f198c06bc50 0x7f198c06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.220+0000 7f1992e6f640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0b3590 con 0x7f198c099970 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.220+0000 7f1992e6f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c06b310 con 0x7f198c06bc50 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.220+0000 7f1992e6f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0cd3a0 con 0x7f198c0b6b50 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f1990c0b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c0b6b50 0x7f198c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f199140c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f198c06bc50 0x7f198c06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f198bfff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f198c099970 0x7f198c099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:50540/0 (socket says 172.21.15.8:50540) 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f198bfff640 1 -- 172.21.15.8:0/90234536 learned_addr learned my addr 172.21.15.8:0/90234536 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f199140c640 1 -- 172.21.15.8:0/90234536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c0b6b50 msgr2=0x7f198c0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f199140c640 1 --2- 172.21.15.8:0/90234536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c0b6b50 0x7f198c0cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f199140c640 1 -- 172.21.15.8:0/90234536 >> v1:172.21.15.116:6789/0 conn(0x7f198c099970 legacy=0x7f198c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f199140c640 1 -- 172.21.15.8:0/90234536 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0b37c0 con 0x7f198c06bc50 2023-11-18T23:42:05.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.221+0000 7f198b7fe640 1 -- 172.21.15.8:0/90234536 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387050291 0 0) 0x7f198c0b3590 con 0x7f198c099970 2023-11-18T23:42:05.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.222+0000 7f199140c640 1 --2- 172.21.15.8:0/90234536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 0x7f198c06c0b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d90 tx=0x7f198402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60905287c42a33e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.222+0000 7f198b7fe640 1 -- 172.21.15.8:0/90234536 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198402cce0 con 0x7f198c06bc50 2023-11-18T23:42:05.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.222+0000 7f198b7fe640 1 -- 172.21.15.8:0/90234536 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198402ce40 con 0x7f198c06bc50 2023-11-18T23:42:05.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.222+0000 7f198b7fe640 1 -- 172.21.15.8:0/90234536 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984034660 con 0x7f198c06bc50 2023-11-18T23:42:05.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 -- 172.21.15.8:0/90234536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 msgr2=0x7f198c06c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 --2- 172.21.15.8:0/90234536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 0x7f198c06c0b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d90 tx=0x7f198402bf30 comp rx=0 tx=0).stop 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 -- 172.21.15.8:0/90234536 shutdown_connections 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 --2- 172.21.15.8:0/90234536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 0x7f198c06c0b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 --2- 172.21.15.8:0/90234536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c0b6b50 0x7f198c0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 -- 172.21.15.8:0/90234536 >> 172.21.15.8:0/90234536 conn(0x7f198c0b2a70 msgr2=0x7f198c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 -- 172.21.15.8:0/90234536 shutdown_connections 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.223+0000 7f1992e6f640 1 -- 172.21.15.8:0/90234536 wait complete. 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.224+0000 7f1992e6f640 1 Processor -- start 2023-11-18T23:42:05.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.224+0000 7f1992e6f640 1 -- start start 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f1992e6f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 0x7f198c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f1992e6f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c099970 0x7f198c1f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f1992e6f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f198c0b6b50 0x7f198c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f1992e6f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1f3840 con 0x7f198c0b6b50 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f1992e6f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1f3b20 con 0x7f198c06bc50 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f1992e6f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1f3e00 con 0x7f198c099970 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f198c0b6b50 0x7f198c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f198c0b6b50 0x7f198c0c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41884/0 (socket says 172.21.15.8:41884) 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 -- 172.21.15.8:0/244313622 learned_addr learned my addr 172.21.15.8:0/244313622 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f1990c0b640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 0x7f198c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 -- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c099970 msgr2=0x7f198c1f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f198bfff640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c099970 0x7f198c1f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c099970 0x7f198c1f2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 -- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 msgr2=0x7f198c152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 0x7f198c152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.225+0000 7f199140c640 1 -- 172.21.15.8:0/244313622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984009a70 con 0x7f198c0b6b50 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.226+0000 7f199140c640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f198c0b6b50 0x7f198c0c88f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d90 tx=0x7f1984004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.226+0000 7f19897fa640 1 -- 172.21.15.8:0/244313622 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198403d600 con 0x7f198c0b6b50 2023-11-18T23:42:05.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.226+0000 7f19897fa640 1 -- 172.21.15.8:0/244313622 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198403d780 con 0x7f198c0b6b50 2023-11-18T23:42:05.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.226+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c0c80f0 con 0x7f198c0b6b50 2023-11-18T23:42:05.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.226+0000 7f19897fa640 1 -- 172.21.15.8:0/244313622 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198403db30 con 0x7f198c0b6b50 2023-11-18T23:42:05.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.226+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c152840 con 0x7f198c0b6b50 2023-11-18T23:42:05.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.227+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c0c8610 con 0x7f198c0b6b50 2023-11-18T23:42:05.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.227+0000 7f19897fa640 1 -- 172.21.15.8:0/244313622 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f198403b040 con 0x7f198c0b6b50 2023-11-18T23:42:05.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.228+0000 7f19897fa640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197006ae40 0x7f197006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.228+0000 7f19897fa640 1 -- 172.21.15.8:0/244313622 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19840ab840 con 0x7f198c0b6b50 2023-11-18T23:42:05.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.228+0000 7f1990c0b640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197006ae40 0x7f197006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.229+0000 7f1990c0b640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197006ae40 0x7f197006d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1980009a30 tx=0x7f1980008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.232+0000 7f19897fa640 1 -- 172.21.15.8:0/244313622 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f198c0c8610 con 0x7f198c0b6b50 2023-11-18T23:42:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.474+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f198c0c8610 con 0x7f198c0b6b50 2023-11-18T23:42:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.476+0000 7f19897fa640 1 -- 172.21.15.8:0/244313622 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f198c0c8610 con 0x7f198c0b6b50 2023-11-18T23:42:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197006ae40 msgr2=0x7f197006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197006ae40 0x7f197006d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1980009a30 tx=0x7f1980008040 comp rx=0 tx=0).stop 2023-11-18T23:42:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f198c0b6b50 msgr2=0x7f198c0c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f198c0b6b50 0x7f198c0c88f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d90 tx=0x7f1984004a40 comp rx=0 tx=0).stop 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 shutdown_connections 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f197006ae40 0x7f197006d300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f198c0b6b50 0x7f198c0c88f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f198c099970 0x7f198c1f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 --2- 172.21.15.8:0/244313622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f198c06bc50 0x7f198c152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 >> 172.21.15.8:0/244313622 conn(0x7f198c0b2a70 msgr2=0x7f198c06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 shutdown_connections 2023-11-18T23:42:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.478+0000 7f1992e6f640 1 -- 172.21.15.8:0/244313622 wait complete. 2023-11-18T23:42:05.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-18T23:42:05.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.596+0000 7f880efa9640 1 Processor -- start 2023-11-18T23:42:05.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.596+0000 7f880efa9640 1 -- start start 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880efa9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f88080ce800 0x7f880815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880efa9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880815abf0 con 0x7f88080702e0 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880efa9640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080cebe0 con 0x7f880806d830 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880efa9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808070da0 con 0x7f88080ce800 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f8807fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f88080702e0 0x7f880806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49192/0 (socket says 172.21.15.8:49192) 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f8807fff640 1 -- 172.21.15.8:0/273752688 learned_addr learned my addr 172.21.15.8:0/273752688 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880cd45640 1 --2- 172.21.15.8:0/273752688 >> v2:172.21.15.116:3300/0 conn(0x7f88080ce800 0x7f880815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255239140 0 0) 0x7f880815abf0 con 0x7f88080702e0 2023-11-18T23:42:05.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f8003520 con 0x7f88080702e0 2023-11-18T23:42:05.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205517206 0 0) 0x7f88080cebe0 con 0x7f880806d830 2023-11-18T23:42:05.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f880815abf0 con 0x7f880806d830 2023-11-18T23:42:05.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 55707104 0 0) 0x7f87f8003520 con 0x7f88080702e0 2023-11-18T23:42:05.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880cd45640 1 -- 172.21.15.8:0/273752688 >> v1:172.21.15.116:6789/0 conn(0x7f880806d830 legacy=0x7f88080b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880cd45640 1 -- 172.21.15.8:0/273752688 >> v1:172.21.15.8:6789/0 conn(0x7f88080702e0 legacy=0x7f880806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.597+0000 7f880cd45640 1 -- 172.21.15.8:0/273752688 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808071080 con 0x7f88080ce800 2023-11-18T23:42:05.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.598+0000 7f880cd45640 1 --2- 172.21.15.8:0/273752688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88080ce800 0x7f880815a6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00a940 tx=0x7f87fc02cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=779e105cf61214d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.598+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4001670 con 0x7f88080ce800 2023-11-18T23:42:05.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc02d790 con 0x7f88080ce800 2023-11-18T23:42:05.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f88077fe640 1 -- 172.21.15.8:0/273752688 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc02db20 con 0x7f88080ce800 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f880efa9640 1 -- 172.21.15.8:0/273752688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88080ce800 msgr2=0x7f880815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f880efa9640 1 --2- 172.21.15.8:0/273752688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88080ce800 0x7f880815a6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00a940 tx=0x7f87fc02cc60 comp rx=0 tx=0).stop 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f880efa9640 1 -- 172.21.15.8:0/273752688 shutdown_connections 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f880efa9640 1 --2- 172.21.15.8:0/273752688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88080ce800 0x7f880815a6b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f880efa9640 1 -- 172.21.15.8:0/273752688 >> 172.21.15.8:0/273752688 conn(0x7f880806a8f0 msgr2=0x7f880806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f880efa9640 1 -- 172.21.15.8:0/273752688 shutdown_connections 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.599+0000 7f880efa9640 1 -- 172.21.15.8:0/273752688 wait complete. 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.600+0000 7f880efa9640 1 Processor -- start 2023-11-18T23:42:05.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.600+0000 7f880efa9640 1 -- start start 2023-11-18T23:42:05.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880efa9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f880806d830 0x7f88081513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880efa9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88080702e0 0x7f88081564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880efa9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88080ce800 0x7f88081f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880efa9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808156a20 con 0x7f88080702e0 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880efa9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808159160 con 0x7f880806d830 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880efa9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8808159440 con 0x7f88080ce800 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f8807fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88080702e0 0x7f88081564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f8807fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88080702e0 0x7f88081564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41892/0 (socket says 172.21.15.8:41892) 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f8807fff640 1 -- 172.21.15.8:0/2566516171 learned_addr learned my addr 172.21.15.8:0/2566516171 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880cd45640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f880806d830 0x7f88081513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.601+0000 7f880d546640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88080ce800 0x7f88081f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f8807fff640 1 -- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88080ce800 msgr2=0x7f88081f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f8807fff640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88080ce800 0x7f88081f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f8807fff640 1 -- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f880806d830 msgr2=0x7f88081513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f8807fff640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f880806d830 0x7f88081513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f8807fff640 1 -- 172.21.15.8:0/2566516171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc00a5a0 con 0x7f88080702e0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f880cd45640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f880806d830 0x7f88081513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f8807fff640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88080702e0 0x7f88081564e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005880 tx=0x7f87f400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f88057fa640 1 -- 172.21.15.8:0/2566516171 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4005ad0 con 0x7f88080702e0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f88057fa640 1 -- 172.21.15.8:0/2566516171 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4005c30 con 0x7f88080702e0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88081508e0 con 0x7f88080702e0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f88057fa640 1 -- 172.21.15.8:0/2566516171 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4007070 con 0x7f88080702e0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.602+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808150ea0 con 0x7f88080702e0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.603+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8808072ae0 con 0x7f88080702e0 2023-11-18T23:42:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.603+0000 7f88057fa640 1 -- 172.21.15.8:0/2566516171 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87f40071d0 con 0x7f88080702e0 2023-11-18T23:42:05.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.604+0000 7f88057fa640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f87ec06ae40 0x7f87ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.604+0000 7f88057fa640 1 -- 172.21.15.8:0/2566516171 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f87f4088870 con 0x7f88080702e0 2023-11-18T23:42:05.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.604+0000 7f880cd45640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f87ec06ae40 0x7f87ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.605+0000 7f880cd45640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f87ec06ae40 0x7f87ec06d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87fc037000 tx=0x7f87fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.608+0000 7f88057fa640 1 -- 172.21.15.8:0/2566516171 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87f4053db0 con 0x7f88080702e0 2023-11-18T23:42:05.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.853+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f880804e920 con 0x7f88080702e0 2023-11-18T23:42:05.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.855+0000 7f88057fa640 1 -- 172.21.15.8:0/2566516171 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f87f4017020 con 0x7f88080702e0 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f87ec06ae40 msgr2=0x7f87ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f87ec06ae40 0x7f87ec06d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87fc037000 tx=0x7f87fc008040 comp rx=0 tx=0).stop 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88080702e0 msgr2=0x7f88081564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88080702e0 0x7f88081564e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005880 tx=0x7f87f400cbe0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 shutdown_connections 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f87ec06ae40 0x7f87ec06d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88080ce800 0x7f88081f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88080702e0 0x7f88081564e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 --2- 172.21.15.8:0/2566516171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f880806d830 0x7f88081513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 >> 172.21.15.8:0/2566516171 conn(0x7f880806a8f0 msgr2=0x7f8808153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 shutdown_connections 2023-11-18T23:42:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.857+0000 7f880efa9640 1 -- 172.21.15.8:0/2566516171 wait complete. 2023-11-18T23:42:05.869 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-18T23:42:05.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.976+0000 7f94c2701640 1 Processor -- start 2023-11-18T23:42:05.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.976+0000 7f94c2701640 1 -- start start 2023-11-18T23:42:05.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94c2701640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94bc0b3610 0x7f94bc160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94c2701640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc0adda0 con 0x7f94bc06efd0 2023-11-18T23:42:05.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94c2701640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc0b3aa0 con 0x7f94bc161370 2023-11-18T23:42:05.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94c2701640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94bc161800 con 0x7f94bc0b3610 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94bbfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f94bc06efd0 0x7f94bc0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49202/0 (socket says 172.21.15.8:49202) 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94bbfff640 1 -- 172.21.15.8:0/4125662735 learned_addr learned my addr 172.21.15.8:0/4125662735 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/4125662735 >> v2:172.21.15.116:3300/0 conn(0x7f94bc0b3610 0x7f94bc160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610159504 0 0) 0x7f94bc0adda0 con 0x7f94bc06efd0 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.977+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a8003520 con 0x7f94bc06efd0 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250395567 0 0) 0x7f94a8003520 con 0x7f94bc06efd0 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 >> v2:172.21.15.116:3300/0 conn(0x7f94bc0b3610 msgr2=0x7f94bc160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 --2- 172.21.15.8:0/4125662735 >> v2:172.21.15.116:3300/0 conn(0x7f94bc0b3610 0x7f94bc160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 >> v1:172.21.15.116:6789/0 conn(0x7f94bc161370 legacy=0x7f94bc06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc0b3d80 con 0x7f94bc06efd0 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f94ac001670 con 0x7f94bc06efd0 2023-11-18T23:42:05.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 >> v1:172.21.15.8:6789/0 conn(0x7f94bc06efd0 legacy=0x7f94bc0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94a8003970 0x7f94a8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94a8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94a8005040 0x7f94a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc161800 con 0x7f94a8004370 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a800bfa0 con 0x7f94a8003970 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a800c160 con 0x7f94a8005040 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94a8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94bbfff640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94a8003970 0x7f94a8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94c0c9e640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94a8005040 0x7f94a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94bb7fe640 1 -- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94a8005040 msgr2=0x7f94a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:05.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94a8005040 0x7f94a800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94bb7fe640 1 -- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94a8003970 msgr2=0x7f94a8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94a8003970 0x7f94a8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94bb7fe640 1 -- 172.21.15.8:0/4125662735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8003520 con 0x7f94a8004370 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.978+0000 7f94c0c9e640 1 -- 172.21.15.8:0/4125662735 reap_dead start 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.979+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94a8004840 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009a90 tx=0x7f94a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1434ecd8ec7fd81b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.979+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a402c680 con 0x7f94a8004370 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.979+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a402c7e0 con 0x7f94a8004370 2023-11-18T23:42:05.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.979+0000 7f94baffd640 1 -- 172.21.15.8:0/4125662735 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a402cb70 con 0x7f94a8004370 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.980+0000 7f94c2701640 1 -- 172.21.15.8:0/4125662735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 msgr2=0x7f94a8004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.980+0000 7f94c2701640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94a8004840 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009a90 tx=0x7f94a80057f0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.980+0000 7f94c2701640 1 -- 172.21.15.8:0/4125662735 shutdown_connections 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.980+0000 7f94c2701640 1 --2- 172.21.15.8:0/4125662735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94a8004840 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.980+0000 7f94c2701640 1 -- 172.21.15.8:0/4125662735 >> 172.21.15.8:0/4125662735 conn(0x7f94bc0b1670 msgr2=0x7f94bc0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.980+0000 7f94c2701640 1 -- 172.21.15.8:0/4125662735 shutdown_connections 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.980+0000 7f94c2701640 1 -- 172.21.15.8:0/4125662735 wait complete. 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.981+0000 7f94c2701640 1 Processor -- start 2023-11-18T23:42:05.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.981+0000 7f94c2701640 1 -- start start 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c2701640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94bc1e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c2701640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc153300 0x7f94bc15fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c2701640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94bc160190 0x7f94bc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c2701640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc1e8670 con 0x7f94a8004370 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c2701640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc1e7d80 con 0x7f94bc153300 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c2701640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc1e8020 con 0x7f94bc160190 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94bc1e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94bc1e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41902/0 (socket says 172.21.15.8:41902) 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 -- 172.21.15.8:0/1795421841 learned_addr learned my addr 172.21.15.8:0/1795421841 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc153300 0x7f94bc15fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c0c9e640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94bc160190 0x7f94bc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 -- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94bc160190 msgr2=0x7f94bc06d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94bc160190 0x7f94bc06d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 -- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc153300 msgr2=0x7f94bc15fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc153300 0x7f94bc15fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 -- 172.21.15.8:0/1795421841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc1e8300 con 0x7f94a8004370 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94c0c9e640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94bc160190 0x7f94bc06d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.982+0000 7f94bbfff640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94bc1e8b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0072c0 tx=0x7f94ac007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.983+0000 7f94b8ff9640 1 -- 172.21.15.8:0/1795421841 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00f860 con 0x7f94a8004370 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.983+0000 7f94b8ff9640 1 -- 172.21.15.8:0/1795421841 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac00f9c0 con 0x7f94a8004370 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.983+0000 7f94b8ff9640 1 -- 172.21.15.8:0/1795421841 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00fd70 con 0x7f94a8004370 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.983+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc154fe0 con 0x7f94a8004370 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.983+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc153780 con 0x7f94a8004370 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.983+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc1e8160 con 0x7f94a8004370 2023-11-18T23:42:05.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.984+0000 7f94b8ff9640 1 -- 172.21.15.8:0/1795421841 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94ac01d460 con 0x7f94a8004370 2023-11-18T23:42:05.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.984+0000 7f94b8ff9640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f949c06ae40 0x7f949c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:05.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.985+0000 7f94b8ff9640 1 -- 172.21.15.8:0/1795421841 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94ac0892c0 con 0x7f94a8004370 2023-11-18T23:42:05.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.985+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f949c06ae40 0x7f949c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:05.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.985+0000 7f94bb7fe640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f949c06ae40 0x7f949c06d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f94a4036000 tx=0x7f94a4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:05.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:05.989+0000 7f94b8ff9640 1 -- 172.21.15.8:0/1795421841 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94bc1e8160 con 0x7f94a8004370 2023-11-18T23:42:06.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.235+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f94bc1e8160 con 0x7f94a8004370 2023-11-18T23:42:06.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.238+0000 7f94b8ff9640 1 -- 172.21.15.8:0/1795421841 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f94bc1e8160 con 0x7f94a8004370 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f949c06ae40 msgr2=0x7f949c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f949c06ae40 0x7f949c06d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f94a4036000 tx=0x7f94a4030000 comp rx=0 tx=0).stop 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 msgr2=0x7f94bc1e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94bc1e8b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0072c0 tx=0x7f94ac007780 comp rx=0 tx=0).stop 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 shutdown_connections 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f949c06ae40 0x7f949c06d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94bc160190 0x7f94bc06d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc153300 0x7f94bc15fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 --2- 172.21.15.8:0/1795421841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94a8004370 0x7f94bc1e8b00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.240+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 >> 172.21.15.8:0/1795421841 conn(0x7f94bc0b1670 msgr2=0x7f94bc06c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.241+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 shutdown_connections 2023-11-18T23:42:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.241+0000 7f94c2701640 1 -- 172.21.15.8:0/1795421841 wait complete. 2023-11-18T23:42:06.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-18T23:42:06.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.358+0000 7f22885b0640 1 Processor -- start 2023-11-18T23:42:06.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.358+0000 7f22885b0640 1 -- start start 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f22885b0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f22801465d0 0x7f22800b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f22885b0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 0x7f2280160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f22885b0640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22800721d0 con 0x7f228006a4d0 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f22885b0640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2280161d80 con 0x7f22801465d0 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f22885b0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22801612d0 con 0x7f2280071d40 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f2286b4d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f228006a4d0 0x7f22800cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49206/0 (socket says 172.21.15.8:49206) 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f2286b4d640 1 -- 172.21.15.8:0/3323504801 learned_addr learned my addr 172.21.15.8:0/3323504801 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f228634c640 1 --2- 172.21.15.8:0/3323504801 >> v2:172.21.15.116:3300/0 conn(0x7f22801465d0 0x7f22800b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.359+0000 7f2285b4b640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 0x7f2280160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869607507 0 0) 0x7f22800721d0 con 0x7f228006a4d0 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2268003520 con 0x7f228006a4d0 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3923438990 0 0) 0x7f2268003520 con 0x7f228006a4d0 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 msgr2=0x7f2280160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 0x7f2280160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 >> v2:172.21.15.116:3300/0 conn(0x7f22801465d0 msgr2=0x7f22800b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 --2- 172.21.15.8:0/3323504801 >> v2:172.21.15.116:3300/0 conn(0x7f22801465d0 0x7f22800b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800cf790 con 0x7f228006a4d0 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f2278001670 con 0x7f228006a4d0 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 >> v1:172.21.15.8:6789/0 conn(0x7f228006a4d0 legacy=0x7f22800cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 0x7f2268003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268003ef0 0x7f22680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2268004d00 0x7f2268005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2280161d80 con 0x7f2268004d00 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22801612d0 con 0x7f2268003ef0 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226800b980 con 0x7f2280071d40 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f2286b4d640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2268004d00 0x7f2268005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f228634c640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 0x7f2268003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f2285b4b640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268003ef0 0x7f22680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f2286b4d640 1 -- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 msgr2=0x7f2268003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f2286b4d640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2280071d40 0x7f2268003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f2286b4d640 1 -- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268003ef0 msgr2=0x7f22680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f2286b4d640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268003ef0 0x7f22680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.360+0000 7f2286b4d640 1 -- 172.21.15.8:0/3323504801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268003520 con 0x7f2268004d00 2023-11-18T23:42:06.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.361+0000 7f2286b4d640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2268004d00 0x7f2268005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f227800c290 tx=0x7f22680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa03947d9a093903 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:06.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.361+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278005ad0 con 0x7f2268004d00 2023-11-18T23:42:06.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.361+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278005c30 con 0x7f2268004d00 2023-11-18T23:42:06.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.361+0000 7f228534a640 1 -- 172.21.15.8:0/3323504801 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227802c8c0 con 0x7f2268004d00 2023-11-18T23:42:06.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.362+0000 7f22885b0640 1 -- 172.21.15.8:0/3323504801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2268004d00 msgr2=0x7f2268005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.362+0000 7f22885b0640 1 --2- 172.21.15.8:0/3323504801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2268004d00 0x7f2268005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f227800c290 tx=0x7f22680057f0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.362+0000 7f2286b4d640 1 -- 172.21.15.8:0/3323504801 reap_dead start 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.362+0000 7f22885b0640 1 -- 172.21.15.8:0/3323504801 shutdown_connections 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.362+0000 7f22885b0640 1 -- 172.21.15.8:0/3323504801 >> 172.21.15.8:0/3323504801 conn(0x7f22800cc930 msgr2=0x7f22800ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.362+0000 7f22885b0640 1 -- 172.21.15.8:0/3323504801 shutdown_connections 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.362+0000 7f22885b0640 1 -- 172.21.15.8:0/3323504801 wait complete. 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.363+0000 7f22885b0640 1 Processor -- start 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.363+0000 7f22885b0640 1 -- start start 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f22885b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268004d00 0x7f228013ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f22885b0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22800b3c70 0x7f22800b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f22885b0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22800ad820 0x7f22800adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f22885b0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228013b340 con 0x7f22800b3c70 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f22885b0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22800b4630 con 0x7f2268004d00 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f22885b0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228013c890 con 0x7f22800ad820 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22800b3c70 0x7f22800b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22800b3c70 0x7f22800b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41920/0 (socket says 172.21.15.8:41920) 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 -- 172.21.15.8:0/3623035845 learned_addr learned my addr 172.21.15.8:0/3623035845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f228634c640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268004d00 0x7f228013ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2286b4d640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22800ad820 0x7f22800adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 -- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22800ad820 msgr2=0x7f22800adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22800ad820 0x7f22800adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 -- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268004d00 msgr2=0x7f228013ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268004d00 0x7f228013ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 -- 172.21.15.8:0/3623035845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800ae570 con 0x7f22800b3c70 2023-11-18T23:42:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f228634c640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268004d00 0x7f228013ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.364+0000 7f2285b4b640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22800b3c70 0x7f22800b40f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f22740119a0 tx=0x7f2274011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.365+0000 7f227effd640 1 -- 172.21.15.8:0/3623035845 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400faf0 con 0x7f22800b3c70 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.365+0000 7f227effd640 1 -- 172.21.15.8:0/3623035845 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227400fc50 con 0x7f22800b3c70 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.365+0000 7f227effd640 1 -- 172.21.15.8:0/3623035845 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274014440 con 0x7f22800b3c70 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.365+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22800ae850 con 0x7f22800b3c70 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.365+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22800aee10 con 0x7f22800b3c70 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.366+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228006e6a0 con 0x7f22800b3c70 2023-11-18T23:42:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.366+0000 7f227effd640 1 -- 172.21.15.8:0/3623035845 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22740145a0 con 0x7f22800b3c70 2023-11-18T23:42:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.366+0000 7f227effd640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f226c06ae40 0x7f226c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.367+0000 7f227effd640 1 -- 172.21.15.8:0/3623035845 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2274089ba0 con 0x7f22800b3c70 2023-11-18T23:42:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.367+0000 7f228634c640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f226c06ae40 0x7f226c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.367+0000 7f228634c640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f226c06ae40 0x7f226c06d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f22700074d0 tx=0x7f227000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:06.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.371+0000 7f227effd640 1 -- 172.21.15.8:0/3623035845 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2274054fa0 con 0x7f22800b3c70 2023-11-18T23:42:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.617+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f228004e920 con 0x7f22800b3c70 2023-11-18T23:42:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.619+0000 7f227effd640 1 -- 172.21.15.8:0/3623035845 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2274022020 con 0x7f22800b3c70 2023-11-18T23:42:06.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f226c06ae40 msgr2=0x7f226c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f226c06ae40 0x7f226c06d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f22700074d0 tx=0x7f227000b040 comp rx=0 tx=0).stop 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22800b3c70 msgr2=0x7f22800b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22800b3c70 0x7f22800b40f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f22740119a0 tx=0x7f2274011e60 comp rx=0 tx=0).stop 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 shutdown_connections 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f226c06ae40 0x7f226c06d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22800ad820 0x7f22800adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22800b3c70 0x7f22800b40f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 --2- 172.21.15.8:0/3623035845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2268004d00 0x7f228013ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 >> 172.21.15.8:0/3623035845 conn(0x7f22800cc930 msgr2=0x7f228006e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 shutdown_connections 2023-11-18T23:42:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.621+0000 7f22885b0640 1 -- 172.21.15.8:0/3623035845 wait complete. 2023-11-18T23:42:06.633 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:42:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.738+0000 7fbe1cf90640 1 Processor -- start 2023-11-18T23:42:06.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.738+0000 7fbe1cf90640 1 -- start start 2023-11-18T23:42:06.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1cf90640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbe1815d3e0 0x7fbe180ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1cf90640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe180b5f90 con 0x7fbe180ced30 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1cf90640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe180b61e0 con 0x7fbe180d1e30 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1cf90640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe180cf170 con 0x7fbe1815d3e0 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1659c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbe1815d3e0 0x7fbe180ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe15d9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbe180ced30 0x7fbe180d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49214/0 (socket says 172.21.15.8:49214) 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1659c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbe1815d3e0 0x7fbe180ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41936/0 (socket says 172.21.15.8:41936) 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe15d9b640 1 -- 172.21.15.8:0/3895025032 learned_addr learned my addr 172.21.15.8:0/3895025032 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1659c640 1 -- 172.21.15.8:0/3895025032 >> v1:172.21.15.116:6789/0 conn(0x7fbe180d1e30 legacy=0x7fbe180b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1659c640 1 -- 172.21.15.8:0/3895025032 >> v1:172.21.15.8:6789/0 conn(0x7fbe180ced30 legacy=0x7fbe180d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1659c640 1 -- 172.21.15.8:0/3895025032 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe180b64c0 con 0x7fbe1815d3e0 2023-11-18T23:42:06.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.739+0000 7fbe1559a640 1 -- 172.21.15.8:0/3895025032 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311711927 0 0) 0x7fbe180b5f90 con 0x7fbe180ced30 2023-11-18T23:42:06.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.740+0000 7fbe1659c640 1 --2- 172.21.15.8:0/3895025032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180ce7f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbe080097a0 tx=0x7fbe0802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6365b1b9c558fa52 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.740+0000 7fbe1559a640 1 -- 172.21.15.8:0/3895025032 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0802f810 con 0x7fbe1815d3e0 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.740+0000 7fbe1559a640 1 -- 172.21.15.8:0/3895025032 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0802f970 con 0x7fbe1815d3e0 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.740+0000 7fbe1559a640 1 -- 172.21.15.8:0/3895025032 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0802fd00 con 0x7fbe1815d3e0 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.741+0000 7fbe1cf90640 1 -- 172.21.15.8:0/3895025032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 msgr2=0x7fbe180ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.741+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/3895025032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180ce7f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbe080097a0 tx=0x7fbe0802b9f0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.741+0000 7fbe1cf90640 1 -- 172.21.15.8:0/3895025032 shutdown_connections 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.741+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/3895025032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180ce7f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.741+0000 7fbe1cf90640 1 -- 172.21.15.8:0/3895025032 >> 172.21.15.8:0/3895025032 conn(0x7fbe1809c480 msgr2=0x7fbe180d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.741+0000 7fbe1cf90640 1 -- 172.21.15.8:0/3895025032 shutdown_connections 2023-11-18T23:42:06.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.741+0000 7fbe1cf90640 1 -- 172.21.15.8:0/3895025032 wait complete. 2023-11-18T23:42:06.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.742+0000 7fbe1cf90640 1 Processor -- start 2023-11-18T23:42:06.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.742+0000 7fbe1cf90640 1 -- start start 2023-11-18T23:42:06.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe1cf90640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe180ced30 0x7fbe180c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe1cf90640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe180d1e30 0x7fbe1815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe1cf90640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe1cf90640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180cbed0 con 0x7fbe1815d3e0 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe1cf90640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180cb300 con 0x7fbe180ced30 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe1cf90640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180cc360 con 0x7fbe180d1e30 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41942/0 (socket says 172.21.15.8:41942) 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 -- 172.21.15.8:0/418363621 learned_addr learned my addr 172.21.15.8:0/418363621 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 -- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe180d1e30 msgr2=0x7fbe1815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe180d1e30 0x7fbe1815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 -- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe180ced30 msgr2=0x7fbe180c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe180ced30 0x7fbe180c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.743+0000 7fbe16d9d640 1 -- 172.21.15.8:0/418363621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08009400 con 0x7fbe1815d3e0 2023-11-18T23:42:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.744+0000 7fbe16d9d640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180cf4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c7a0 tx=0x7fbe1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.744+0000 7fbe06ffd640 1 -- 172.21.15.8:0/418363621 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10003b70 con 0x7fbe1815d3e0 2023-11-18T23:42:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.744+0000 7fbe06ffd640 1 -- 172.21.15.8:0/418363621 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe10003cf0 con 0x7fbe1815d3e0 2023-11-18T23:42:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.744+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe180cb5a0 con 0x7fbe1815d3e0 2023-11-18T23:42:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.744+0000 7fbe06ffd640 1 -- 172.21.15.8:0/418363621 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10003ea0 con 0x7fbe1815d3e0 2023-11-18T23:42:06.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.744+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe180cbb60 con 0x7fbe1815d3e0 2023-11-18T23:42:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.745+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe18067420 con 0x7fbe1815d3e0 2023-11-18T23:42:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.745+0000 7fbe06ffd640 1 -- 172.21.15.8:0/418363621 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe1000aa90 con 0x7fbe1815d3e0 2023-11-18T23:42:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.746+0000 7fbe06ffd640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbdf806ae70 0x7fbdf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.746+0000 7fbe06ffd640 1 -- 172.21.15.8:0/418363621 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe100890e0 con 0x7fbe1815d3e0 2023-11-18T23:42:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.746+0000 7fbe1659c640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbdf806ae70 0x7fbdf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:06.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.746+0000 7fbe1659c640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbdf806ae70 0x7fbdf806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbe08036000 tx=0x7fbe08039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:06.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.750+0000 7fbe06ffd640 1 -- 172.21.15.8:0/418363621 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe100544e0 con 0x7fbe1815d3e0 2023-11-18T23:42:06.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.928+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe180cc010 con 0x7fbe1815d3e0 2023-11-18T23:42:06.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.929+0000 7fbe06ffd640 1 -- 172.21.15.8:0/418363621 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12785 (secure 0 0 0) 0x7fbe10057b00 con 0x7fbe1815d3e0 2023-11-18T23:42:06.930 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:06.930 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":29,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:42:03.947180+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:42:06.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbdf806ae70 msgr2=0x7fbdf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbdf806ae70 0x7fbdf806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbe08036000 tx=0x7fbe08039040 comp rx=0 tx=0).stop 2023-11-18T23:42:06.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 msgr2=0x7fbe180cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:06.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180cf4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c7a0 tx=0x7fbe1000cc60 comp rx=0 tx=0).stop 2023-11-18T23:42:06.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 shutdown_connections 2023-11-18T23:42:06.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fbdf806ae70 0x7fbdf806d330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1815d3e0 0x7fbe180cf4d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe180d1e30 0x7fbe1815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 --2- 172.21.15.8:0/418363621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe180ced30 0x7fbe180c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:06.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 >> 172.21.15.8:0/418363621 conn(0x7fbe1809c480 msgr2=0x7fbe180d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:06.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 shutdown_connections 2023-11-18T23:42:06.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:06.931+0000 7fbe1cf90640 1 -- 172.21.15.8:0/418363621 wait complete. 2023-11-18T23:42:06.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T23:40:59.299033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T23:42:06.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T23:42:07.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.051+0000 7f3906ecf640 1 Processor -- start 2023-11-18T23:42:07.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.051+0000 7f3906ecf640 1 -- start start 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f3906ecf640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f390009a080 0x7f39000cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f3906ecf640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39000b3590 con 0x7f390006bc50 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f3906ecf640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390006b310 con 0x7f39000b6b50 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f3906ecf640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39000cd3a0 con 0x7f390009a080 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f390546c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f390006bc50 0x7f390006c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49224/0 (socket says 172.21.15.8:49224) 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f390546c640 1 -- 172.21.15.8:0/3678216056 learned_addr learned my addr 172.21.15.8:0/3678216056 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38fffff640 1 --2- 172.21.15.8:0/3678216056 >> v2:172.21.15.116:3300/0 conn(0x7f390009a080 0x7f39000cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929758806 0 0) 0x7f39000b3590 con 0x7f390006bc50 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f0003520 con 0x7f390006bc50 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311444745 0 0) 0x7f390006b310 con 0x7f39000b6b50 2023-11-18T23:42:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39000b3590 con 0x7f39000b6b50 2023-11-18T23:42:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38fffff640 1 -- 172.21.15.8:0/3678216056 >> v1:172.21.15.116:6789/0 conn(0x7f39000b6b50 legacy=0x7f3900099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38fffff640 1 -- 172.21.15.8:0/3678216056 >> v1:172.21.15.8:6789/0 conn(0x7f390006bc50 legacy=0x7f390006c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310765493 0 0) 0x7f38f0003520 con 0x7f390006bc50 2023-11-18T23:42:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.052+0000 7f38fffff640 1 -- 172.21.15.8:0/3678216056 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000b37c0 con 0x7f390009a080 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.053+0000 7f38fffff640 1 --2- 172.21.15.8:0/3678216056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 0x7f39000cfd40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0097a0 tx=0x7f38ec02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ab592e4a2ae6b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.053+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f80019f0 con 0x7f390009a080 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.053+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec031590 con 0x7f390009a080 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.053+0000 7f38ff7fe640 1 -- 172.21.15.8:0/3678216056 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec031920 con 0x7f390009a080 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.054+0000 7f3906ecf640 1 -- 172.21.15.8:0/3678216056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 msgr2=0x7f39000cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.054+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3678216056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 0x7f39000cfd40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0097a0 tx=0x7f38ec02b8b0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.054+0000 7f3906ecf640 1 -- 172.21.15.8:0/3678216056 shutdown_connections 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.054+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3678216056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 0x7f39000cfd40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.054+0000 7f3906ecf640 1 -- 172.21.15.8:0/3678216056 >> 172.21.15.8:0/3678216056 conn(0x7f39000b2a70 msgr2=0x7f39000b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.054+0000 7f3906ecf640 1 -- 172.21.15.8:0/3678216056 shutdown_connections 2023-11-18T23:42:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.054+0000 7f3906ecf640 1 -- 172.21.15.8:0/3678216056 wait complete. 2023-11-18T23:42:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.055+0000 7f3906ecf640 1 Processor -- start 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.055+0000 7f3906ecf640 1 -- start start 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3906ecf640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390006bc50 0x7f390014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3906ecf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 0x7f39001474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3906ecf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39000b6b50 0x7f39001479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3906ecf640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900147f20 con 0x7f390006bc50 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3906ecf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39001584f0 con 0x7f390009a080 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3906ecf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3900158210 con 0x7f39000b6b50 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3904c6b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390006bc50 0x7f390014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3904c6b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390006bc50 0x7f390014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41954/0 (socket says 172.21.15.8:41954) 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3904c6b640 1 -- 172.21.15.8:0/3365851980 learned_addr learned my addr 172.21.15.8:0/3365851980 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3904c6b640 1 -- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39000b6b50 msgr2=0x7f39001479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f390546c640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39000b6b50 0x7f39001479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f38fffff640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 0x7f39001474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3904c6b640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39000b6b50 0x7f39001479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3904c6b640 1 -- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 msgr2=0x7f39001474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.056+0000 7f3904c6b640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 0x7f39001474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.057+0000 7f3904c6b640 1 -- 172.21.15.8:0/3365851980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec009400 con 0x7f390006bc50 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.057+0000 7f3904c6b640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390006bc50 0x7f390014a4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f38f400c430 tx=0x7f38f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.057+0000 7f38fd7fa640 1 -- 172.21.15.8:0/3365851980 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40052d0 con 0x7f390006bc50 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.057+0000 7f38fd7fa640 1 -- 172.21.15.8:0/3365851980 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4005450 con 0x7f390006bc50 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.057+0000 7f38fd7fa640 1 -- 172.21.15.8:0/3365851980 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4003830 con 0x7f390006bc50 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.057+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39000c9c50 con 0x7f390006bc50 2023-11-18T23:42:07.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.057+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39000ca210 con 0x7f390006bc50 2023-11-18T23:42:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.058+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39000c7ea0 con 0x7f390006bc50 2023-11-18T23:42:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.058+0000 7f38fd7fa640 1 -- 172.21.15.8:0/3365851980 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38f4003990 con 0x7f390006bc50 2023-11-18T23:42:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.059+0000 7f38fd7fa640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e406ae40 0x7f38e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.059+0000 7f38fd7fa640 1 -- 172.21.15.8:0/3365851980 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f38f4088960 con 0x7f390006bc50 2023-11-18T23:42:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.059+0000 7f38fffff640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e406ae40 0x7f38e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.060+0000 7f38fffff640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e406ae40 0x7f38e406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38ec036000 tx=0x7f38ec03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.063+0000 7f38fd7fa640 1 -- 172.21.15.8:0/3365851980 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38f4053cd0 con 0x7f390006bc50 2023-11-18T23:42:07.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.239+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39000c9ab0 con 0x7f390006bc50 2023-11-18T23:42:07.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.239+0000 7f38fd7fa640 1 -- 172.21.15.8:0/3365851980 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39000c9ab0 con 0x7f390006bc50 2023-11-18T23:42:07.241 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e406ae40 msgr2=0x7f38e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e406ae40 0x7f38e406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38ec036000 tx=0x7f38ec03d040 comp rx=0 tx=0).stop 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390006bc50 msgr2=0x7f390014a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390006bc50 0x7f390014a4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f38f400c430 tx=0x7f38f400c8f0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 shutdown_connections 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f38e406ae40 0x7f38e406d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39000b6b50 0x7f39001479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f390009a080 0x7f39001474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 --2- 172.21.15.8:0/3365851980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390006bc50 0x7f390014a4a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 >> 172.21.15.8:0/3365851980 conn(0x7f39000b2a70 msgr2=0x7f39000cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 shutdown_connections 2023-11-18T23:42:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.241+0000 7f3906ecf640 1 -- 172.21.15.8:0/3365851980 wait complete. 2023-11-18T23:42:07.254 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T23:42:07.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.359+0000 7f5f88826640 1 Processor -- start 2023-11-18T23:42:07.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.359+0000 7f5f88826640 1 -- start start 2023-11-18T23:42:07.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.359+0000 7f5f88826640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5f8409a080 0x7f5f840b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.359+0000 7f5f88826640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f840b0660 con 0x7f5f8415d900 2023-11-18T23:42:07.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f88826640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8406c900 con 0x7f5f840b2610 2023-11-18T23:42:07.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f88826640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8406cbe0 con 0x7f5f8409a080 2023-11-18T23:42:07.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f79d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5f8409a080 0x7f5f840b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f8259c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5f8415d900 0x7f5f84099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49226/0 (socket says 172.21.15.8:49226) 2023-11-18T23:42:07.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f8259c640 1 -- 172.21.15.8:0/2557910138 learned_addr learned my addr 172.21.15.8:0/2557910138 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:07.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f79d9b640 1 -- 172.21.15.8:0/2557910138 >> v1:172.21.15.116:6789/0 conn(0x7f5f840b2610 legacy=0x7f5f840b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:07.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f79d9b640 1 -- 172.21.15.8:0/2557910138 >> v1:172.21.15.8:6789/0 conn(0x7f5f8415d900 legacy=0x7f5f84099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f79d9b640 1 -- 172.21.15.8:0/2557910138 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8406cec0 con 0x7f5f8409a080 2023-11-18T23:42:07.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.360+0000 7f5f81d9b640 1 -- 172.21.15.8:0/2557910138 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676954154 0 0) 0x7f5f840b0660 con 0x7f5f8415d900 2023-11-18T23:42:07.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f79d9b640 1 --2- 172.21.15.8:0/2557910138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8409a080 0x7f5f840b0dd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0097a0 tx=0x7f5f6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab093154a4e93c8e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f81d9b640 1 -- 172.21.15.8:0/2557910138 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c031830 con 0x7f5f8409a080 2023-11-18T23:42:07.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f81d9b640 1 -- 172.21.15.8:0/2557910138 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c031990 con 0x7f5f8409a080 2023-11-18T23:42:07.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f81d9b640 1 -- 172.21.15.8:0/2557910138 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c031d20 con 0x7f5f8409a080 2023-11-18T23:42:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f88826640 1 -- 172.21.15.8:0/2557910138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8409a080 msgr2=0x7f5f840b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f88826640 1 --2- 172.21.15.8:0/2557910138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8409a080 0x7f5f840b0dd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0097a0 tx=0x7f5f6c02b8d0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f88826640 1 -- 172.21.15.8:0/2557910138 shutdown_connections 2023-11-18T23:42:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f88826640 1 --2- 172.21.15.8:0/2557910138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8409a080 0x7f5f840b0dd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f88826640 1 -- 172.21.15.8:0/2557910138 >> 172.21.15.8:0/2557910138 conn(0x7f5f840b2a70 msgr2=0x7f5f840b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f88826640 1 -- 172.21.15.8:0/2557910138 shutdown_connections 2023-11-18T23:42:07.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.361+0000 7f5f88826640 1 -- 172.21.15.8:0/2557910138 wait complete. 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.363+0000 7f5f88826640 1 Processor -- start 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.363+0000 7f5f88826640 1 -- start start 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f88826640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f8409a080 0x7f5f84159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f88826640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f840b2610 0x7f5f840b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f88826640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8415d900 0x7f5f840b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f88826640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840c8f20 con 0x7f5f8415d900 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f88826640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840c8050 con 0x7f5f8409a080 2023-11-18T23:42:07.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f88826640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840caf40 con 0x7f5f840b2610 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8415d900 0x7f5f840b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8415d900 0x7f5f840b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41976/0 (socket says 172.21.15.8:41976) 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 -- 172.21.15.8:0/1460706893 learned_addr learned my addr 172.21.15.8:0/1460706893 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f8259c640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f8409a080 0x7f5f84159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f79d9b640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f840b2610 0x7f5f840b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 -- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f840b2610 msgr2=0x7f5f840b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f840b2610 0x7f5f840b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 -- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f8409a080 msgr2=0x7f5f84159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f8409a080 0x7f5f84159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 -- 172.21.15.8:0/1460706893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009400 con 0x7f5f8415d900 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f82d9d640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8415d900 0x7f5f840b64b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00b970 tx=0x7f5f7c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f7b7fe640 1 -- 172.21.15.8:0/1460706893 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00cb40 con 0x7f5f8415d900 2023-11-18T23:42:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f7b7fe640 1 -- 172.21.15.8:0/1460706893 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c00cca0 con 0x7f5f8415d900 2023-11-18T23:42:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f7b7fe640 1 -- 172.21.15.8:0/1460706893 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c014680 con 0x7f5f8415d900 2023-11-18T23:42:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.364+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f840c82a0 con 0x7f5f8415d900 2023-11-18T23:42:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.365+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f840c8860 con 0x7f5f8415d900 2023-11-18T23:42:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.365+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f840c9060 con 0x7f5f8415d900 2023-11-18T23:42:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.366+0000 7f5f7b7fe640 1 -- 172.21.15.8:0/1460706893 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f7c01d3b0 con 0x7f5f8415d900 2023-11-18T23:42:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.366+0000 7f5f7b7fe640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5f6406ae70 0x7f5f6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.366+0000 7f5f7b7fe640 1 -- 172.21.15.8:0/1460706893 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f7c088f90 con 0x7f5f8415d900 2023-11-18T23:42:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.367+0000 7f5f8259c640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5f6406ae70 0x7f5f6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.367+0000 7f5f8259c640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5f6406ae70 0x7f5f6406d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000f60 tx=0x7f5f74007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.371+0000 7f5f7b7fe640 1 -- 172.21.15.8:0/1460706893 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f7c0bbe90 con 0x7f5f8415d900 2023-11-18T23:42:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.550+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5f840d02b0 con 0x7f5f8415d900 2023-11-18T23:42:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.550+0000 7f5f7b7fe640 1 -- 172.21.15.8:0/1460706893 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5f840c9060 con 0x7f5f8415d900 2023-11-18T23:42:07.552 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:07.552 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-11-18T23:42:07.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-11-18T23:42:07.552 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-11-18T23:42:07.552 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-11-18T23:42:07.552 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:07.552 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5f6406ae70 msgr2=0x7f5f6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5f6406ae70 0x7f5f6406d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000f60 tx=0x7f5f74007d50 comp rx=0 tx=0).stop 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8415d900 msgr2=0x7f5f840b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8415d900 0x7f5f840b64b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00b970 tx=0x7f5f7c00be30 comp rx=0 tx=0).stop 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 shutdown_connections 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f5f6406ae70 0x7f5f6406d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f8415d900 0x7f5f840b64b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f840b2610 0x7f5f840b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 --2- 172.21.15.8:0/1460706893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f8409a080 0x7f5f84159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 >> 172.21.15.8:0/1460706893 conn(0x7f5f840b2a70 msgr2=0x7f5f8415bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 shutdown_connections 2023-11-18T23:42:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.552+0000 7f5f88826640 1 -- 172.21.15.8:0/1460706893 wait complete. 2023-11-18T23:42:07.565 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T23:42:07.565 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T23:42:07.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.674+0000 7f4ca6133640 1 Processor -- start 2023-11-18T23:42:07.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.674+0000 7f4ca6133640 1 -- start start 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4ca6133640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4ca01576f0 0x7f4ca00722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4ca6133640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ca00b3170 0x7f4ca006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4ca6133640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca0160f40 con 0x7f4ca0157ad0 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4ca6133640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca00b3740 con 0x7f4ca00b3170 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4ca6133640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca00b3a20 con 0x7f4ca01576f0 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ca00b3170 0x7f4ca006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9effd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4ca0157ad0 0x7f4ca01616d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50544/0 (socket says 172.21.15.8:50544) 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9effd640 1 -- 172.21.15.8:0/2810873987 learned_addr learned my addr 172.21.15.8:0/2810873987 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9f7fe640 1 --2- 172.21.15.8:0/2810873987 >> v2:172.21.15.116:3300/0 conn(0x7f4ca01576f0 0x7f4ca00722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9ffff640 1 -- 172.21.15.8:0/2810873987 >> v2:172.21.15.116:3300/0 conn(0x7f4ca01576f0 msgr2=0x7f4ca00722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:07.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9ffff640 1 --2- 172.21.15.8:0/2810873987 >> v2:172.21.15.116:3300/0 conn(0x7f4ca01576f0 0x7f4ca00722e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9ffff640 1 -- 172.21.15.8:0/2810873987 >> v1:172.21.15.8:6789/0 conn(0x7f4ca0157ad0 legacy=0x7f4ca01616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9e7fc640 1 -- 172.21.15.8:0/2810873987 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848527058 0 0) 0x7f4ca0160f40 con 0x7f4ca0157ad0 2023-11-18T23:42:07.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.675+0000 7f4c9ffff640 1 -- 172.21.15.8:0/2810873987 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca01611b0 con 0x7f4ca00b3170 2023-11-18T23:42:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.676+0000 7f4c9ffff640 1 --2- 172.21.15.8:0/2810873987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca006a4d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4ca006e520 tx=0x7f4c9802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9250ed5fb4deddbb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.676+0000 7f4c9e7fc640 1 -- 172.21.15.8:0/2810873987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9802cc80 con 0x7f4ca00b3170 2023-11-18T23:42:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.676+0000 7f4c9e7fc640 1 -- 172.21.15.8:0/2810873987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9802cde0 con 0x7f4ca00b3170 2023-11-18T23:42:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.676+0000 7f4c9e7fc640 1 -- 172.21.15.8:0/2810873987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98034660 con 0x7f4ca00b3170 2023-11-18T23:42:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 -- 172.21.15.8:0/2810873987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 msgr2=0x7f4ca006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2810873987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca006a4d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4ca006e520 tx=0x7f4c9802bed0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 -- 172.21.15.8:0/2810873987 shutdown_connections 2023-11-18T23:42:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2810873987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca006a4d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2810873987 >> v2:172.21.15.116:3300/0 conn(0x7f4ca01576f0 0x7f4ca00722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 -- 172.21.15.8:0/2810873987 >> 172.21.15.8:0/2810873987 conn(0x7f4ca006c050 msgr2=0x7f4ca006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 -- 172.21.15.8:0/2810873987 shutdown_connections 2023-11-18T23:42:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.677+0000 7f4ca6133640 1 -- 172.21.15.8:0/2810873987 wait complete. 2023-11-18T23:42:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.678+0000 7f4ca6133640 1 Processor -- start 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.678+0000 7f4ca6133640 1 -- start start 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4ca6133640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca0151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4ca6133640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ca01576f0 0x7f4ca01537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4ca6133640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0157ad0 0x7f4ca015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4ca6133640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca015a360 con 0x7f4ca00b3170 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4ca6133640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0159ac0 con 0x7f4ca0157ad0 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4ca6133640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0159da0 con 0x7f4ca01576f0 2023-11-18T23:42:07.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4c9f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca0151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4c9f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca0151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33726/0 (socket says 172.21.15.8:33726) 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4c9f7fe640 1 -- 172.21.15.8:0/2234927943 learned_addr learned my addr 172.21.15.8:0/2234927943 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4c9ffff640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0157ad0 0x7f4ca015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.679+0000 7f4c9effd640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ca01576f0 0x7f4ca01537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c9f7fe640 1 -- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ca01576f0 msgr2=0x7f4ca01537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c9f7fe640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ca01576f0 0x7f4ca01537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c9f7fe640 1 -- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0157ad0 msgr2=0x7f4ca015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c9f7fe640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0157ad0 0x7f4ca015c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c9f7fe640 1 -- 172.21.15.8:0/2234927943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c98009a70 con 0x7f4ca00b3170 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c9ffff640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0157ad0 0x7f4ca015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c9f7fe640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca0151d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000d800 tx=0x7f4c9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c87fff640 1 -- 172.21.15.8:0/2234927943 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000b6c0 con 0x7f4ca00b3170 2023-11-18T23:42:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c87fff640 1 -- 172.21.15.8:0/2234927943 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000b820 con 0x7f4ca00b3170 2023-11-18T23:42:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca015a080 con 0x7f4ca00b3170 2023-11-18T23:42:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4c87fff640 1 -- 172.21.15.8:0/2234927943 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000bbb0 con 0x7f4ca00b3170 2023-11-18T23:42:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.680+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca00acb60 con 0x7f4ca00b3170 2023-11-18T23:42:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.681+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca0067420 con 0x7f4ca00b3170 2023-11-18T23:42:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.681+0000 7f4c87fff640 1 -- 172.21.15.8:0/2234927943 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c9000bd10 con 0x7f4ca00b3170 2023-11-18T23:42:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.682+0000 7f4c87fff640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4c8c06ae40 0x7f4c8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.682+0000 7f4c87fff640 1 -- 172.21.15.8:0/2234927943 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c90089820 con 0x7f4ca00b3170 2023-11-18T23:42:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.682+0000 7f4c9effd640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4c8c06ae40 0x7f4c8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.682+0000 7f4c9effd640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4c8c06ae40 0x7f4c8c06d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00af5c0 tx=0x7f4c94007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.686+0000 7f4c87fff640 1 -- 172.21.15.8:0/2234927943 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c90054c20 con 0x7f4ca00b3170 2023-11-18T23:42:07.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:07.862+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4ca006a960 con 0x7f4ca00b3170 2023-11-18T23:42:08.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.105+0000 7f4c87fff640 1 -- 172.21.15.8:0/2234927943 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4c90058240 con 0x7f4ca00b3170 2023-11-18T23:42:08.106 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-11-18T23:42:08.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.107+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4c8c06ae40 msgr2=0x7f4c8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:08.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.107+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4c8c06ae40 0x7f4c8c06d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00af5c0 tx=0x7f4c94007c00 comp rx=0 tx=0).stop 2023-11-18T23:42:08.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 msgr2=0x7f4ca0151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca0151d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000d800 tx=0x7f4c9000dcc0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 shutdown_connections 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f4c8c06ae40 0x7f4c8c06d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ca0157ad0 0x7f4ca015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4ca01576f0 0x7f4ca01537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 --2- 172.21.15.8:0/2234927943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ca00b3170 0x7f4ca0151d70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 >> 172.21.15.8:0/2234927943 conn(0x7f4ca006c050 msgr2=0x7f4ca006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 shutdown_connections 2023-11-18T23:42:08.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.108+0000 7f4ca6133640 1 -- 172.21.15.8:0/2234927943 wait complete. 2023-11-18T23:42:08.123 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T23:42:08.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.235+0000 7f3445e44640 1 Processor -- start 2023-11-18T23:42:08.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.235+0000 7f3445e44640 1 -- start start 2023-11-18T23:42:08.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f3445e44640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f344006ec60 0x7f344015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:08.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f3445e44640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f344015d690 0x7f344006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:08.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f3445e44640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f344006e460 0x7f3440160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:08.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f3445e44640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344015e9d0 con 0x7f344006e460 2023-11-18T23:42:08.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f3445e44640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344009a720 con 0x7f344015d690 2023-11-18T23:42:08.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f3445e44640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344006f580 con 0x7f344006ec60 2023-11-18T23:42:08.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f343ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f344006e460 0x7f3440160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:08.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f343ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f344006e460 0x7f3440160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33734/0 (socket says 172.21.15.8:33734) 2023-11-18T23:42:08.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.236+0000 7f343ffff640 1 -- 172.21.15.8:0/3417231929 learned_addr learned my addr 172.21.15.8:0/3417231929 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:08.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.237+0000 7f343ffff640 1 -- 172.21.15.8:0/3417231929 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f344006ec60 msgr2=0x7f344015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:08.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.237+0000 7f343ffff640 1 --2- 172.21.15.8:0/3417231929 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f344006ec60 0x7f344015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.237+0000 7f343ffff640 1 -- 172.21.15.8:0/3417231929 >> v2:172.21.15.116:3300/0 conn(0x7f344015d690 msgr2=0x7f344006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:08.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.237+0000 7f343ffff640 1 --2- 172.21.15.8:0/3417231929 >> v2:172.21.15.116:3300/0 conn(0x7f344015d690 0x7f344006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.237+0000 7f343ffff640 1 -- 172.21.15.8:0/3417231929 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440099b10 con 0x7f344006e460 2023-11-18T23:42:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.237+0000 7f343ffff640 1 --2- 172.21.15.8:0/3417231929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006e460 0x7f3440160f80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f344006b4b0 tx=0x7f343802be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7494cbd5d9c4a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f343e7fc640 1 -- 172.21.15.8:0/3417231929 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343802ca10 con 0x7f344006e460 2023-11-18T23:42:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f343e7fc640 1 -- 172.21.15.8:0/3417231929 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343802cb70 con 0x7f344006e460 2023-11-18T23:42:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f343e7fc640 1 -- 172.21.15.8:0/3417231929 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34380343f0 con 0x7f344006e460 2023-11-18T23:42:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 -- 172.21.15.8:0/3417231929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006e460 msgr2=0x7f3440160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 --2- 172.21.15.8:0/3417231929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006e460 0x7f3440160f80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f344006b4b0 tx=0x7f343802be70 comp rx=0 tx=0).stop 2023-11-18T23:42:08.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 -- 172.21.15.8:0/3417231929 shutdown_connections 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 --2- 172.21.15.8:0/3417231929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006e460 0x7f3440160f80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 --2- 172.21.15.8:0/3417231929 >> v2:172.21.15.116:3300/0 conn(0x7f344015d690 0x7f344006f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 --2- 172.21.15.8:0/3417231929 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f344006ec60 0x7f344015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 -- 172.21.15.8:0/3417231929 >> 172.21.15.8:0/3417231929 conn(0x7f34400b2a20 msgr2=0x7f34400b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 -- 172.21.15.8:0/3417231929 shutdown_connections 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.238+0000 7f3445e44640 1 -- 172.21.15.8:0/3417231929 wait complete. 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.239+0000 7f3445e44640 1 Processor -- start 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.239+0000 7f3445e44640 1 -- start start 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f3445e44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f344006e460 0x7f34400c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:08.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f3445e44640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006ec60 0x7f3440151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f3445e44640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3440152380 0x7f344009bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f3445e44640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440152830 con 0x7f344006ec60 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f3445e44640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400b6be0 con 0x7f344006e460 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f3445e44640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400b4700 con 0x7f3440152380 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f343effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006ec60 0x7f3440151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f343effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006ec60 0x7f3440151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33746/0 (socket says 172.21.15.8:33746) 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.240+0000 7f343effd640 1 -- 172.21.15.8:0/3039851935 learned_addr learned my addr 172.21.15.8:0/3039851935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343ffff640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3440152380 0x7f344009bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:08.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343f7fe640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f344006e460 0x7f34400c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343effd640 1 -- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3440152380 msgr2=0x7f344009bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343effd640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3440152380 0x7f344009bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343effd640 1 -- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f344006e460 msgr2=0x7f34400c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343effd640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f344006e460 0x7f34400c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343effd640 1 -- 172.21.15.8:0/3039851935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438009b30 con 0x7f344006ec60 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f343effd640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006ec60 0x7f3440151e40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f343400b410 tx=0x7f3434009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f3427fff640 1 -- 172.21.15.8:0/3039851935 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011830 con 0x7f344006ec60 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f3427fff640 1 -- 172.21.15.8:0/3039851935 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434011990 con 0x7f344006ec60 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34400b49a0 con 0x7f344006ec60 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f3427fff640 1 -- 172.21.15.8:0/3039851935 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011d40 con 0x7f344006ec60 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.241+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34400b4f60 con 0x7f344006ec60 2023-11-18T23:42:08.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.242+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344009f040 con 0x7f344006ec60 2023-11-18T23:42:08.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.242+0000 7f3427fff640 1 -- 172.21.15.8:0/3039851935 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f343401a400 con 0x7f344006ec60 2023-11-18T23:42:08.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.243+0000 7f3427fff640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f342c06ae70 0x7f342c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:08.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.243+0000 7f3427fff640 1 -- 172.21.15.8:0/3039851935 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3434089580 con 0x7f344006ec60 2023-11-18T23:42:08.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.243+0000 7f343f7fe640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f342c06ae70 0x7f342c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:08.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.244+0000 7f343f7fe640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f342c06ae70 0x7f342c06d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3430009890 tx=0x7f3430008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:08.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.248+0000 7f3427fff640 1 -- 172.21.15.8:0/3039851935 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3434054760 con 0x7f344006ec60 2023-11-18T23:42:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:08.425+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f344004e920 con 0x7f344006ec60 2023-11-18T23:42:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.107+0000 7f3427fff640 1 -- 172.21.15.8:0/3039851935 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3434015020 con 0x7f344006ec60 2023-11-18T23:42:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-11-18T23:42:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.111+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f342c06ae70 msgr2=0x7f342c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.111+0000 7f3445e44640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f342c06ae70 0x7f342c06d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3430009890 tx=0x7f3430008040 comp rx=0 tx=0).stop 2023-11-18T23:42:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.111+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006ec60 msgr2=0x7f3440151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.111+0000 7f3445e44640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006ec60 0x7f3440151e40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f343400b410 tx=0x7f3434009f90 comp rx=0 tx=0).stop 2023-11-18T23:42:09.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.117+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 shutdown_connections 2023-11-18T23:42:09.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.117+0000 7f3445e44640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f342c06ae70 0x7f342c06d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.117+0000 7f3445e44640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3440152380 0x7f344009bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.117+0000 7f3445e44640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f344006ec60 0x7f3440151e40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.117+0000 7f3445e44640 1 --2- 172.21.15.8:0/3039851935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f344006e460 0x7f34400c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.118+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 >> 172.21.15.8:0/3039851935 conn(0x7f34400b2a20 msgr2=0x7f34400b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.122+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 shutdown_connections 2023-11-18T23:42:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.122+0000 7f3445e44640 1 -- 172.21.15.8:0/3039851935 wait complete. 2023-11-18T23:42:09.143 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T23:42:09.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.256+0000 7f430ad41640 1 Processor -- start 2023-11-18T23:42:09.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.256+0000 7f430ad41640 1 -- start start 2023-11-18T23:42:09.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f430ad41640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43040b6b50 0x7f43040cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:09.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f430ad41640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f430406bc50 0x7f430406c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:09.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f430ad41640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43040b3590 con 0x7f4304099970 2023-11-18T23:42:09.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f430ad41640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430406b310 con 0x7f430406bc50 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f430ad41640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43040cd3a0 con 0x7f43040b6b50 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f43092de640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f430406bc50 0x7f430406c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f4303fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4304099970 0x7f4304099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50554/0 (socket says 172.21.15.8:50554) 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f4303fff640 1 -- 172.21.15.8:0/1219253979 learned_addr learned my addr 172.21.15.8:0/1219253979 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f4308add640 1 --2- 172.21.15.8:0/1219253979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43040b6b50 0x7f43040cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.257+0000 7f43092de640 1 -- 172.21.15.8:0/1219253979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43040b6b50 msgr2=0x7f43040cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43092de640 1 --2- 172.21.15.8:0/1219253979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43040b6b50 0x7f43040cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43092de640 1 -- 172.21.15.8:0/1219253979 >> v1:172.21.15.8:6789/0 conn(0x7f4304099970 legacy=0x7f4304099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:09.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43037fe640 1 -- 172.21.15.8:0/1219253979 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020742427 0 0) 0x7f43040b3590 con 0x7f4304099970 2023-11-18T23:42:09.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43092de640 1 -- 172.21.15.8:0/1219253979 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43040b37c0 con 0x7f430406bc50 2023-11-18T23:42:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43092de640 1 --2- 172.21.15.8:0/1219253979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f430406bc50 0x7f430406c0b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009d90 tx=0x7f42fc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5685e0bd84b54ea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43037fe640 1 -- 172.21.15.8:0/1219253979 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc02cce0 con 0x7f430406bc50 2023-11-18T23:42:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43037fe640 1 -- 172.21.15.8:0/1219253979 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc02ce40 con 0x7f430406bc50 2023-11-18T23:42:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.258+0000 7f43037fe640 1 -- 172.21.15.8:0/1219253979 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc034660 con 0x7f430406bc50 2023-11-18T23:42:09.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 -- 172.21.15.8:0/1219253979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f430406bc50 msgr2=0x7f430406c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 --2- 172.21.15.8:0/1219253979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f430406bc50 0x7f430406c0b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009d90 tx=0x7f42fc02bf30 comp rx=0 tx=0).stop 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 -- 172.21.15.8:0/1219253979 shutdown_connections 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 --2- 172.21.15.8:0/1219253979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f430406bc50 0x7f430406c0b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 --2- 172.21.15.8:0/1219253979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43040b6b50 0x7f43040cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 -- 172.21.15.8:0/1219253979 >> 172.21.15.8:0/1219253979 conn(0x7f43040b2a70 msgr2=0x7f43040b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 -- 172.21.15.8:0/1219253979 shutdown_connections 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.259+0000 7f430ad41640 1 -- 172.21.15.8:0/1219253979 wait complete. 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.260+0000 7f430ad41640 1 Processor -- start 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.260+0000 7f430ad41640 1 -- start start 2023-11-18T23:42:09.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f430ad41640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f430406bc50 0x7f430415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f430ad41640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4304099970 0x7f430414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f430ad41640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43040b6b50 0x7f43040c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f430ad41640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43040c5ca0 con 0x7f4304099970 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f430ad41640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430415acb0 con 0x7f43040b6b50 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f430ad41640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43040c5340 con 0x7f430406bc50 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f4303fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4304099970 0x7f430414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f4303fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4304099970 0x7f430414b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33766/0 (socket says 172.21.15.8:33766) 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f4303fff640 1 -- 172.21.15.8:0/276296612 learned_addr learned my addr 172.21.15.8:0/276296612 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:09.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f43092de640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43040b6b50 0x7f43040c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f4308add640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f430406bc50 0x7f430415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f4303fff640 1 -- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f430406bc50 msgr2=0x7f430415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f4303fff640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f430406bc50 0x7f430415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.261+0000 7f4303fff640 1 -- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43040b6b50 msgr2=0x7f43040c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f4303fff640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43040b6b50 0x7f43040c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f4303fff640 1 -- 172.21.15.8:0/276296612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc009a70 con 0x7f4304099970 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f4308add640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f430406bc50 0x7f430415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f4303fff640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4304099970 0x7f430414b370 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c4d0 tx=0x7f42f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f43017fa640 1 -- 172.21.15.8:0/276296612 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f00074e0 con 0x7f4304099970 2023-11-18T23:42:09.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f43017fa640 1 -- 172.21.15.8:0/276296612 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0007660 con 0x7f4304099970 2023-11-18T23:42:09.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f43017fa640 1 -- 172.21.15.8:0/276296612 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0004a20 con 0x7f4304099970 2023-11-18T23:42:09.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43040c55e0 con 0x7f4304099970 2023-11-18T23:42:09.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.262+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430414b8b0 con 0x7f4304099970 2023-11-18T23:42:09.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.263+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43040c5de0 con 0x7f4304099970 2023-11-18T23:42:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.263+0000 7f43017fa640 1 -- 172.21.15.8:0/276296612 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42f0004b80 con 0x7f4304099970 2023-11-18T23:42:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.264+0000 7f43017fa640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f42e806ae40 0x7f42e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.264+0000 7f43017fa640 1 -- 172.21.15.8:0/276296612 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f42f00886b0 con 0x7f4304099970 2023-11-18T23:42:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.264+0000 7f4308add640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f42e806ae40 0x7f42e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.265+0000 7f4308add640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f42e806ae40 0x7f42e806d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f42f8006fd0 tx=0x7f42f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:09.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.269+0000 7f43017fa640 1 -- 172.21.15.8:0/276296612 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43040c5de0 con 0x7f4304099970 2023-11-18T23:42:09.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:09.480+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f43040c5de0 con 0x7f4304099970 2023-11-18T23:42:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.123+0000 7f43017fa640 1 -- 172.21.15.8:0/276296612 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f43040c5de0 con 0x7f4304099970 2023-11-18T23:42:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 4 and data pool 5 2023-11-18T23:42:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.128+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f42e806ae40 msgr2=0x7f42e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.128+0000 7f430ad41640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f42e806ae40 0x7f42e806d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f42f8006fd0 tx=0x7f42f8008040 comp rx=0 tx=0).stop 2023-11-18T23:42:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.128+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4304099970 msgr2=0x7f430414b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.128+0000 7f430ad41640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4304099970 0x7f430414b370 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c4d0 tx=0x7f42f000c990 comp rx=0 tx=0).stop 2023-11-18T23:42:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 shutdown_connections 2023-11-18T23:42:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f42e806ae40 0x7f42e806d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43040b6b50 0x7f43040c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4304099970 0x7f430414b370 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 --2- 172.21.15.8:0/276296612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f430406bc50 0x7f430415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 >> 172.21.15.8:0/276296612 conn(0x7f43040b2a70 msgr2=0x7f43040cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 shutdown_connections 2023-11-18T23:42:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.129+0000 7f430ad41640 1 -- 172.21.15.8:0/276296612 wait complete. 2023-11-18T23:42:10.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:42:10.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.271+0000 7ff50170f640 1 Processor -- start 2023-11-18T23:42:10.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.271+0000 7ff50170f640 1 -- start start 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.272+0000 7ff50170f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4fc0b4810 0x7ff4fc15b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.272+0000 7ff50170f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc15bd90 0x7ff4fc0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.272+0000 7ff50170f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc06de80 con 0x7ff4fc13e2d0 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.272+0000 7ff50170f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc15fc60 con 0x7ff4fc0b4810 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.272+0000 7ff50170f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc06d5c0 con 0x7ff4fc15bd90 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.272+0000 7ff4faffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff4fc13e2d0 0x7ff4fc0b4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50558/0 (socket says 172.21.15.8:50558) 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.272+0000 7ff4faffd640 1 -- 172.21.15.8:0/2365817133 learned_addr learned my addr 172.21.15.8:0/2365817133 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4fa7fc640 1 --2- 172.21.15.8:0/2365817133 >> v2:172.21.15.8:3300/0 conn(0x7ff4fc0b4810 0x7ff4fc15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4f9ffb640 1 -- 172.21.15.8:0/2365817133 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909274948 0 0) 0x7ff4fc06de80 con 0x7ff4fc13e2d0 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4f9ffb640 1 -- 172.21.15.8:0/2365817133 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e8003520 con 0x7ff4fc13e2d0 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4fb7fe640 1 --2- 172.21.15.8:0/2365817133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc15bd90 0x7ff4fc0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4fa7fc640 1 -- 172.21.15.8:0/2365817133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc15bd90 msgr2=0x7ff4fc0cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4fa7fc640 1 --2- 172.21.15.8:0/2365817133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc15bd90 0x7ff4fc0cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4fa7fc640 1 -- 172.21.15.8:0/2365817133 >> v1:172.21.15.8:6789/0 conn(0x7ff4fc13e2d0 legacy=0x7ff4fc0b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4fa7fc640 1 -- 172.21.15.8:0/2365817133 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc06d830 con 0x7ff4fc0b4810 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.273+0000 7ff4fb7fe640 1 --2- 172.21.15.8:0/2365817133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc15bd90 0x7ff4fc0cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff4fa7fc640 1 --2- 172.21.15.8:0/2365817133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc0b4810 0x7ff4fc15b850 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40097a0 tx=0x7ff4e402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e791e9889e6a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff4f9ffb640 1 -- 172.21.15.8:0/2365817133 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e402d040 con 0x7ff4fc0b4810 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff4f9ffb640 1 -- 172.21.15.8:0/2365817133 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4031810 con 0x7ff4fc0b4810 2023-11-18T23:42:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff4f9ffb640 1 -- 172.21.15.8:0/2365817133 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4031b80 con 0x7ff4fc0b4810 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 -- 172.21.15.8:0/2365817133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc0b4810 msgr2=0x7ff4fc15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 --2- 172.21.15.8:0/2365817133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc0b4810 0x7ff4fc15b850 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40097a0 tx=0x7ff4e402b8b0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 -- 172.21.15.8:0/2365817133 shutdown_connections 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 --2- 172.21.15.8:0/2365817133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc15bd90 0x7ff4fc0cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 --2- 172.21.15.8:0/2365817133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc0b4810 0x7ff4fc15b850 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 -- 172.21.15.8:0/2365817133 >> 172.21.15.8:0/2365817133 conn(0x7ff4fc0b0af0 msgr2=0x7ff4fc0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 -- 172.21.15.8:0/2365817133 shutdown_connections 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.274+0000 7ff50170f640 1 -- 172.21.15.8:0/2365817133 wait complete. 2023-11-18T23:42:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 Processor -- start 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 -- start start 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc0b4810 0x7ff4fc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4fc13e2d0 0x7ff4fc151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc15bd90 0x7ff4fc131e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc151690 con 0x7ff4fc15bd90 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0b2510 con 0x7ff4fc13e2d0 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.276+0000 7ff50170f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0b27f0 con 0x7ff4fc0b4810 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc15bd90 0x7ff4fc131e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc15bd90 0x7ff4fc131e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33790/0 (socket says 172.21.15.8:33790) 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 -- 172.21.15.8:0/1649651447 learned_addr learned my addr 172.21.15.8:0/1649651447 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4faffd640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc0b4810 0x7ff4fc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fa7fc640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4fc13e2d0 0x7ff4fc151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 -- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc0b4810 msgr2=0x7ff4fc155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc0b4810 0x7ff4fc155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 -- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4fc13e2d0 msgr2=0x7ff4fc151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4fc13e2d0 0x7ff4fc151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 -- 172.21.15.8:0/1649651447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009400 con 0x7ff4fc15bd90 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4fb7fe640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc15bd90 0x7ff4fc131e70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00cef0 tx=0x7ff4ec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4f37fe640 1 -- 172.21.15.8:0/1649651447 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00d840 con 0x7ff4fc15bd90 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4f37fe640 1 -- 172.21.15.8:0/1649651447 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00d9c0 con 0x7ff4fc15bd90 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc06e490 con 0x7ff4fc15bd90 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff4f37fe640 1 -- 172.21.15.8:0/1649651447 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00dd70 con 0x7ff4fc15bd90 2023-11-18T23:42:10.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.277+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc0b2db0 con 0x7ff4fc15bd90 2023-11-18T23:42:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.278+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc067420 con 0x7ff4fc15bd90 2023-11-18T23:42:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.279+0000 7ff4f37fe640 1 -- 172.21.15.8:0/1649651447 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4ec01e3b0 con 0x7ff4fc15bd90 2023-11-18T23:42:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.279+0000 7ff4f37fe640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4dc06ae40 0x7ff4dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.279+0000 7ff4f37fe640 1 -- 172.21.15.8:0/1649651447 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec08a0d0 con 0x7ff4fc15bd90 2023-11-18T23:42:10.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.279+0000 7ff4faffd640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4dc06ae40 0x7ff4dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.280+0000 7ff4faffd640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4dc06ae40 0x7ff4dc06d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4005880 tx=0x7ff4f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.284+0000 7ff4f37fe640 1 -- 172.21.15.8:0/1649651447 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4ec055260 con 0x7ff4fc15bd90 2023-11-18T23:42:10.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.460+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4fc0b1750 con 0x7ff4fc15bd90 2023-11-18T23:42:10.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.461+0000 7ff4f37fe640 1 -- 172.21.15.8:0/1649651447 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16510 (secure 0 0 0) 0x7ff4ec01a090 con 0x7ff4fc15bd90 2023-11-18T23:42:10.463 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:10.463 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":32,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:42:09.482026+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:42:07.893239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T23:42:08.455984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4dc06ae40 msgr2=0x7ff4dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4dc06ae40 0x7ff4dc06d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4005880 tx=0x7ff4f4009040 comp rx=0 tx=0).stop 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc15bd90 msgr2=0x7ff4fc131e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc15bd90 0x7ff4fc131e70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00cef0 tx=0x7ff4ec00a710 comp rx=0 tx=0).stop 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 shutdown_connections 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7ff4dc06ae40 0x7ff4dc06d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4fc15bd90 0x7ff4fc131e70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4fc13e2d0 0x7ff4fc151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 --2- 172.21.15.8:0/1649651447 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4fc0b4810 0x7ff4fc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 >> 172.21.15.8:0/1649651447 conn(0x7ff4fc0b0af0 msgr2=0x7ff4fc0cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 shutdown_connections 2023-11-18T23:42:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.463+0000 7ff50170f640 1 -- 172.21.15.8:0/1649651447 wait complete. 2023-11-18T23:42:10.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:42:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.581+0000 7f918f3fb640 1 Processor -- start 2023-11-18T23:42:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.581+0000 7f918f3fb640 1 -- start start 2023-11-18T23:42:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918f3fb640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f91880b2690 0x7f918815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918f3fb640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918806e9e0 con 0x7f918806cc50 2023-11-18T23:42:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918f3fb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918806de60 con 0x7f918806a8b0 2023-11-18T23:42:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918f3fb640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918806d0d0 con 0x7f91880b2690 2023-11-18T23:42:10.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918d197640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f91880b2690 0x7f918815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918c996640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f918806cc50 0x7f91880b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50562/0 (socket says 172.21.15.8:50562) 2023-11-18T23:42:10.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918c996640 1 -- 172.21.15.8:0/1703110780 learned_addr learned my addr 172.21.15.8:0/1703110780 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:10.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918d197640 1 -- 172.21.15.8:0/1703110780 >> v1:172.21.15.116:6789/0 conn(0x7f918806a8b0 legacy=0x7f918806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:10.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918d197640 1 -- 172.21.15.8:0/1703110780 >> v1:172.21.15.8:6789/0 conn(0x7f918806cc50 legacy=0x7f91880b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f917ffff640 1 -- 172.21.15.8:0/1703110780 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685900632 0 0) 0x7f918806e9e0 con 0x7f918806cc50 2023-11-18T23:42:10.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.582+0000 7f918d197640 1 -- 172.21.15.8:0/1703110780 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918806d2e0 con 0x7f91880b2690 2023-11-18T23:42:10.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.583+0000 7f918d197640 1 --2- 172.21.15.8:0/1703110780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91880b2690 0x7f918815d800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f91840097a0 tx=0x7f918402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63247bdc5427389 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.583+0000 7f917ffff640 1 -- 172.21.15.8:0/1703110780 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918402e070 con 0x7f91880b2690 2023-11-18T23:42:10.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.583+0000 7f917ffff640 1 -- 172.21.15.8:0/1703110780 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91840315a0 con 0x7f91880b2690 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.583+0000 7f917ffff640 1 -- 172.21.15.8:0/1703110780 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184031930 con 0x7f91880b2690 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.584+0000 7f918f3fb640 1 -- 172.21.15.8:0/1703110780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91880b2690 msgr2=0x7f918815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.584+0000 7f918f3fb640 1 --2- 172.21.15.8:0/1703110780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91880b2690 0x7f918815d800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f91840097a0 tx=0x7f918402b840 comp rx=0 tx=0).stop 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.584+0000 7f918f3fb640 1 -- 172.21.15.8:0/1703110780 shutdown_connections 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.584+0000 7f918f3fb640 1 --2- 172.21.15.8:0/1703110780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91880b2690 0x7f918815d800 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.584+0000 7f918f3fb640 1 -- 172.21.15.8:0/1703110780 >> 172.21.15.8:0/1703110780 conn(0x7f91880cf6a0 msgr2=0x7f91880cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.584+0000 7f918f3fb640 1 -- 172.21.15.8:0/1703110780 shutdown_connections 2023-11-18T23:42:10.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.584+0000 7f918f3fb640 1 -- 172.21.15.8:0/1703110780 wait complete. 2023-11-18T23:42:10.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.585+0000 7f918f3fb640 1 Processor -- start 2023-11-18T23:42:10.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.585+0000 7f918f3fb640 1 -- start start 2023-11-18T23:42:10.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918f3fb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f918806a8b0 0x7f91880cee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918f3fb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f918806cc50 0x7f91880cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918f3fb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91880b2690 0x7f9188156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918f3fb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91880cc3c0 con 0x7f918806cc50 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918f3fb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91880cd970 con 0x7f918806a8b0 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918f3fb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9188151dc0 con 0x7f91880b2690 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f918806cc50 0x7f91880cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f918806cc50 0x7f91880cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33808/0 (socket says 172.21.15.8:33808) 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 -- 172.21.15.8:0/2982679525 learned_addr learned my addr 172.21.15.8:0/2982679525 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918d197640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f918806a8b0 0x7f91880cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918d998640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91880b2690 0x7f9188156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 -- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91880b2690 msgr2=0x7f9188156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91880b2690 0x7f9188156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 -- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f918806a8b0 msgr2=0x7f91880cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f918806a8b0 0x7f91880cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 -- 172.21.15.8:0/2982679525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184009400 con 0x7f918806cc50 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918d197640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f918806a8b0 0x7f91880cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918d998640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91880b2690 0x7f9188156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f918c996640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f918806cc50 0x7f91880cbe80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f917800c4d0 tx=0x7f917800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f917dffb640 1 -- 172.21.15.8:0/2982679525 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780074e0 con 0x7f918806cc50 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.586+0000 7f917dffb640 1 -- 172.21.15.8:0/2982679525 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178007660 con 0x7f918806cc50 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.587+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91881520a0 con 0x7f918806cc50 2023-11-18T23:42:10.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.587+0000 7f917dffb640 1 -- 172.21.15.8:0/2982679525 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178004a20 con 0x7f918806cc50 2023-11-18T23:42:10.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.587+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9188152660 con 0x7f918806cc50 2023-11-18T23:42:10.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.588+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9188067420 con 0x7f918806cc50 2023-11-18T23:42:10.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.588+0000 7f917dffb640 1 -- 172.21.15.8:0/2982679525 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9178004b80 con 0x7f918806cc50 2023-11-18T23:42:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.589+0000 7f917dffb640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f916c06ae40 0x7f916c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.589+0000 7f917dffb640 1 -- 172.21.15.8:0/2982679525 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91780888c0 con 0x7f918806cc50 2023-11-18T23:42:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.589+0000 7f918d197640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f916c06ae40 0x7f916c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.589+0000 7f918d197640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f916c06ae40 0x7f916c06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9184036000 tx=0x7f9184008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.593+0000 7f917dffb640 1 -- 172.21.15.8:0/2982679525 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9178053850 con 0x7f918806cc50 2023-11-18T23:42:10.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.770+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9188073580 con 0x7f918806cc50 2023-11-18T23:42:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.771+0000 7f917dffb640 1 -- 172.21.15.8:0/2982679525 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16510 (secure 0 0 0) 0x7f9178088020 con 0x7f918806cc50 2023-11-18T23:42:10.772 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:10.772 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":32,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:42:09.482026+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:42:07.893239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T23:42:08.455984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:42:10.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f916c06ae40 msgr2=0x7f916c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f916c06ae40 0x7f916c06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9184036000 tx=0x7f9184008030 comp rx=0 tx=0).stop 2023-11-18T23:42:10.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f918806cc50 msgr2=0x7f91880cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f918806cc50 0x7f91880cbe80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f917800c4d0 tx=0x7f917800c990 comp rx=0 tx=0).stop 2023-11-18T23:42:10.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 shutdown_connections 2023-11-18T23:42:10.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f916c06ae40 0x7f916c06d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91880b2690 0x7f9188156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f918806cc50 0x7f91880cbe80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 --2- 172.21.15.8:0/2982679525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f918806a8b0 0x7f91880cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 >> 172.21.15.8:0/2982679525 conn(0x7f91880cf6a0 msgr2=0x7f91880b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:10.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 shutdown_connections 2023-11-18T23:42:10.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.773+0000 7f918f3fb640 1 -- 172.21.15.8:0/2982679525 wait complete. 2023-11-18T23:42:10.785 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T23:42:10.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.893+0000 7fab34c21640 1 Processor -- start 2023-11-18T23:42:10.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.893+0000 7fab34c21640 1 -- start start 2023-11-18T23:42:10.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab34c21640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 0x7fab3015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab34c21640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3009a720 con 0x7fab3015d690 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab34c21640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab30099b10 con 0x7fab3006e460 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab34c21640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3015e9d0 con 0x7fab3006ec60 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab27fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fab3015d690 0x7fab3006f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50578/0 (socket says 172.21.15.8:50578) 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab27fff640 1 -- 172.21.15.8:0/1897611358 learned_addr learned my addr 172.21.15.8:0/1897611358 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2e59c640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 0x7fab3015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177487357 0 0) 0x7fab3009a720 con 0x7fab3015d690 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab1c003520 con 0x7fab3015d690 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628064952 0 0) 0x7fab30099b10 con 0x7fab3006e460 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab3009a720 con 0x7fab3006e460 2023-11-18T23:42:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4168613343 0 0) 0x7fab1c003520 con 0x7fab3015d690 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 msgr2=0x7fab3015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 0x7fab3015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 >> v1:172.21.15.116:6789/0 conn(0x7fab3006e460 legacy=0x7fab300cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30099df0 con 0x7fab3015d690 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7fab18001670 con 0x7fab3015d690 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.894+0000 7fab2e59c640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 0x7fab3015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 >> v1:172.21.15.8:6789/0 conn(0x7fab3015d690 legacy=0x7fab3006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2dd9b640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab1c003b30 0x7fab1c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2dd9b640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 0x7fab1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2dd9b640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3015e9d0 con 0x7fab1c004d00 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00ba60 con 0x7fab1c003b30 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00bc20 con 0x7fab3006ec60 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2e59c640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab1c003b30 0x7fab1c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2ed9d640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab27fff640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 0x7fab1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2ed9d640 1 -- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 msgr2=0x7fab1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2ed9d640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab3006ec60 0x7fab1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2ed9d640 1 -- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab1c003b30 msgr2=0x7fab1c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2ed9d640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab1c003b30 0x7fab1c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.895+0000 7fab2ed9d640 1 -- 172.21.15.8:0/1897611358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20009400 con 0x7fab1c004d00 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab2ed9d640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fab28001fd0 tx=0x7fab1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4846bc5896d50bd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab28003b70 con 0x7fab1c004d00 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28003cd0 con 0x7fab1c004d00 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab2dd9b640 1 -- 172.21.15.8:0/1897611358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280052f0 con 0x7fab1c004d00 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab34c21640 1 -- 172.21.15.8:0/1897611358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 msgr2=0x7fab1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab34c21640 1 --2- 172.21.15.8:0/1897611358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fab28001fd0 tx=0x7fab1c0057f0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab2ed9d640 1 -- 172.21.15.8:0/1897611358 reap_dead start 2023-11-18T23:42:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab34c21640 1 -- 172.21.15.8:0/1897611358 shutdown_connections 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.896+0000 7fab34c21640 1 -- 172.21.15.8:0/1897611358 >> 172.21.15.8:0/1897611358 conn(0x7fab300b2a20 msgr2=0x7fab300b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.897+0000 7fab34c21640 1 -- 172.21.15.8:0/1897611358 shutdown_connections 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.897+0000 7fab34c21640 1 -- 172.21.15.8:0/1897611358 wait complete. 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.898+0000 7fab34c21640 1 Processor -- start 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.898+0000 7fab34c21640 1 -- start start 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab30153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab30159820 0x7fab30154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab30154850 0x7fab3015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301f8050 con 0x7fab1c004d00 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab30154d00 con 0x7fab30159820 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab30153aa0 con 0x7fab30154850 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab30153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab30153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33828/0 (socket says 172.21.15.8:33828) 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 -- 172.21.15.8:0/586922945 learned_addr learned my addr 172.21.15.8:0/586922945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab27fff640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab30159820 0x7fab30154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2ed9d640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab30154850 0x7fab3015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 -- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab30154850 msgr2=0x7fab3015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab30154850 0x7fab3015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 -- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab30159820 msgr2=0x7fab30154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab30159820 0x7fab30154310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 -- 172.21.15.8:0/586922945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab301f73d0 con 0x7fab1c004d00 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab2e59c640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab30153560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab20011d00 tx=0x7fab2000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab26ffd640 1 -- 172.21.15.8:0/586922945 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000fd20 con 0x7fab1c004d00 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab26ffd640 1 -- 172.21.15.8:0/586922945 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000fe80 con 0x7fab1c004d00 2023-11-18T23:42:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab301f76b0 con 0x7fab1c004d00 2023-11-18T23:42:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab26ffd640 1 -- 172.21.15.8:0/586922945 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20004240 con 0x7fab1c004d00 2023-11-18T23:42:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.899+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab301f7c70 con 0x7fab1c004d00 2023-11-18T23:42:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.900+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3009f040 con 0x7fab1c004d00 2023-11-18T23:42:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.901+0000 7fab26ffd640 1 -- 172.21.15.8:0/586922945 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab200043a0 con 0x7fab1c004d00 2023-11-18T23:42:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.901+0000 7fab26ffd640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab1006ae40 0x7fab1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.901+0000 7fab26ffd640 1 -- 172.21.15.8:0/586922945 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab20089cc0 con 0x7fab1c004d00 2023-11-18T23:42:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.902+0000 7fab27fff640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab1006ae40 0x7fab1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.902+0000 7fab27fff640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab1006ae40 0x7fab1006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fab30158a80 tx=0x7fab18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:10.906+0000 7fab26ffd640 1 -- 172.21.15.8:0/586922945 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab20054e00 con 0x7fab1c004d00 2023-11-18T23:42:11.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.119+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fab3006f530 con 0x7fab1c004d00 2023-11-18T23:42:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.142+0000 7fab26ffd640 1 -- 172.21.15.8:0/586922945 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fab20022070 con 0x7fab1c004d00 2023-11-18T23:42:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.144+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab1006ae40 msgr2=0x7fab1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.144+0000 7fab34c21640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab1006ae40 0x7fab1006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fab30158a80 tx=0x7fab18009040 comp rx=0 tx=0).stop 2023-11-18T23:42:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.144+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 msgr2=0x7fab30153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.144+0000 7fab34c21640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab30153560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab20011d00 tx=0x7fab2000f610 comp rx=0 tx=0).stop 2023-11-18T23:42:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 shutdown_connections 2023-11-18T23:42:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fab1006ae40 0x7fab1006d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab30154850 0x7fab3015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab30159820 0x7fab30154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 --2- 172.21.15.8:0/586922945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab30153560 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 >> 172.21.15.8:0/586922945 conn(0x7fab300b2a20 msgr2=0x7fab30155300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 shutdown_connections 2023-11-18T23:42:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.145+0000 7fab34c21640 1 -- 172.21.15.8:0/586922945 wait complete. 2023-11-18T23:42:11.157 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-18T23:42:11.157 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T23:42:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.265+0000 7f08aee4b640 1 Processor -- start 2023-11-18T23:42:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.265+0000 7f08aee4b640 1 -- start start 2023-11-18T23:42:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08aee4b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08a8160b70 0x7f08a80d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08aee4b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f08a80cef00 0x7f08a8161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08aee4b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a80ce360 con 0x7f08a80b2aa0 2023-11-18T23:42:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08aee4b640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a80b2f20 con 0x7f08a8160b70 2023-11-18T23:42:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08aee4b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a80cdd50 con 0x7f08a80cef00 2023-11-18T23:42:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08acbe7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08a8160b70 0x7f08a80d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08acbe7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08a8160b70 0x7f08a80d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33830/0 (socket says 172.21.15.8:33830) 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08acbe7640 1 -- 172.21.15.8:0/3528538796 learned_addr learned my addr 172.21.15.8:0/3528538796 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08ad3e8640 1 --2- 172.21.15.8:0/3528538796 >> v2:172.21.15.116:3300/0 conn(0x7f08a80cef00 0x7f08a8161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08acbe7640 1 -- 172.21.15.8:0/3528538796 >> v2:172.21.15.116:3300/0 conn(0x7f08a80cef00 msgr2=0x7f08a8161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08acbe7640 1 --2- 172.21.15.8:0/3528538796 >> v2:172.21.15.116:3300/0 conn(0x7f08a80cef00 0x7f08a8161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08acbe7640 1 -- 172.21.15.8:0/3528538796 >> v1:172.21.15.116:6789/0 conn(0x7f08a80b2aa0 legacy=0x7f08a80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08acbe7640 1 -- 172.21.15.8:0/3528538796 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80d1c70 con 0x7f08a8160b70 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.266+0000 7f08ad3e8640 1 --2- 172.21.15.8:0/3528538796 >> v2:172.21.15.116:3300/0 conn(0x7f08a80cef00 0x7f08a8161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.267+0000 7f08acbe7640 1 --2- 172.21.15.8:0/3528538796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a80d1570 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f08a8072b40 tx=0x7f089c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417fb2574730f31 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.267+0000 7f08a77fe640 1 -- 172.21.15.8:0/3528538796 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c031870 con 0x7f08a8160b70 2023-11-18T23:42:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.267+0000 7f08a77fe640 1 -- 172.21.15.8:0/3528538796 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c0319d0 con 0x7f08a8160b70 2023-11-18T23:42:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.267+0000 7f08a77fe640 1 -- 172.21.15.8:0/3528538796 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c031d60 con 0x7f08a8160b70 2023-11-18T23:42:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.267+0000 7f08aee4b640 1 -- 172.21.15.8:0/3528538796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 msgr2=0x7f08a80d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.267+0000 7f08aee4b640 1 --2- 172.21.15.8:0/3528538796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a80d1570 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f08a8072b40 tx=0x7f089c02b910 comp rx=0 tx=0).stop 2023-11-18T23:42:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.268+0000 7f08aee4b640 1 -- 172.21.15.8:0/3528538796 shutdown_connections 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.268+0000 7f08aee4b640 1 --2- 172.21.15.8:0/3528538796 >> v2:172.21.15.116:3300/0 conn(0x7f08a80cef00 0x7f08a8161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.268+0000 7f08aee4b640 1 --2- 172.21.15.8:0/3528538796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a80d1570 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.268+0000 7f08aee4b640 1 -- 172.21.15.8:0/3528538796 >> 172.21.15.8:0/3528538796 conn(0x7f08a809c470 msgr2=0x7f08a80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.268+0000 7f08aee4b640 1 -- 172.21.15.8:0/3528538796 shutdown_connections 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.268+0000 7f08aee4b640 1 -- 172.21.15.8:0/3528538796 wait complete. 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.269+0000 7f08aee4b640 1 Processor -- start 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.269+0000 7f08aee4b640 1 -- start start 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08aee4b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08a80b2aa0 0x7f08a8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08aee4b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08a80cef00 0x7f08a8151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08aee4b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08aee4b640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a815cb00 con 0x7f08a8160b70 2023-11-18T23:42:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08aee4b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a815b6d0 con 0x7f08a80b2aa0 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08aee4b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a815bef0 con 0x7f08a80cef00 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a806c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33842/0 (socket says 172.21.15.8:33842) 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 -- 172.21.15.8:0/1732661401 learned_addr learned my addr 172.21.15.8:0/1732661401 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08acbe7640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08a80b2aa0 0x7f08a8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08a7fff640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08a80cef00 0x7f08a8151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 -- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08a80cef00 msgr2=0x7f08a8151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08a80cef00 0x7f08a8151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 -- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08a80b2aa0 msgr2=0x7f08a8158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08a80b2aa0 0x7f08a8158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 -- 172.21.15.8:0/1732661401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0094d0 con 0x7f08a8160b70 2023-11-18T23:42:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08ad3e8640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a806c490 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f08a000cd50 tx=0x7f08a000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08a57fa640 1 -- 172.21.15.8:0/1732661401 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000f680 con 0x7f08a8160b70 2023-11-18T23:42:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.270+0000 7f08a57fa640 1 -- 172.21.15.8:0/1732661401 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a000f800 con 0x7f08a8160b70 2023-11-18T23:42:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.271+0000 7f08a57fa640 1 -- 172.21.15.8:0/1732661401 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000fbb0 con 0x7f08a8160b70 2023-11-18T23:42:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.271+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a815c1d0 con 0x7f08a8160b70 2023-11-18T23:42:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.271+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a815c790 con 0x7f08a8160b70 2023-11-18T23:42:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.272+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a815ccb0 con 0x7f08a8160b70 2023-11-18T23:42:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.272+0000 7f08a57fa640 1 -- 172.21.15.8:0/1732661401 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08a000b040 con 0x7f08a8160b70 2023-11-18T23:42:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.272+0000 7f08a57fa640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f088c06ae70 0x7f088c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.273+0000 7f08a57fa640 1 -- 172.21.15.8:0/1732661401 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08a0089ed0 con 0x7f08a8160b70 2023-11-18T23:42:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.273+0000 7f08acbe7640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f088c06ae70 0x7f088c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.273+0000 7f08acbe7640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f088c06ae70 0x7f088c06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f089c036000 tx=0x7f089c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.277+0000 7f08a57fa640 1 -- 172.21.15.8:0/1732661401 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08a815ccb0 con 0x7f08a8160b70 2023-11-18T23:42:11.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:11.493+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f08a80a1150 con 0x7f08a8160b70 2023-11-18T23:42:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.147+0000 7f08a57fa640 1 -- 172.21.15.8:0/1732661401 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f08a001d020 con 0x7f08a8160b70 2023-11-18T23:42:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f088c06ae70 msgr2=0x7f088c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f088c06ae70 0x7f088c06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f089c036000 tx=0x7f089c03c040 comp rx=0 tx=0).stop 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 msgr2=0x7f08a806c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a806c490 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f08a000cd50 tx=0x7f08a000a650 comp rx=0 tx=0).stop 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 shutdown_connections 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f088c06ae70 0x7f088c06d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08a8160b70 0x7f08a806c490 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08a80cef00 0x7f08a8151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 --2- 172.21.15.8:0/1732661401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08a80b2aa0 0x7f08a8158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 >> 172.21.15.8:0/1732661401 conn(0x7f08a809c470 msgr2=0x7f08a80b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 shutdown_connections 2023-11-18T23:42:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.150+0000 7f08aee4b640 1 -- 172.21.15.8:0/1732661401 wait complete. 2023-11-18T23:42:12.165 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T23:42:12.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:42:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.276+0000 7f2cae6c2640 1 Processor -- start 2023-11-18T23:42:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.276+0000 7f2cae6c2640 1 -- start start 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2cae6c2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca815d460 0x7f2ca80d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2cae6c2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ca80d37f0 0x7f2ca80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2cae6c2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca80cf260 con 0x7f2ca80d2010 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2cae6c2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca80ceca0 con 0x7f2ca80d37f0 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2cae6c2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80cef80 con 0x7f2ca815d460 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2cacc5f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ca80d37f0 0x7f2ca80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2ca77fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2ca80d2010 0x7f2ca80d30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50582/0 (socket says 172.21.15.8:50582) 2023-11-18T23:42:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.277+0000 7f2ca77fe640 1 -- 172.21.15.8:0/2627258837 learned_addr learned my addr 172.21.15.8:0/2627258837 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2ca7fff640 1 --2- 172.21.15.8:0/2627258837 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca815d460 0x7f2ca80d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2cacc5f640 1 -- 172.21.15.8:0/2627258837 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca815d460 msgr2=0x7f2ca80d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2cacc5f640 1 --2- 172.21.15.8:0/2627258837 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca815d460 0x7f2ca80d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2cacc5f640 1 -- 172.21.15.8:0/2627258837 >> v1:172.21.15.8:6789/0 conn(0x7f2ca80d2010 legacy=0x7f2ca80d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2ca6ffd640 1 -- 172.21.15.8:0/2627258837 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247570264 0 0) 0x7f2ca80cf260 con 0x7f2ca80d2010 2023-11-18T23:42:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2cacc5f640 1 -- 172.21.15.8:0/2627258837 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80b31b0 con 0x7f2ca80d37f0 2023-11-18T23:42:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2ca7fff640 1 --2- 172.21.15.8:0/2627258837 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca815d460 0x7f2ca80d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.278+0000 7f2cacc5f640 1 --2- 172.21.15.8:0/2627258837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca80d37f0 0x7f2ca80b39b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b167038bfe9a6da1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2ca6ffd640 1 -- 172.21.15.8:0/2627258837 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca002cbc0 con 0x7f2ca80d37f0 2023-11-18T23:42:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2ca6ffd640 1 -- 172.21.15.8:0/2627258837 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca002cd20 con 0x7f2ca80d37f0 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2ca6ffd640 1 -- 172.21.15.8:0/2627258837 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0034660 con 0x7f2ca80d37f0 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 -- 172.21.15.8:0/2627258837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca80d37f0 msgr2=0x7f2ca80b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/2627258837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca80d37f0 0x7f2ca80b39b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca002be10 comp rx=0 tx=0).stop 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 -- 172.21.15.8:0/2627258837 shutdown_connections 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/2627258837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca80d37f0 0x7f2ca80b39b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/2627258837 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca815d460 0x7f2ca80d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 -- 172.21.15.8:0/2627258837 >> 172.21.15.8:0/2627258837 conn(0x7f2ca808cb60 msgr2=0x7f2ca809c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 -- 172.21.15.8:0/2627258837 shutdown_connections 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.279+0000 7f2cae6c2640 1 -- 172.21.15.8:0/2627258837 wait complete. 2023-11-18T23:42:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.280+0000 7f2cae6c2640 1 Processor -- start 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cae6c2640 1 -- start start 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cae6c2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca80d2010 0x7f2ca8152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cae6c2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ca80d37f0 0x7f2ca80b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cae6c2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca815d460 0x7f2ca80b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cae6c2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8152b90 con 0x7f2ca815d460 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cae6c2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80cb150 con 0x7f2ca80d37f0 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cae6c2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80b5ec0 con 0x7f2ca80d2010 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cacc5f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca815d460 0x7f2ca80b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cacc5f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca815d460 0x7f2ca80b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33858/0 (socket says 172.21.15.8:33858) 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.281+0000 7f2cacc5f640 1 -- 172.21.15.8:0/3767367752 learned_addr learned my addr 172.21.15.8:0/3767367752 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2ca7fff640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca80d2010 0x7f2ca8152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2ca77fe640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ca80d37f0 0x7f2ca80b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cacc5f640 1 -- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca80d2010 msgr2=0x7f2ca8152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cacc5f640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca80d2010 0x7f2ca8152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cacc5f640 1 -- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ca80d37f0 msgr2=0x7f2ca80b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cacc5f640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ca80d37f0 0x7f2ca80b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cacc5f640 1 -- 172.21.15.8:0/3767367752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009a70 con 0x7f2ca815d460 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cacc5f640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca815d460 0x7f2ca80b8530 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2ca4ff9640 1 -- 172.21.15.8:0/3767367752 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0040650 con 0x7f2ca815d460 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2ca4ff9640 1 -- 172.21.15.8:0/3767367752 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca002ce90 con 0x7f2ca815d460 2023-11-18T23:42:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2ca4ff9640 1 -- 172.21.15.8:0/3767367752 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0040a10 con 0x7f2ca815d460 2023-11-18T23:42:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca80b61a0 con 0x7f2ca815d460 2023-11-18T23:42:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.282+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca81f29e0 con 0x7f2ca815d460 2023-11-18T23:42:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.283+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca80b66c0 con 0x7f2ca815d460 2023-11-18T23:42:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.284+0000 7f2ca4ff9640 1 -- 172.21.15.8:0/3767367752 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ca0040b70 con 0x7f2ca815d460 2023-11-18T23:42:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.284+0000 7f2ca4ff9640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2c8806ae40 0x7f2c8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.284+0000 7f2ca4ff9640 1 -- 172.21.15.8:0/3767367752 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ca00ac3e0 con 0x7f2ca815d460 2023-11-18T23:42:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.284+0000 7f2ca7fff640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2c8806ae40 0x7f2c8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.285+0000 7f2ca7fff640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2c8806ae40 0x7f2c8806d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80b4640 tx=0x7f2c90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.289+0000 7f2ca4ff9640 1 -- 172.21.15.8:0/3767367752 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ca80b66c0 con 0x7f2ca815d460 2023-11-18T23:42:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.503+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ca80b66c0 con 0x7f2ca815d460 2023-11-18T23:42:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.504+0000 7f2ca4ff9640 1 -- 172.21.15.8:0/3767367752 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f2ca80b66c0 con 0x7f2ca815d460 2023-11-18T23:42:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:12.505 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2766026998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":2766026998},{"type":"v1","addr":"172.21.15.116:6837","nonce":2766026998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2655733368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2655733368},{"type":"v1","addr":"172.21.15.116:6836","nonce":2655733368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5050,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/3557217311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3557217311},{"type":"v1","addr":"172.21.15.8:6834","nonce":3557217311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:42:09.482337+0000","modified":"2023-11-18T23:42:11.495128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5053":{"gid":5053,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6835/3317836505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":3317836505},{"type":"v1","addr":"172.21.15.8:6835","nonce":3317836505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-18T23:42:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2023-11-18T23:42:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2c8806ae40 msgr2=0x7f2c8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2c8806ae40 0x7f2c8806d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80b4640 tx=0x7f2c90008040 comp rx=0 tx=0).stop 2023-11-18T23:42:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca815d460 msgr2=0x7f2ca80b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca815d460 0x7f2ca80b8530 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca0004a40 comp rx=0 tx=0).stop 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 shutdown_connections 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2c8806ae40 0x7f2c8806d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ca815d460 0x7f2ca80b8530 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ca80d37f0 0x7f2ca80b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 --2- 172.21.15.8:0/3767367752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ca80d2010 0x7f2ca8152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 >> 172.21.15.8:0/3767367752 conn(0x7f2ca808cb60 msgr2=0x7f2ca815fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 shutdown_connections 2023-11-18T23:42:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.506+0000 7f2cae6c2640 1 -- 172.21.15.8:0/3767367752 wait complete. 2023-11-18T23:42:12.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T23:42:12.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.623+0000 7fdbdb61c640 1 Processor -- start 2023-11-18T23:42:12.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.623+0000 7fdbdb61c640 1 -- start start 2023-11-18T23:42:12.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.623+0000 7fdbdb61c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdbd4142d20 0x7fdbd4071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbdb61c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbd40b1df0 0x7fdbd406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbdb61c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd406da60 0x7fdbd40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbdb61c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd406def0 con 0x7fdbd40b1df0 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbdb61c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40b3130 con 0x7fdbd4142d20 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbdb61c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4143100 con 0x7fdbd406da60 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbd40b1df0 0x7fdbd406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdbd40b1df0 0x7fdbd406d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33860/0 (socket says 172.21.15.8:33860) 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/1981121224 learned_addr learned my addr 172.21.15.8:0/1981121224 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/1981121224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd406da60 msgr2=0x7fdbd40b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd93b8640 1 --2- 172.21.15.8:0/1981121224 >> v2:172.21.15.116:3300/0 conn(0x7fdbd4142d20 0x7fdbd4071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd9bb9640 1 --2- 172.21.15.8:0/1981121224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd406da60 0x7fdbd40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 --2- 172.21.15.8:0/1981121224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd406da60 0x7fdbd40b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/1981121224 >> v2:172.21.15.116:3300/0 conn(0x7fdbd4142d20 msgr2=0x7fdbd4071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 --2- 172.21.15.8:0/1981121224 >> v2:172.21.15.116:3300/0 conn(0x7fdbd4142d20 0x7fdbd4071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/1981121224 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40b2250 con 0x7fdbd40b1df0 2023-11-18T23:42:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd93b8640 1 --2- 172.21.15.8:0/1981121224 >> v2:172.21.15.116:3300/0 conn(0x7fdbd4142d20 0x7fdbd4071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.624+0000 7fdbd9bb9640 1 --2- 172.21.15.8:0/1981121224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd406da60 0x7fdbd40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.625+0000 7fdbd8bb7640 1 --2- 172.21.15.8:0/1981121224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd406d520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdbd406ba70 tx=0x7fdbc402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1275cdd01e5f42b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.625+0000 7fdbcbfff640 1 -- 172.21.15.8:0/1981121224 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4031870 con 0x7fdbd40b1df0 2023-11-18T23:42:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.625+0000 7fdbcbfff640 1 -- 172.21.15.8:0/1981121224 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc40319d0 con 0x7fdbd40b1df0 2023-11-18T23:42:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.625+0000 7fdbcbfff640 1 -- 172.21.15.8:0/1981121224 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4031d60 con 0x7fdbd40b1df0 2023-11-18T23:42:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.625+0000 7fdbdb61c640 1 -- 172.21.15.8:0/1981121224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 msgr2=0x7fdbd406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.625+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/1981121224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd406d520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdbd406ba70 tx=0x7fdbc402b910 comp rx=0 tx=0).stop 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.626+0000 7fdbdb61c640 1 -- 172.21.15.8:0/1981121224 shutdown_connections 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.626+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/1981121224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd406da60 0x7fdbd40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.626+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/1981121224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd406d520 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.626+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/1981121224 >> v2:172.21.15.116:3300/0 conn(0x7fdbd4142d20 0x7fdbd4071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.626+0000 7fdbdb61c640 1 -- 172.21.15.8:0/1981121224 >> 172.21.15.8:0/1981121224 conn(0x7fdbd40b0af0 msgr2=0x7fdbd40b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.626+0000 7fdbdb61c640 1 -- 172.21.15.8:0/1981121224 shutdown_connections 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.626+0000 7fdbdb61c640 1 -- 172.21.15.8:0/1981121224 wait complete. 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.627+0000 7fdbdb61c640 1 Processor -- start 2023-11-18T23:42:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.627+0000 7fdbdb61c640 1 -- start start 2023-11-18T23:42:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbdb61c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbd406da60 0x7fdbd41e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbdb61c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd413dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbdb61c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd4142d20 0x7fdbd414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbdb61c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd41e3b50 con 0x7fdbd40b1df0 2023-11-18T23:42:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbdb61c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40ce460 con 0x7fdbd406da60 2023-11-18T23:42:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbdb61c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd41e2ed0 con 0x7fdbd4142d20 2023-11-18T23:42:12.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd413dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd413dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33876/0 (socket says 172.21.15.8:33876) 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/2448050244 learned_addr learned my addr 172.21.15.8:0/2448050244 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd9bb9640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd4142d20 0x7fdbd414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd93b8640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbd406da60 0x7fdbd41e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd4142d20 msgr2=0x7fdbd414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd4142d20 0x7fdbd414a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbd406da60 msgr2=0x7fdbd41e27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbd406da60 0x7fdbd41e27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 -- 172.21.15.8:0/2448050244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40094d0 con 0x7fdbd40b1df0 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd9bb9640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd4142d20 0x7fdbd414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd93b8640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbd406da60 0x7fdbd41e27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbd8bb7640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd413dac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4000c00 tx=0x7fdbc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbc9ffb640 1 -- 172.21.15.8:0/2448050244 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc403ad10 con 0x7fdbd40b1df0 2023-11-18T23:42:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbc9ffb640 1 -- 172.21.15.8:0/2448050244 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc403ae70 con 0x7fdbd40b1df0 2023-11-18T23:42:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd41e31b0 con 0x7fdbd40b1df0 2023-11-18T23:42:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.628+0000 7fdbc9ffb640 1 -- 172.21.15.8:0/2448050244 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4044610 con 0x7fdbd40b1df0 2023-11-18T23:42:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.629+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd41e3770 con 0x7fdbd40b1df0 2023-11-18T23:42:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.629+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd41e3c90 con 0x7fdbd40b1df0 2023-11-18T23:42:12.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.630+0000 7fdbc9ffb640 1 -- 172.21.15.8:0/2448050244 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbc4044770 con 0x7fdbd40b1df0 2023-11-18T23:42:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.630+0000 7fdbc9ffb640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdbb806ae40 0x7fdbb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.630+0000 7fdbc9ffb640 1 -- 172.21.15.8:0/2448050244 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbc402d040 con 0x7fdbd40b1df0 2023-11-18T23:42:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.631+0000 7fdbd93b8640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdbb806ae40 0x7fdbb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.631+0000 7fdbd93b8640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdbb806ae40 0x7fdbb806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0006fd0 tx=0x7fdbd0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.635+0000 7fdbc9ffb640 1 -- 172.21.15.8:0/2448050244 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbd41e3c90 con 0x7fdbd40b1df0 2023-11-18T23:42:12.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:42:12.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:42:12.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.815+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbd41e3c90 con 0x7fdbd40b1df0 2023-11-18T23:42:12.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.816+0000 7fdbc9ffb640 1 -- 172.21.15.8:0/2448050244 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16497 (secure 0 0 0) 0x7fdbd41e3c90 con 0x7fdbd40b1df0 2023-11-18T23:42:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:12.818 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":33,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","created":"2023-11-18T23:40:47.108208+0000","modified":"2023-11-18T23:42:11.133687+0000","last_up_change":"2023-11-18T23:40:57.700119+0000","last_in_change":"2023-11-18T23:40:49.330213+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T23:40:59.299033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-18T23:42:07.893239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-18T23:42:08.455984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49ec5c0c-7fd1-4b41-bfd4-31b0cce07854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6801","nonce":555757690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6803","nonce":555757690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6807","nonce":555757690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":555757690},{"type":"v1","addr":"172.21.15.8:6805","nonce":555757690}]},"public_addr":"172.21.15.8:6801/555757690","cluster_addr":"172.21.15.8:6803/555757690","heartbeat_back_addr":"172.21.15.8:6807/555757690","heartbeat_front_addr":"172.21.15.8:6805/555757690","state":["exists","up"]},{"osd":1,"uuid":"35b1fa9a-38ce-478e-b4a5-39533be5bd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6812","nonce":1322099792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6816","nonce":1322099792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6823","nonce":1322099792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1322099792},{"type":"v1","addr":"172.21.15.8:6820","nonce":1322099792}]},"public_addr":"172.21.15.8:6812/1322099792","cluster_addr":"172.21.15.8:6816/1322099792","heartbeat_back_addr":"172.21.15.8:6823/1322099792","heartbeat_front_addr":"172.21.15.8:6820/1322099792","state":["exists","up"]},{"osd":2,"uuid":"7b9fd147-ee9b-4197-922c-fc998413d8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6809","nonce":3891742519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6813","nonce":3891742519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6819","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6821","nonce":3891742519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6815","nonce":3891742519},{"type":"v1","addr":"172.21.15.8:6817","nonce":3891742519}]},"public_addr":"172.21.15.8:6809/3891742519","cluster_addr":"172.21.15.8:6813/3891742519","heartbeat_back_addr":"172.21.15.8:6821/3891742519","heartbeat_front_addr":"172.21.15.8:6817/3891742519","state":["exists","up"]},{"osd":3,"uuid":"84ad6608-8092-4637-8354-ae4afe85e4a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6825","nonce":993268355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6827","nonce":993268355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6831","nonce":993268355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":993268355},{"type":"v1","addr":"172.21.15.8:6829","nonce":993268355}]},"public_addr":"172.21.15.8:6825/993268355","cluster_addr":"172.21.15.8:6827/993268355","heartbeat_back_addr":"172.21.15.8:6831/993268355","heartbeat_front_addr":"172.21.15.8:6829/993268355","state":["exists","up"]},{"osd":4,"uuid":"b8382491-446a-4a0b-b5ca-fc73c050e4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6801","nonce":2991510677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6803","nonce":2991510677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6807","nonce":2991510677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":2991510677},{"type":"v1","addr":"172.21.15.116:6805","nonce":2991510677}]},"public_addr":"172.21.15.116:6801/2991510677","cluster_addr":"172.21.15.116:6803/2991510677","heartbeat_back_addr":"172.21.15.116:6807/2991510677","heartbeat_front_addr":"172.21.15.116:6805/2991510677","state":["exists","up"]},{"osd":5,"uuid":"15683341-f0d7-4f5f-a5f8-3bf8ae54223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6825","nonce":1164600341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6827","nonce":1164600341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6831","nonce":1164600341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1164600341},{"type":"v1","addr":"172.21.15.116:6829","nonce":1164600341}]},"public_addr":"172.21.15.116:6825/1164600341","cluster_addr":"172.21.15.116:6827/1164600341","heartbeat_back_addr":"172.21.15.116:6831/1164600341","heartbeat_front_addr":"172.21.15.116:6829/1164600341","state":["exists","up"]},{"osd":6,"uuid":"8ca3ae25-3f08-4dcb-847a-783fcedfb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6809","nonce":2118747924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6813","nonce":2118747924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6821","nonce":2118747924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2118747924},{"type":"v1","addr":"172.21.15.116:6817","nonce":2118747924}]},"public_addr":"172.21.15.116:6809/2118747924","cluster_addr":"172.21.15.116:6813/2118747924","heartbeat_back_addr":"172.21.15.116:6821/2118747924","heartbeat_front_addr":"172.21.15.116:6817/2118747924","state":["exists","up"]},{"osd":7,"uuid":"83046faa-fd59-44b8-a0db-f82d66da14cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6812","nonce":422496807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6816","nonce":422496807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6823","nonce":422496807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":422496807},{"type":"v1","addr":"172.21.15.116:6819","nonce":422496807}]},"public_addr":"172.21.15.116:6812/422496807","cluster_addr":"172.21.15.116:6816/422496807","heartbeat_back_addr":"172.21.15.116:6823/422496807","heartbeat_front_addr":"172.21.15.116:6819/422496807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.385762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.473155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.454447+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.497779+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.445552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.493617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.416707+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T23:40:54.481456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdbb806ae40 msgr2=0x7fdbb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdbb806ae40 0x7fdbb806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0006fd0 tx=0x7fdbd0008040 comp rx=0 tx=0).stop 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 msgr2=0x7fdbd413dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd413dac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4000c00 tx=0x7fdbc40046c0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 shutdown_connections 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fdbb806ae40 0x7fdbb806d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdbd4142d20 0x7fdbd414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdbd40b1df0 0x7fdbd413dac0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 --2- 172.21.15.8:0/2448050244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbd406da60 0x7fdbd41e27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.818+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 >> 172.21.15.8:0/2448050244 conn(0x7fdbd40b0af0 msgr2=0x7fdbd4141ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:12.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.819+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 shutdown_connections 2023-11-18T23:42:12.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.819+0000 7fdbdb61c640 1 -- 172.21.15.8:0/2448050244 wait complete. 2023-11-18T23:42:12.830 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T23:42:12.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:42:12.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.935+0000 7f22456f2640 1 Processor -- start 2023-11-18T23:42:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.935+0000 7f22456f2640 1 -- start start 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.936+0000 7f22456f2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f224015d3e0 0x7f22400ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.936+0000 7f22456f2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22400ced30 0x7f22400d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.936+0000 7f22456f2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f22400d1c60 0x7f22400b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.936+0000 7f22456f2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22400cf170 con 0x7f22400ced30 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.936+0000 7f22456f2640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22400d20f0 con 0x7f22400d1c60 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.936+0000 7f22456f2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400b5f90 con 0x7f224015d3e0 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.936+0000 7f223e7fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22400ced30 0x7f22400d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223e7fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22400ced30 0x7f22400d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33890/0 (socket says 172.21.15.8:33890) 2023-11-18T23:42:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223e7fc640 1 -- 172.21.15.8:0/482112162 learned_addr learned my addr 172.21.15.8:0/482112162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223effd640 1 --2- 172.21.15.8:0/482112162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f224015d3e0 0x7f22400ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223f7fe640 1 --2- 172.21.15.8:0/482112162 >> v2:172.21.15.116:3300/0 conn(0x7f22400d1c60 0x7f22400b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223e7fc640 1 -- 172.21.15.8:0/482112162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f224015d3e0 msgr2=0x7f22400ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223e7fc640 1 --2- 172.21.15.8:0/482112162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f224015d3e0 0x7f22400ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223e7fc640 1 -- 172.21.15.8:0/482112162 >> v2:172.21.15.116:3300/0 conn(0x7f22400d1c60 msgr2=0x7f22400b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223e7fc640 1 --2- 172.21.15.8:0/482112162 >> v2:172.21.15.116:3300/0 conn(0x7f22400d1c60 0x7f22400b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.937+0000 7f223e7fc640 1 -- 172.21.15.8:0/482112162 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400b61e0 con 0x7f22400ced30 2023-11-18T23:42:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f223e7fc640 1 --2- 172.21.15.8:0/482112162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22400ced30 0x7f22400d1720 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f22400d2b90 tx=0x7f222802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e239552cbd656b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f223dffb640 1 -- 172.21.15.8:0/482112162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228031870 con 0x7f22400ced30 2023-11-18T23:42:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f223dffb640 1 -- 172.21.15.8:0/482112162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22280319d0 con 0x7f22400ced30 2023-11-18T23:42:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f223dffb640 1 -- 172.21.15.8:0/482112162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228031d60 con 0x7f22400ced30 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 -- 172.21.15.8:0/482112162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22400ced30 msgr2=0x7f22400d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 --2- 172.21.15.8:0/482112162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22400ced30 0x7f22400d1720 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f22400d2b90 tx=0x7f222802b910 comp rx=0 tx=0).stop 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 -- 172.21.15.8:0/482112162 shutdown_connections 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 --2- 172.21.15.8:0/482112162 >> v2:172.21.15.116:3300/0 conn(0x7f22400d1c60 0x7f22400b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 --2- 172.21.15.8:0/482112162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22400ced30 0x7f22400d1720 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 --2- 172.21.15.8:0/482112162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f224015d3e0 0x7f22400ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 -- 172.21.15.8:0/482112162 >> 172.21.15.8:0/482112162 conn(0x7f224009c480 msgr2=0x7f22400d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 -- 172.21.15.8:0/482112162 shutdown_connections 2023-11-18T23:42:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.938+0000 7f22456f2640 1 -- 172.21.15.8:0/482112162 wait complete. 2023-11-18T23:42:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 Processor -- start 2023-11-18T23:42:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 -- start start 2023-11-18T23:42:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22400ced30 0x7f2240144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22400d1c60 0x7f224015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f224015d3e0 0x7f2240157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2240157c80 con 0x7f224015d3e0 2023-11-18T23:42:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400cc430 con 0x7f22400d1c60 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f22456f2640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400cb860 con 0x7f22400ced30 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f223f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f224015d3e0 0x7f2240157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f223f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f224015d3e0 0x7f2240157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33892/0 (socket says 172.21.15.8:33892) 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.940+0000 7f223f7fe640 1 -- 172.21.15.8:0/4179219722 learned_addr learned my addr 172.21.15.8:0/4179219722 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f223f7fe640 1 -- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22400ced30 msgr2=0x7f2240144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f223f7fe640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22400ced30 0x7f2240144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f223f7fe640 1 -- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22400d1c60 msgr2=0x7f224015a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f223f7fe640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22400d1c60 0x7f224015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f223f7fe640 1 -- 172.21.15.8:0/4179219722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280094d0 con 0x7f224015d3e0 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f223f7fe640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f224015d3e0 0x7f2240157400 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2230007e60 tx=0x7f223000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f22377fe640 1 -- 172.21.15.8:0/4179219722 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230014620 con 0x7f224015d3e0 2023-11-18T23:42:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f22377fe640 1 -- 172.21.15.8:0/4179219722 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000ee90 con 0x7f224015d3e0 2023-11-18T23:42:12.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224015ab90 con 0x7f224015d3e0 2023-11-18T23:42:12.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f22377fe640 1 -- 172.21.15.8:0/4179219722 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22300149e0 con 0x7f224015d3e0 2023-11-18T23:42:12.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.941+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22400cbde0 con 0x7f224015d3e0 2023-11-18T23:42:12.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.942+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2240067420 con 0x7f224015d3e0 2023-11-18T23:42:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.942+0000 7f22377fe640 1 -- 172.21.15.8:0/4179219722 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2230014b40 con 0x7f224015d3e0 2023-11-18T23:42:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.943+0000 7f22377fe640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f222006ae40 0x7f222006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.943+0000 7f22377fe640 1 -- 172.21.15.8:0/4179219722 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2230089f90 con 0x7f224015d3e0 2023-11-18T23:42:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.943+0000 7f223effd640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f222006ae40 0x7f222006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:12.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.944+0000 7f223effd640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f222006ae40 0x7f222006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2238006fd0 tx=0x7f2238008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:12.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:12.947+0000 7f22377fe640 1 -- 172.21.15.8:0/4179219722 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22300bce90 con 0x7f224015d3e0 2023-11-18T23:42:13.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.122+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22400b8ed0 con 0x7f222006ae40 2023-11-18T23:42:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.130+0000 7f22377fe640 1 -- 172.21.15.8:0/4179219722 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277383 (secure 0 0 0) 0x7f22400b8ed0 con 0x7f222006ae40 2023-11-18T23:42:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:42:13.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.132+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f222006ae40 msgr2=0x7f222006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.132+0000 7f22456f2640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f222006ae40 0x7f222006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2238006fd0 tx=0x7f2238008040 comp rx=0 tx=0).stop 2023-11-18T23:42:13.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.132+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f224015d3e0 msgr2=0x7f2240157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.132+0000 7f22456f2640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f224015d3e0 0x7f2240157400 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2230007e60 tx=0x7f223000e4b0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 shutdown_connections 2023-11-18T23:42:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f222006ae40 0x7f222006d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f224015d3e0 0x7f2240157400 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22400d1c60 0x7f224015a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 --2- 172.21.15.8:0/4179219722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f22400ced30 0x7f2240144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 >> 172.21.15.8:0/4179219722 conn(0x7f224009c480 msgr2=0x7f22400ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 shutdown_connections 2023-11-18T23:42:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.133+0000 7f22456f2640 1 -- 172.21.15.8:0/4179219722 wait complete. 2023-11-18T23:42:13.144 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-11-18T23:42:11.257663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236568,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738152,"statfs":{"total":773094113280,"available":772851867648,"internally_reserved":0,"allocated":3776512,"data_stored":2152776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000810"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113448+0000","last_change":"2023-11-18T23:42:08.113448+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113448+0000","last_undegraded":"2023-11-18T23:42:08.113448+0000","last_fullsized":"2023-11-18T23:42:08.113448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256515+0000","last_change":"2023-11-18T23:42:08.256515+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256515+0000","last_undegraded":"2023-11-18T23:42:08.256515+0000","last_fullsized":"2023-11-18T23:42:08.256515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108510+0000","last_change":"2023-11-18T23:42:08.108510+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108510+0000","last_undegraded":"2023-11-18T23:42:08.108510+0000","last_fullsized":"2023-11-18T23:42:08.108510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111377+0000","last_change":"2023-11-18T23:42:08.111377+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111377+0000","last_undegraded":"2023-11-18T23:42:08.111377+0000","last_fullsized":"2023-11-18T23:42:08.111377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120672+0000","last_change":"2023-11-18T23:42:08.120672+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120672+0000","last_undegraded":"2023-11-18T23:42:08.120672+0000","last_fullsized":"2023-11-18T23:42:08.120672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120004+0000","last_change":"2023-11-18T23:42:08.120004+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120004+0000","last_undegraded":"2023-11-18T23:42:08.120004+0000","last_fullsized":"2023-11-18T23:42:08.120004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108461+0000","last_change":"2023-11-18T23:42:08.108461+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108461+0000","last_undegraded":"2023-11-18T23:42:08.108461+0000","last_fullsized":"2023-11-18T23:42:08.108461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120034+0000","last_change":"2023-11-18T23:42:08.120034+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120034+0000","last_undegraded":"2023-11-18T23:42:08.120034+0000","last_fullsized":"2023-11-18T23:42:08.120034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108512+0000","last_change":"2023-11-18T23:42:08.108512+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108512+0000","last_undegraded":"2023-11-18T23:42:08.108512+0000","last_fullsized":"2023-11-18T23:42:08.108512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255747+0000","last_change":"2023-11-18T23:42:08.255747+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255747+0000","last_undegraded":"2023-11-18T23:42:08.255747+0000","last_fullsized":"2023-11-18T23:42:08.255747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108705+0000","last_change":"2023-11-18T23:42:08.108705+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108705+0000","last_undegraded":"2023-11-18T23:42:08.108705+0000","last_fullsized":"2023-11-18T23:42:08.108705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108482+0000","last_change":"2023-11-18T23:42:08.108482+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108482+0000","last_undegraded":"2023-11-18T23:42:08.108482+0000","last_fullsized":"2023-11-18T23:42:08.108482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120055+0000","last_change":"2023-11-18T23:42:08.120055+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120055+0000","last_undegraded":"2023-11-18T23:42:08.120055+0000","last_fullsized":"2023-11-18T23:42:08.120055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111196+0000","last_change":"2023-11-18T23:42:08.111196+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111196+0000","last_undegraded":"2023-11-18T23:42:08.111196+0000","last_fullsized":"2023-11-18T23:42:08.111196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108938+0000","last_change":"2023-11-18T23:42:08.108938+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108938+0000","last_undegraded":"2023-11-18T23:42:08.108938+0000","last_fullsized":"2023-11-18T23:42:08.108938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108443+0000","last_change":"2023-11-18T23:42:08.108443+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108443+0000","last_undegraded":"2023-11-18T23:42:08.108443+0000","last_fullsized":"2023-11-18T23:42:08.108443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111185+0000","last_change":"2023-11-18T23:42:08.111185+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111185+0000","last_undegraded":"2023-11-18T23:42:08.111185+0000","last_fullsized":"2023-11-18T23:42:08.111185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120118+0000","last_change":"2023-11-18T23:42:08.120118+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120118+0000","last_undegraded":"2023-11-18T23:42:08.120118+0000","last_fullsized":"2023-11-18T23:42:08.120118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120056+0000","last_change":"2023-11-18T23:42:08.120056+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120056+0000","last_undegraded":"2023-11-18T23:42:08.120056+0000","last_fullsized":"2023-11-18T23:42:08.120056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120068+0000","last_change":"2023-11-18T23:42:08.120068+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120068+0000","last_undegraded":"2023-11-18T23:42:08.120068+0000","last_fullsized":"2023-11-18T23:42:08.120068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256188+0000","last_change":"2023-11-18T23:42:08.256188+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256188+0000","last_undegraded":"2023-11-18T23:42:08.256188+0000","last_fullsized":"2023-11-18T23:42:08.256188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113454+0000","last_change":"2023-11-18T23:42:08.113454+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113454+0000","last_undegraded":"2023-11-18T23:42:08.113454+0000","last_fullsized":"2023-11-18T23:42:08.113454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120738+0000","last_change":"2023-11-18T23:42:08.120738+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120738+0000","last_undegraded":"2023-11-18T23:42:08.120738+0000","last_fullsized":"2023-11-18T23:42:08.120738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108715+0000","last_change":"2023-11-18T23:42:08.108715+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108715+0000","last_undegraded":"2023-11-18T23:42:08.108715+0000","last_fullsized":"2023-11-18T23:42:08.108715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110563+0000","last_change":"2023-11-18T23:42:08.110563+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110563+0000","last_undegraded":"2023-11-18T23:42:08.110563+0000","last_fullsized":"2023-11-18T23:42:08.110563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256203+0000","last_change":"2023-11-18T23:42:08.256203+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256203+0000","last_undegraded":"2023-11-18T23:42:08.256203+0000","last_fullsized":"2023-11-18T23:42:08.256203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110498+0000","last_change":"2023-11-18T23:42:08.110498+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110498+0000","last_undegraded":"2023-11-18T23:42:08.110498+0000","last_fullsized":"2023-11-18T23:42:08.110498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255750+0000","last_change":"2023-11-18T23:42:08.255750+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255750+0000","last_undegraded":"2023-11-18T23:42:08.255750+0000","last_fullsized":"2023-11-18T23:42:08.255750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110192+0000","last_change":"2023-11-18T23:42:08.110192+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110192+0000","last_undegraded":"2023-11-18T23:42:08.110192+0000","last_fullsized":"2023-11-18T23:42:08.110192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120003+0000","last_change":"2023-11-18T23:42:08.120003+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120003+0000","last_undegraded":"2023-11-18T23:42:08.120003+0000","last_fullsized":"2023-11-18T23:42:08.120003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.109022+0000","last_change":"2023-11-18T23:42:08.109022+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.109022+0000","last_undegraded":"2023-11-18T23:42:08.109022+0000","last_fullsized":"2023-11-18T23:42:08.109022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113375+0000","last_change":"2023-11-18T23:42:08.113375+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113375+0000","last_undegraded":"2023-11-18T23:42:08.113375+0000","last_fullsized":"2023-11-18T23:42:08.113375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T23:42:04.104433+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:42:04.104433+0000","last_peered":"2023-11-18T23:42:04.104433+0000","last_clean":"2023-11-18T23:42:04.104433+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:42:04.104433+0000","last_undegraded":"2023-11-18T23:42:04.104433+0000","last_fullsized":"2023-11-18T23:42:04.104433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.622}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45200000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.501}]},{"osd":6,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.625}]},{"osd":7,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.627},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.317},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.443}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.314}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.26500000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.44},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.372}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:42:13.150 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:42:13.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.290+0000 7f7fad12c640 1 Processor -- start 2023-11-18T23:42:13.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.290+0000 7f7fad12c640 1 -- start start 2023-11-18T23:42:13.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fad12c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 0x7f7fa80ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fad12c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa8141820 con 0x7f7fa815b1f0 2023-11-18T23:42:13.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fad12c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80ce760 con 0x7f7fa8141370 2023-11-18T23:42:13.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fad12c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80cea40 con 0x7f7fa80cc7c0 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fa6d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7fa815b1f0 0x7f7fa80cc0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50588/0 (socket says 172.21.15.8:50588) 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fa6d9d640 1 -- 172.21.15.8:0/3159473794 learned_addr learned my addr 172.21.15.8:0/3159473794 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929510352 0 0) 0x7f7fa8141820 con 0x7f7fa815b1f0 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f94003520 con 0x7f7fa815b1f0 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fa659c640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 0x7f7fa80ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.291+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88633424 0 0) 0x7f7f94003520 con 0x7f7fa815b1f0 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 msgr2=0x7f7fa80ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 0x7f7fa80ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 >> v1:172.21.15.116:6789/0 conn(0x7f7fa8141370 legacy=0x7f7fa806a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80ced20 con 0x7f7fa815b1f0 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2248057734 0 0) 0x7f7fa0001670 con 0x7f7fa815b1f0 2023-11-18T23:42:13.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 >> v1:172.21.15.8:6789/0 conn(0x7f7fa815b1f0 legacy=0x7f7fa80cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f940039a0 0x7f7f94003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 0x7f7f94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80cea40 con 0x7f7f940047c0 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9400ba60 con 0x7f7f940039a0 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9400bc20 con 0x7f7fa80cc7c0 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa659c640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa6d9d640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f940039a0 0x7f7f94003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa759e640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 0x7f7f94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa659c640 1 -- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 msgr2=0x7f7f94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa659c640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa80cc7c0 0x7f7f94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa659c640 1 -- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f940039a0 msgr2=0x7f7f94003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:13.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa659c640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f940039a0 0x7f7f94003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.292+0000 7f7fa659c640 1 -- 172.21.15.8:0/3159473794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94003520 con 0x7f7f940047c0 2023-11-18T23:42:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.293+0000 7f7fa659c640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009a90 tx=0x7f7f940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b8c39dbb8637f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.293+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9002c680 con 0x7f7f940047c0 2023-11-18T23:42:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.293+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9002c7e0 con 0x7f7f940047c0 2023-11-18T23:42:13.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.293+0000 7f7fa5d9b640 1 -- 172.21.15.8:0/3159473794 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9002cb70 con 0x7f7f940047c0 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.293+0000 7f7fad12c640 1 -- 172.21.15.8:0/3159473794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 msgr2=0x7f7f94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.293+0000 7f7fad12c640 1 --2- 172.21.15.8:0/3159473794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009a90 tx=0x7f7f940057f0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.293+0000 7f7fa759e640 1 -- 172.21.15.8:0/3159473794 reap_dead start 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.294+0000 7f7fad12c640 1 -- 172.21.15.8:0/3159473794 shutdown_connections 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.294+0000 7f7fad12c640 1 -- 172.21.15.8:0/3159473794 >> 172.21.15.8:0/3159473794 conn(0x7f7fa80cf6a0 msgr2=0x7f7fa80cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.294+0000 7f7fad12c640 1 -- 172.21.15.8:0/3159473794 shutdown_connections 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.294+0000 7f7fad12c640 1 -- 172.21.15.8:0/3159473794 wait complete. 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.295+0000 7f7fad12c640 1 Processor -- start 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.295+0000 7f7fad12c640 1 -- start start 2023-11-18T23:42:13.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fad12c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7fa80b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fad12c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa80b42b0 0x7f7fa8139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fad12c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa8159b70 0x7f7fa8159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fad12c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa815a530 con 0x7f7f940047c0 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fad12c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80ac7e0 con 0x7f7fa80b42b0 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fad12c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80acda0 con 0x7f7fa8159b70 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7fa80b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7fa80b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33904/0 (socket says 172.21.15.8:33904) 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 -- 172.21.15.8:0/2179417112 learned_addr learned my addr 172.21.15.8:0/2179417112 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa659c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa80b42b0 0x7f7fa8139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa759e640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa8159b70 0x7f7fa8159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 -- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa8159b70 msgr2=0x7f7fa8159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa8159b70 0x7f7fa8159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 -- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa80b42b0 msgr2=0x7f7fa8139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa80b42b0 0x7f7fa8139400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 -- 172.21.15.8:0/2179417112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80b4730 con 0x7f7f940047c0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7fa6d9d640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7fa80b31a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00072c0 tx=0x7f7fa0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.296+0000 7f7f9f7fe640 1 -- 172.21.15.8:0/2179417112 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0001440 con 0x7f7f940047c0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.297+0000 7f7f9f7fe640 1 -- 172.21.15.8:0/2179417112 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000f8e0 con 0x7f7f940047c0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.297+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa80b38a0 con 0x7f7f940047c0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.297+0000 7f7f9f7fe640 1 -- 172.21.15.8:0/2179417112 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000fc90 con 0x7f7f940047c0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.297+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80aca30 con 0x7f7f940047c0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.298+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa80acbc0 con 0x7f7f940047c0 2023-11-18T23:42:13.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.298+0000 7f7f9f7fe640 1 -- 172.21.15.8:0/2179417112 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fa001d460 con 0x7f7f940047c0 2023-11-18T23:42:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.299+0000 7f7f9f7fe640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7f8806ae70 0x7f7f8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.299+0000 7f7f9f7fe640 1 -- 172.21.15.8:0/2179417112 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa00896a0 con 0x7f7f940047c0 2023-11-18T23:42:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.299+0000 7f7fa659c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7f8806ae70 0x7f7f8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.299+0000 7f7fa659c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7f8806ae70 0x7f7f8806d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7f90036000 tx=0x7f7f90030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.303+0000 7f7f9f7fe640 1 -- 172.21.15.8:0/2179417112 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fa0054890 con 0x7f7f940047c0 2023-11-18T23:42:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.480+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fa8140bd0 con 0x7f7f8806ae70 2023-11-18T23:42:13.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.487+0000 7f7f9f7fe640 1 -- 172.21.15.8:0/2179417112 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277383 (secure 0 0 0) 0x7f7fa8140bd0 con 0x7f7f8806ae70 2023-11-18T23:42:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:42:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7f8806ae70 msgr2=0x7f7f8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7f8806ae70 0x7f7f8806d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7f90036000 tx=0x7f7f90030000 comp rx=0 tx=0).stop 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 msgr2=0x7f7fa80b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7fa80b31a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00072c0 tx=0x7f7fa0007780 comp rx=0 tx=0).stop 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 shutdown_connections 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f7f8806ae70 0x7f7f8806d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7fa8159b70 0x7f7fa8159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa80b42b0 0x7f7fa8139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 --2- 172.21.15.8:0/2179417112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f940047c0 0x7f7fa80b31a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 >> 172.21.15.8:0/2179417112 conn(0x7f7fa80cf6a0 msgr2=0x7f7fa80af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 shutdown_connections 2023-11-18T23:42:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.490+0000 7f7fad12c640 1 -- 172.21.15.8:0/2179417112 wait complete. 2023-11-18T23:42:13.502 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-18T23:42:13.258218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236568,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738152,"statfs":{"total":773094113280,"available":772851867648,"internally_reserved":0,"allocated":3776512,"data_stored":2152776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.151268"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113448+0000","last_change":"2023-11-18T23:42:08.113448+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113448+0000","last_undegraded":"2023-11-18T23:42:08.113448+0000","last_fullsized":"2023-11-18T23:42:08.113448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256515+0000","last_change":"2023-11-18T23:42:08.256515+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256515+0000","last_undegraded":"2023-11-18T23:42:08.256515+0000","last_fullsized":"2023-11-18T23:42:08.256515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108510+0000","last_change":"2023-11-18T23:42:08.108510+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108510+0000","last_undegraded":"2023-11-18T23:42:08.108510+0000","last_fullsized":"2023-11-18T23:42:08.108510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111377+0000","last_change":"2023-11-18T23:42:08.111377+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111377+0000","last_undegraded":"2023-11-18T23:42:08.111377+0000","last_fullsized":"2023-11-18T23:42:08.111377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120672+0000","last_change":"2023-11-18T23:42:08.120672+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120672+0000","last_undegraded":"2023-11-18T23:42:08.120672+0000","last_fullsized":"2023-11-18T23:42:08.120672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120004+0000","last_change":"2023-11-18T23:42:08.120004+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120004+0000","last_undegraded":"2023-11-18T23:42:08.120004+0000","last_fullsized":"2023-11-18T23:42:08.120004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108461+0000","last_change":"2023-11-18T23:42:08.108461+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108461+0000","last_undegraded":"2023-11-18T23:42:08.108461+0000","last_fullsized":"2023-11-18T23:42:08.108461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120034+0000","last_change":"2023-11-18T23:42:08.120034+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120034+0000","last_undegraded":"2023-11-18T23:42:08.120034+0000","last_fullsized":"2023-11-18T23:42:08.120034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108512+0000","last_change":"2023-11-18T23:42:08.108512+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108512+0000","last_undegraded":"2023-11-18T23:42:08.108512+0000","last_fullsized":"2023-11-18T23:42:08.108512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255747+0000","last_change":"2023-11-18T23:42:08.255747+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255747+0000","last_undegraded":"2023-11-18T23:42:08.255747+0000","last_fullsized":"2023-11-18T23:42:08.255747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108705+0000","last_change":"2023-11-18T23:42:08.108705+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108705+0000","last_undegraded":"2023-11-18T23:42:08.108705+0000","last_fullsized":"2023-11-18T23:42:08.108705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108482+0000","last_change":"2023-11-18T23:42:08.108482+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108482+0000","last_undegraded":"2023-11-18T23:42:08.108482+0000","last_fullsized":"2023-11-18T23:42:08.108482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120055+0000","last_change":"2023-11-18T23:42:08.120055+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120055+0000","last_undegraded":"2023-11-18T23:42:08.120055+0000","last_fullsized":"2023-11-18T23:42:08.120055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111196+0000","last_change":"2023-11-18T23:42:08.111196+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111196+0000","last_undegraded":"2023-11-18T23:42:08.111196+0000","last_fullsized":"2023-11-18T23:42:08.111196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108938+0000","last_change":"2023-11-18T23:42:08.108938+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108938+0000","last_undegraded":"2023-11-18T23:42:08.108938+0000","last_fullsized":"2023-11-18T23:42:08.108938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108443+0000","last_change":"2023-11-18T23:42:08.108443+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108443+0000","last_undegraded":"2023-11-18T23:42:08.108443+0000","last_fullsized":"2023-11-18T23:42:08.108443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111185+0000","last_change":"2023-11-18T23:42:08.111185+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111185+0000","last_undegraded":"2023-11-18T23:42:08.111185+0000","last_fullsized":"2023-11-18T23:42:08.111185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120118+0000","last_change":"2023-11-18T23:42:08.120118+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120118+0000","last_undegraded":"2023-11-18T23:42:08.120118+0000","last_fullsized":"2023-11-18T23:42:08.120118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120056+0000","last_change":"2023-11-18T23:42:08.120056+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120056+0000","last_undegraded":"2023-11-18T23:42:08.120056+0000","last_fullsized":"2023-11-18T23:42:08.120056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120068+0000","last_change":"2023-11-18T23:42:08.120068+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120068+0000","last_undegraded":"2023-11-18T23:42:08.120068+0000","last_fullsized":"2023-11-18T23:42:08.120068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256188+0000","last_change":"2023-11-18T23:42:08.256188+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256188+0000","last_undegraded":"2023-11-18T23:42:08.256188+0000","last_fullsized":"2023-11-18T23:42:08.256188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113454+0000","last_change":"2023-11-18T23:42:08.113454+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113454+0000","last_undegraded":"2023-11-18T23:42:08.113454+0000","last_fullsized":"2023-11-18T23:42:08.113454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120738+0000","last_change":"2023-11-18T23:42:08.120738+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120738+0000","last_undegraded":"2023-11-18T23:42:08.120738+0000","last_fullsized":"2023-11-18T23:42:08.120738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108715+0000","last_change":"2023-11-18T23:42:08.108715+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108715+0000","last_undegraded":"2023-11-18T23:42:08.108715+0000","last_fullsized":"2023-11-18T23:42:08.108715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110563+0000","last_change":"2023-11-18T23:42:08.110563+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110563+0000","last_undegraded":"2023-11-18T23:42:08.110563+0000","last_fullsized":"2023-11-18T23:42:08.110563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256203+0000","last_change":"2023-11-18T23:42:08.256203+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256203+0000","last_undegraded":"2023-11-18T23:42:08.256203+0000","last_fullsized":"2023-11-18T23:42:08.256203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110498+0000","last_change":"2023-11-18T23:42:08.110498+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110498+0000","last_undegraded":"2023-11-18T23:42:08.110498+0000","last_fullsized":"2023-11-18T23:42:08.110498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255750+0000","last_change":"2023-11-18T23:42:08.255750+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255750+0000","last_undegraded":"2023-11-18T23:42:08.255750+0000","last_fullsized":"2023-11-18T23:42:08.255750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110192+0000","last_change":"2023-11-18T23:42:08.110192+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110192+0000","last_undegraded":"2023-11-18T23:42:08.110192+0000","last_fullsized":"2023-11-18T23:42:08.110192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120003+0000","last_change":"2023-11-18T23:42:08.120003+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120003+0000","last_undegraded":"2023-11-18T23:42:08.120003+0000","last_fullsized":"2023-11-18T23:42:08.120003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.109022+0000","last_change":"2023-11-18T23:42:08.109022+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.109022+0000","last_undegraded":"2023-11-18T23:42:08.109022+0000","last_fullsized":"2023-11-18T23:42:08.109022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113375+0000","last_change":"2023-11-18T23:42:08.113375+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113375+0000","last_undegraded":"2023-11-18T23:42:08.113375+0000","last_fullsized":"2023-11-18T23:42:08.113375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T23:42:04.104433+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:42:04.104433+0000","last_peered":"2023-11-18T23:42:04.104433+0000","last_clean":"2023-11-18T23:42:04.104433+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:42:04.104433+0000","last_undegraded":"2023-11-18T23:42:04.104433+0000","last_fullsized":"2023-11-18T23:42:04.104433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.622}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45200000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.501}]},{"osd":6,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.625}]},{"osd":7,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.627},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.317},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.443}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.314}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.26500000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.44},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.372}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:42:13.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:42:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.648+0000 7fd8e0961640 1 Processor -- start 2023-11-18T23:42:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.648+0000 7fd8e0961640 1 -- start start 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8e0961640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc0b2ee0 0x7fd8dc071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8e0961640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0b3300 con 0x7fd8dc1465d0 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8e0961640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0cf790 con 0x7fd8dc06abe0 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8e0961640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc161d80 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8da59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd8dc1465d0 0x7fd8dc06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50590/0 (socket says 172.21.15.8:50590) 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8da59c640 1 -- 172.21.15.8:0/4092288368 learned_addr learned my addr 172.21.15.8:0/4092288368 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8dad9d640 1 --2- 172.21.15.8:0/4092288368 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc0b2ee0 0x7fd8dc071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269289912 0 0) 0x7fd8dc0b3300 con 0x7fd8dc1465d0 2023-11-18T23:42:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.649+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c4003520 con 0x7fd8dc1465d0 2023-11-18T23:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.650+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806742802 0 0) 0x7fd8dc0cf790 con 0x7fd8dc06abe0 2023-11-18T23:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.650+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8dc0b3300 con 0x7fd8dc06abe0 2023-11-18T23:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.650+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457621187 0 0) 0x7fd8c4003520 con 0x7fd8dc1465d0 2023-11-18T23:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.650+0000 7fd8dad9d640 1 -- 172.21.15.8:0/4092288368 >> v1:172.21.15.116:6789/0 conn(0x7fd8dc06abe0 legacy=0x7fd8dc0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.650+0000 7fd8dad9d640 1 -- 172.21.15.8:0/4092288368 >> v1:172.21.15.8:6789/0 conn(0x7fd8dc1465d0 legacy=0x7fd8dc06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.650+0000 7fd8dad9d640 1 -- 172.21.15.8:0/4092288368 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc1614e0 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.650+0000 7fd8dad9d640 1 --2- 172.21.15.8:0/4092288368 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc0b2ee0 0x7fd8dc071d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009dc0 tx=0x7fd8d402bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=806fc42f51b511df server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc001670 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d402c910 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8d959a640 1 -- 172.21.15.8:0/4092288368 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d402cc80 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8e0961640 1 -- 172.21.15.8:0/4092288368 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc0b2ee0 msgr2=0x7fd8dc071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8e0961640 1 --2- 172.21.15.8:0/4092288368 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc0b2ee0 0x7fd8dc071d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009dc0 tx=0x7fd8d402bde0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8e0961640 1 -- 172.21.15.8:0/4092288368 shutdown_connections 2023-11-18T23:42:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8e0961640 1 --2- 172.21.15.8:0/4092288368 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc0b2ee0 0x7fd8dc071d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8e0961640 1 -- 172.21.15.8:0/4092288368 >> 172.21.15.8:0/4092288368 conn(0x7fd8dc0cc930 msgr2=0x7fd8dc0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8e0961640 1 -- 172.21.15.8:0/4092288368 shutdown_connections 2023-11-18T23:42:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.651+0000 7fd8e0961640 1 -- 172.21.15.8:0/4092288368 wait complete. 2023-11-18T23:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 Processor -- start 2023-11-18T23:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 -- start start 2023-11-18T23:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8dc06abe0 0x7fd8dc1f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc0b2ee0 0x7fd8dc0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc1465d0 0x7fd8dc0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc135f80 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0b1bc0 con 0x7fd8dc06abe0 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8e0961640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0b1ea0 con 0x7fd8dc1465d0 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8d9d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc0b2ee0 0x7fd8dc0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.653+0000 7fd8d9d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc0b2ee0 0x7fd8dc0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33920/0 (socket says 172.21.15.8:33920) 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8d9d9b640 1 -- 172.21.15.8:0/1134707713 learned_addr learned my addr 172.21.15.8:0/1134707713 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8dad9d640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc1465d0 0x7fd8dc0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8da59c640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8dc06abe0 0x7fd8dc1f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8d9d9b640 1 -- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc1465d0 msgr2=0x7fd8dc0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8d9d9b640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc1465d0 0x7fd8dc0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8d9d9b640 1 -- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8dc06abe0 msgr2=0x7fd8dc1f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8d9d9b640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8dc06abe0 0x7fd8dc1f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8d9d9b640 1 -- 172.21.15.8:0/1134707713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009a70 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8d9d9b640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc0b2ee0 0x7fd8dc0b34b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000c490 tx=0x7fd8d000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:13.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8caffd640 1 -- 172.21.15.8:0/1134707713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00052d0 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8caffd640 1 -- 172.21.15.8:0/1134707713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0005430 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc0b2180 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8caffd640 1 -- 172.21.15.8:0/1134707713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0012870 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.654+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc1f2880 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.655+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc0b26a0 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.656+0000 7fd8caffd640 1 -- 172.21.15.8:0/1134707713 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8d00129d0 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.656+0000 7fd8caffd640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd8bc06ae40 0x7fd8bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:13.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.656+0000 7fd8caffd640 1 -- 172.21.15.8:0/1134707713 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8d0089080 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.656+0000 7fd8da59c640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd8bc06ae40 0x7fd8bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:13.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.657+0000 7fd8da59c640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd8bc06ae40 0x7fd8bc06d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0011e0 tx=0x7fd8cc001690 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:13.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.660+0000 7fd8caffd640 1 -- 172.21.15.8:0/1134707713 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8dc0b26a0 con 0x7fd8dc0b2ee0 2023-11-18T23:42:13.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.833+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8dc0cfa30 con 0x7fd8bc06ae40 2023-11-18T23:42:13.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.841+0000 7fd8caffd640 1 -- 172.21.15.8:0/1134707713 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277383 (secure 0 0 0) 0x7fd8cc00f940 con 0x7fd8bc06ae40 2023-11-18T23:42:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:42:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.843+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd8bc06ae40 msgr2=0x7fd8bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.843+0000 7fd8e0961640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd8bc06ae40 0x7fd8bc06d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0011e0 tx=0x7fd8cc001690 comp rx=0 tx=0).stop 2023-11-18T23:42:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.843+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc0b2ee0 msgr2=0x7fd8dc0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.843+0000 7fd8e0961640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc0b2ee0 0x7fd8dc0b34b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000c490 tx=0x7fd8d000c950 comp rx=0 tx=0).stop 2023-11-18T23:42:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 shutdown_connections 2023-11-18T23:42:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fd8bc06ae40 0x7fd8bc06d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8dc1465d0 0x7fd8dc0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8dc0b2ee0 0x7fd8dc0b34b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 --2- 172.21.15.8:0/1134707713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8dc06abe0 0x7fd8dc1f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 >> 172.21.15.8:0/1134707713 conn(0x7fd8dc0cc930 msgr2=0x7fd8dc144900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 shutdown_connections 2023-11-18T23:42:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:13.844+0000 7fd8e0961640 1 -- 172.21.15.8:0/1134707713 wait complete. 2023-11-18T23:42:13.855 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-18T23:42:13.258218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236568,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738152,"statfs":{"total":773094113280,"available":772851867648,"internally_reserved":0,"allocated":3776512,"data_stored":2152776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.151268"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113448+0000","last_change":"2023-11-18T23:42:08.113448+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113448+0000","last_undegraded":"2023-11-18T23:42:08.113448+0000","last_fullsized":"2023-11-18T23:42:08.113448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256515+0000","last_change":"2023-11-18T23:42:08.256515+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256515+0000","last_undegraded":"2023-11-18T23:42:08.256515+0000","last_fullsized":"2023-11-18T23:42:08.256515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108510+0000","last_change":"2023-11-18T23:42:08.108510+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108510+0000","last_undegraded":"2023-11-18T23:42:08.108510+0000","last_fullsized":"2023-11-18T23:42:08.108510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111377+0000","last_change":"2023-11-18T23:42:08.111377+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111377+0000","last_undegraded":"2023-11-18T23:42:08.111377+0000","last_fullsized":"2023-11-18T23:42:08.111377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120672+0000","last_change":"2023-11-18T23:42:08.120672+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120672+0000","last_undegraded":"2023-11-18T23:42:08.120672+0000","last_fullsized":"2023-11-18T23:42:08.120672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120004+0000","last_change":"2023-11-18T23:42:08.120004+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120004+0000","last_undegraded":"2023-11-18T23:42:08.120004+0000","last_fullsized":"2023-11-18T23:42:08.120004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108461+0000","last_change":"2023-11-18T23:42:08.108461+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108461+0000","last_undegraded":"2023-11-18T23:42:08.108461+0000","last_fullsized":"2023-11-18T23:42:08.108461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120034+0000","last_change":"2023-11-18T23:42:08.120034+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120034+0000","last_undegraded":"2023-11-18T23:42:08.120034+0000","last_fullsized":"2023-11-18T23:42:08.120034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108512+0000","last_change":"2023-11-18T23:42:08.108512+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108512+0000","last_undegraded":"2023-11-18T23:42:08.108512+0000","last_fullsized":"2023-11-18T23:42:08.108512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255747+0000","last_change":"2023-11-18T23:42:08.255747+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255747+0000","last_undegraded":"2023-11-18T23:42:08.255747+0000","last_fullsized":"2023-11-18T23:42:08.255747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108705+0000","last_change":"2023-11-18T23:42:08.108705+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108705+0000","last_undegraded":"2023-11-18T23:42:08.108705+0000","last_fullsized":"2023-11-18T23:42:08.108705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108482+0000","last_change":"2023-11-18T23:42:08.108482+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108482+0000","last_undegraded":"2023-11-18T23:42:08.108482+0000","last_fullsized":"2023-11-18T23:42:08.108482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120055+0000","last_change":"2023-11-18T23:42:08.120055+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120055+0000","last_undegraded":"2023-11-18T23:42:08.120055+0000","last_fullsized":"2023-11-18T23:42:08.120055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111196+0000","last_change":"2023-11-18T23:42:08.111196+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111196+0000","last_undegraded":"2023-11-18T23:42:08.111196+0000","last_fullsized":"2023-11-18T23:42:08.111196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108938+0000","last_change":"2023-11-18T23:42:08.108938+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108938+0000","last_undegraded":"2023-11-18T23:42:08.108938+0000","last_fullsized":"2023-11-18T23:42:08.108938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108443+0000","last_change":"2023-11-18T23:42:08.108443+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108443+0000","last_undegraded":"2023-11-18T23:42:08.108443+0000","last_fullsized":"2023-11-18T23:42:08.108443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111185+0000","last_change":"2023-11-18T23:42:08.111185+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111185+0000","last_undegraded":"2023-11-18T23:42:08.111185+0000","last_fullsized":"2023-11-18T23:42:08.111185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120118+0000","last_change":"2023-11-18T23:42:08.120118+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120118+0000","last_undegraded":"2023-11-18T23:42:08.120118+0000","last_fullsized":"2023-11-18T23:42:08.120118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120056+0000","last_change":"2023-11-18T23:42:08.120056+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120056+0000","last_undegraded":"2023-11-18T23:42:08.120056+0000","last_fullsized":"2023-11-18T23:42:08.120056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120068+0000","last_change":"2023-11-18T23:42:08.120068+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120068+0000","last_undegraded":"2023-11-18T23:42:08.120068+0000","last_fullsized":"2023-11-18T23:42:08.120068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256188+0000","last_change":"2023-11-18T23:42:08.256188+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256188+0000","last_undegraded":"2023-11-18T23:42:08.256188+0000","last_fullsized":"2023-11-18T23:42:08.256188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113454+0000","last_change":"2023-11-18T23:42:08.113454+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113454+0000","last_undegraded":"2023-11-18T23:42:08.113454+0000","last_fullsized":"2023-11-18T23:42:08.113454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120738+0000","last_change":"2023-11-18T23:42:08.120738+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120738+0000","last_undegraded":"2023-11-18T23:42:08.120738+0000","last_fullsized":"2023-11-18T23:42:08.120738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108715+0000","last_change":"2023-11-18T23:42:08.108715+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108715+0000","last_undegraded":"2023-11-18T23:42:08.108715+0000","last_fullsized":"2023-11-18T23:42:08.108715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110563+0000","last_change":"2023-11-18T23:42:08.110563+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110563+0000","last_undegraded":"2023-11-18T23:42:08.110563+0000","last_fullsized":"2023-11-18T23:42:08.110563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256203+0000","last_change":"2023-11-18T23:42:08.256203+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256203+0000","last_undegraded":"2023-11-18T23:42:08.256203+0000","last_fullsized":"2023-11-18T23:42:08.256203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110498+0000","last_change":"2023-11-18T23:42:08.110498+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110498+0000","last_undegraded":"2023-11-18T23:42:08.110498+0000","last_fullsized":"2023-11-18T23:42:08.110498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255750+0000","last_change":"2023-11-18T23:42:08.255750+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255750+0000","last_undegraded":"2023-11-18T23:42:08.255750+0000","last_fullsized":"2023-11-18T23:42:08.255750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110192+0000","last_change":"2023-11-18T23:42:08.110192+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110192+0000","last_undegraded":"2023-11-18T23:42:08.110192+0000","last_fullsized":"2023-11-18T23:42:08.110192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120003+0000","last_change":"2023-11-18T23:42:08.120003+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120003+0000","last_undegraded":"2023-11-18T23:42:08.120003+0000","last_fullsized":"2023-11-18T23:42:08.120003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.109022+0000","last_change":"2023-11-18T23:42:08.109022+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.109022+0000","last_undegraded":"2023-11-18T23:42:08.109022+0000","last_fullsized":"2023-11-18T23:42:08.109022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113375+0000","last_change":"2023-11-18T23:42:08.113375+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113375+0000","last_undegraded":"2023-11-18T23:42:08.113375+0000","last_fullsized":"2023-11-18T23:42:08.113375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T23:42:04.104433+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:42:04.104433+0000","last_peered":"2023-11-18T23:42:04.104433+0000","last_clean":"2023-11-18T23:42:04.104433+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:42:04.104433+0000","last_undegraded":"2023-11-18T23:42:04.104433+0000","last_fullsized":"2023-11-18T23:42:04.104433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.622}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45200000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.501}]},{"osd":6,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.625}]},{"osd":7,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.627},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.317},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.443}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.314}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.26500000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.44},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.372}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:42:13.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-18T23:42:13.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-18T23:42:13.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-18T23:42:13.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-18T23:42:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-18T23:42:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-18T23:42:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-18T23:42:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-18T23:42:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.113448+0000', 'last_change': '2023-11-18T23:42:08.113448+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.113448+0000', 'last_undegraded': '2023-11-18T23:42:08.113448+0000', 'last_fullsized': '2023-11-18T23:42:08.113448+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.256515+0000', 'last_change': '2023-11-18T23:42:08.256515+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.256515+0000', 'last_undegraded': '2023-11-18T23:42:08.256515+0000', 'last_fullsized': '2023-11-18T23:42:08.256515+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108510+0000', 'last_change': '2023-11-18T23:42:08.108510+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108510+0000', 'last_undegraded': '2023-11-18T23:42:08.108510+0000', 'last_fullsized': '2023-11-18T23:42:08.108510+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.111377+0000', 'last_change': '2023-11-18T23:42:08.111377+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.111377+0000', 'last_undegraded': '2023-11-18T23:42:08.111377+0000', 'last_fullsized': '2023-11-18T23:42:08.111377+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-18T23:42:13.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120672+0000', 'last_change': '2023-11-18T23:42:08.120672+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120672+0000', 'last_undegraded': '2023-11-18T23:42:08.120672+0000', 'last_fullsized': '2023-11-18T23:42:08.120672+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120004+0000', 'last_change': '2023-11-18T23:42:08.120004+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120004+0000', 'last_undegraded': '2023-11-18T23:42:08.120004+0000', 'last_fullsized': '2023-11-18T23:42:08.120004+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108461+0000', 'last_change': '2023-11-18T23:42:08.108461+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108461+0000', 'last_undegraded': '2023-11-18T23:42:08.108461+0000', 'last_fullsized': '2023-11-18T23:42:08.108461+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120034+0000', 'last_change': '2023-11-18T23:42:08.120034+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120034+0000', 'last_undegraded': '2023-11-18T23:42:08.120034+0000', 'last_fullsized': '2023-11-18T23:42:08.120034+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-18T23:42:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108512+0000', 'last_change': '2023-11-18T23:42:08.108512+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108512+0000', 'last_undegraded': '2023-11-18T23:42:08.108512+0000', 'last_fullsized': '2023-11-18T23:42:08.108512+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.255747+0000', 'last_change': '2023-11-18T23:42:08.255747+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.255747+0000', 'last_undegraded': '2023-11-18T23:42:08.255747+0000', 'last_fullsized': '2023-11-18T23:42:08.255747+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108705+0000', 'last_change': '2023-11-18T23:42:08.108705+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108705+0000', 'last_undegraded': '2023-11-18T23:42:08.108705+0000', 'last_fullsized': '2023-11-18T23:42:08.108705+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108482+0000', 'last_change': '2023-11-18T23:42:08.108482+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108482+0000', 'last_undegraded': '2023-11-18T23:42:08.108482+0000', 'last_fullsized': '2023-11-18T23:42:08.108482+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120055+0000', 'last_change': '2023-11-18T23:42:08.120055+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120055+0000', 'last_undegraded': '2023-11-18T23:42:08.120055+0000', 'last_fullsized': '2023-11-18T23:42:08.120055+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-18T23:42:13.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.111196+0000', 'last_change': '2023-11-18T23:42:08.111196+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.111196+0000', 'last_undegraded': '2023-11-18T23:42:08.111196+0000', 'last_fullsized': '2023-11-18T23:42:08.111196+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108938+0000', 'last_change': '2023-11-18T23:42:08.108938+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108938+0000', 'last_undegraded': '2023-11-18T23:42:08.108938+0000', 'last_fullsized': '2023-11-18T23:42:08.108938+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108443+0000', 'last_change': '2023-11-18T23:42:08.108443+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108443+0000', 'last_undegraded': '2023-11-18T23:42:08.108443+0000', 'last_fullsized': '2023-11-18T23:42:08.108443+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-18T23:42:13.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-18T23:42:13.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.111185+0000', 'last_change': '2023-11-18T23:42:08.111185+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.111185+0000', 'last_undegraded': '2023-11-18T23:42:08.111185+0000', 'last_fullsized': '2023-11-18T23:42:08.111185+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T23:42:13.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-18T23:42:13.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-18T23:42:13.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120118+0000', 'last_change': '2023-11-18T23:42:08.120118+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120118+0000', 'last_undegraded': '2023-11-18T23:42:08.120118+0000', 'last_fullsized': '2023-11-18T23:42:08.120118+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120056+0000', 'last_change': '2023-11-18T23:42:08.120056+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120056+0000', 'last_undegraded': '2023-11-18T23:42:08.120056+0000', 'last_fullsized': '2023-11-18T23:42:08.120056+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120068+0000', 'last_change': '2023-11-18T23:42:08.120068+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120068+0000', 'last_undegraded': '2023-11-18T23:42:08.120068+0000', 'last_fullsized': '2023-11-18T23:42:08.120068+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-18T23:42:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.256188+0000', 'last_change': '2023-11-18T23:42:08.256188+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.256188+0000', 'last_undegraded': '2023-11-18T23:42:08.256188+0000', 'last_fullsized': '2023-11-18T23:42:08.256188+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.113454+0000', 'last_change': '2023-11-18T23:42:08.113454+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.113454+0000', 'last_undegraded': '2023-11-18T23:42:08.113454+0000', 'last_fullsized': '2023-11-18T23:42:08.113454+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-18T23:42:13.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120738+0000', 'last_change': '2023-11-18T23:42:08.120738+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120738+0000', 'last_undegraded': '2023-11-18T23:42:08.120738+0000', 'last_fullsized': '2023-11-18T23:42:08.120738+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.108715+0000', 'last_change': '2023-11-18T23:42:08.108715+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.108715+0000', 'last_undegraded': '2023-11-18T23:42:08.108715+0000', 'last_fullsized': '2023-11-18T23:42:08.108715+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.110563+0000', 'last_change': '2023-11-18T23:42:08.110563+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.110563+0000', 'last_undegraded': '2023-11-18T23:42:08.110563+0000', 'last_fullsized': '2023-11-18T23:42:08.110563+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-18T23:42:13.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.256203+0000', 'last_change': '2023-11-18T23:42:08.256203+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.256203+0000', 'last_undegraded': '2023-11-18T23:42:08.256203+0000', 'last_fullsized': '2023-11-18T23:42:08.256203+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.110498+0000', 'last_change': '2023-11-18T23:42:08.110498+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.110498+0000', 'last_undegraded': '2023-11-18T23:42:08.110498+0000', 'last_fullsized': '2023-11-18T23:42:08.110498+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-18T23:42:13.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.255750+0000', 'last_change': '2023-11-18T23:42:08.255750+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.255750+0000', 'last_undegraded': '2023-11-18T23:42:08.255750+0000', 'last_fullsized': '2023-11-18T23:42:08.255750+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.110192+0000', 'last_change': '2023-11-18T23:42:08.110192+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.110192+0000', 'last_undegraded': '2023-11-18T23:42:08.110192+0000', 'last_fullsized': '2023-11-18T23:42:08.110192+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.120003+0000', 'last_change': '2023-11-18T23:42:08.120003+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.120003+0000', 'last_undegraded': '2023-11-18T23:42:08.120003+0000', 'last_fullsized': '2023-11-18T23:42:08.120003+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-18T23:42:13.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.109022+0000', 'last_change': '2023-11-18T23:42:08.109022+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.109022+0000', 'last_undegraded': '2023-11-18T23:42:08.109022+0000', 'last_fullsized': '2023-11-18T23:42:08.109022+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-18T23:42:13.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-18T23:42:13.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-18T23:42:09.106124+0000', 'last_change': '2023-11-18T23:42:09.106124+0000', 'last_active': '2023-11-18T23:42:09.106124+0000', 'last_peered': '2023-11-18T23:42:09.106124+0000', 'last_clean': '2023-11-18T23:42:09.106124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:09.106124+0000', 'last_undegraded': '2023-11-18T23:42:09.106124+0000', 'last_fullsized': '2023-11-18T23:42:09.106124+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:09.106124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-18T23:42:13.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-18T23:42:13.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-18T23:42:08.113375+0000', 'last_change': '2023-11-18T23:42:08.113375+0000', 'last_active': '2023-11-18T23:42:08.102347+0000', 'last_peered': '2023-11-18T23:42:08.102347+0000', 'last_clean': '2023-11-18T23:42:08.102347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-18T23:42:08.113375+0000', 'last_undegraded': '2023-11-18T23:42:08.113375+0000', 'last_fullsized': '2023-11-18T23:42:08.113375+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'last_clean_scrub_stamp': '2023-11-18T23:42:08.102347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-18T23:42:13.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-18T23:42:13.944 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-18T23:42:13.943+0000 7f15b8e5d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T23:42:14.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.000+0000 7f9d3c00e640 1 Processor -- start 2023-11-18T23:42:14.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.000+0000 7f9d3c00e640 1 -- start start 2023-11-18T23:42:14.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d3c00e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9d34099970 0x7f9d34099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d3c00e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d3409a530 0x7f9d340cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d3c00e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d340d0070 con 0x7f9d340cf890 2023-11-18T23:42:14.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d3c00e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d340cbb50 con 0x7f9d34099970 2023-11-18T23:42:14.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d3c00e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3409a290 con 0x7f9d3409a530 2023-11-18T23:42:14.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d39daa640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9d34099970 0x7f9d34099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d395a9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d3409a530 0x7f9d340cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d3a5ab640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f9d340cf890 0x7f9d340b0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:43050/0 (socket says 172.21.15.8:43050) 2023-11-18T23:42:14.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.001+0000 7f9d3a5ab640 1 -- 172.21.15.8:0/1680696815 learned_addr learned my addr 172.21.15.8:0/1680696815 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:14.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.002+0000 7f9d395a9640 1 -- 172.21.15.8:0/1680696815 >> v2:172.21.15.116:3300/0 conn(0x7f9d34099970 msgr2=0x7f9d34099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:14.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.002+0000 7f9d395a9640 1 --2- 172.21.15.8:0/1680696815 >> v2:172.21.15.116:3300/0 conn(0x7f9d34099970 0x7f9d34099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.002+0000 7f9d395a9640 1 -- 172.21.15.8:0/1680696815 >> v1:172.21.15.116:6789/0 conn(0x7f9d340cf890 legacy=0x7f9d340b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.002+0000 7f9d395a9640 1 -- 172.21.15.8:0/1680696815 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340cfd90 con 0x7f9d3409a530 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.002+0000 7f9d38da8640 1 -- 172.21.15.8:0/1680696815 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368541877 0 0) 0x7f9d2c001490 con 0x7f9d340cf890 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.002+0000 7f9d39daa640 1 --2- 172.21.15.8:0/1680696815 >> v2:172.21.15.116:3300/0 conn(0x7f9d34099970 0x7f9d34099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.002+0000 7f9d395a9640 1 --2- 172.21.15.8:0/1680696815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d3409a530 0x7f9d340cc8d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097a0 tx=0x7f9d2402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed7a4f51bbf567c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d38da8640 1 -- 172.21.15.8:0/1680696815 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24031830 con 0x7f9d3409a530 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d38da8640 1 -- 172.21.15.8:0/1680696815 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24031990 con 0x7f9d3409a530 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d38da8640 1 -- 172.21.15.8:0/1680696815 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24031d20 con 0x7f9d3409a530 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1680696815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d3409a530 msgr2=0x7f9d340cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1680696815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d3409a530 0x7f9d340cc8d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097a0 tx=0x7f9d2402b8d0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1680696815 shutdown_connections 2023-11-18T23:42:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1680696815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d3409a530 0x7f9d340cc8d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1680696815 >> v2:172.21.15.116:3300/0 conn(0x7f9d34099970 0x7f9d34099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1680696815 >> 172.21.15.8:0/1680696815 conn(0x7f9d340b2a70 msgr2=0x7f9d340b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:14.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1680696815 shutdown_connections 2023-11-18T23:42:14.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.003+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1680696815 wait complete. 2023-11-18T23:42:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.004+0000 7f9d3c00e640 1 Processor -- start 2023-11-18T23:42:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.004+0000 7f9d3c00e640 1 -- start start 2023-11-18T23:42:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d3c00e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d34099970 0x7f9d34155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d3c00e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3409a530 0x7f9d3415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d3c00e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d340cf890 0x7f9d340b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d3c00e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d341519b0 con 0x7f9d3409a530 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d3c00e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d34155890 con 0x7f9d340cf890 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d3c00e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3415aef0 con 0x7f9d34099970 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d395a9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3409a530 0x7f9d3415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d395a9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3409a530 0x7f9d3415a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33926/0 (socket says 172.21.15.8:33926) 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.005+0000 7f9d395a9640 1 -- 172.21.15.8:0/1786205275 learned_addr learned my addr 172.21.15.8:0/1786205275 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d3a5ab640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d340cf890 0x7f9d340b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d39daa640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d34099970 0x7f9d34155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d395a9640 1 -- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d34099970 msgr2=0x7f9d34155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d395a9640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d34099970 0x7f9d34155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d395a9640 1 -- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d340cf890 msgr2=0x7f9d340b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d395a9640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d340cf890 0x7f9d340b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d395a9640 1 -- 172.21.15.8:0/1786205275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30009400 con 0x7f9d3409a530 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d3a5ab640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d340cf890 0x7f9d340b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d395a9640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3409a530 0x7f9d3415a9b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d240098c0 tx=0x7f9d240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d2a7fc640 1 -- 172.21.15.8:0/1786205275 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24004230 con 0x7f9d3409a530 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d2a7fc640 1 -- 172.21.15.8:0/1786205275 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24004390 con 0x7f9d3409a530 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d24009400 con 0x7f9d3409a530 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d2a7fc640 1 -- 172.21.15.8:0/1786205275 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2403a8a0 con 0x7f9d3409a530 2023-11-18T23:42:14.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.006+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d34155da0 con 0x7f9d3409a530 2023-11-18T23:42:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.007+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d34067420 con 0x7f9d3409a530 2023-11-18T23:42:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.008+0000 7f9d2a7fc640 1 -- 172.21.15.8:0/1786205275 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d2403aa00 con 0x7f9d3409a530 2023-11-18T23:42:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.008+0000 7f9d2a7fc640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9d1806ae40 0x7f9d1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.008+0000 7f9d2a7fc640 1 -- 172.21.15.8:0/1786205275 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d240abe20 con 0x7f9d3409a530 2023-11-18T23:42:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.008+0000 7f9d39daa640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9d1806ae40 0x7f9d1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.009+0000 7f9d39daa640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9d1806ae40 0x7f9d1806d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009c60 tx=0x7f9d30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:14.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.012+0000 7f9d2a7fc640 1 -- 172.21.15.8:0/1786205275 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d24077080 con 0x7f9d3409a530 2023-11-18T23:42:14.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.259+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9d340b3840 con 0x7f9d3409a530 2023-11-18T23:42:14.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.259+0000 7f9d2a7fc640 1 -- 172.21.15.8:0/1786205275 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1655 (secure 0 0 0) 0x7f9d2403acb0 con 0x7f9d3409a530 2023-11-18T23:42:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:14.261 INFO:teuthology.orchestra.run.smithi008.stdout:{"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":87,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1700350857,"num_in_osds":8,"osd_in_since":1700350849,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242245632,"bytes_avail":772851867648,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5053}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-18T23:41:59.255389+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-18T23:42:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9d1806ae40 msgr2=0x7f9d1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9d1806ae40 0x7f9d1806d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009c60 tx=0x7f9d30008040 comp rx=0 tx=0).stop 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3409a530 msgr2=0x7f9d3415a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3409a530 0x7f9d3415a9b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d240098c0 tx=0x7f9d240046c0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 shutdown_connections 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f9d1806ae40 0x7f9d1806d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d340cf890 0x7f9d340b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3409a530 0x7f9d3415a9b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 --2- 172.21.15.8:0/1786205275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d34099970 0x7f9d34155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 >> 172.21.15.8:0/1786205275 conn(0x7f9d340b2a70 msgr2=0x7f9d340b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 shutdown_connections 2023-11-18T23:42:14.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.261+0000 7f9d3c00e640 1 -- 172.21.15.8:0/1786205275 wait complete. 2023-11-18T23:42:14.273 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-18T23:42:14.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:42:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.378+0000 7f78d1f5a640 1 Processor -- start 2023-11-18T23:42:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78d1f5a640 1 -- start start 2023-11-18T23:42:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78d1f5a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc15d3e0 0x7f78cc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78d1f5a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78cc0ced30 0x7f78cc0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78d1f5a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78cc0b5f90 con 0x7f78cc0d1c60 2023-11-18T23:42:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78d1f5a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc0cf170 con 0x7f78cc0ced30 2023-11-18T23:42:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78d1f5a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0d20f0 con 0x7f78cc15d3e0 2023-11-18T23:42:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78caffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78cc0ced30 0x7f78cc0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.379+0000 7f78cbfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f78cc0d1c60 0x7f78cc0b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50602/0 (socket says 172.21.15.8:50602) 2023-11-18T23:42:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.380+0000 7f78cbfff640 1 -- 172.21.15.8:0/1389056085 learned_addr learned my addr 172.21.15.8:0/1389056085 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.380+0000 7f78cb7fe640 1 --2- 172.21.15.8:0/1389056085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc15d3e0 0x7f78cc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.380+0000 7f78caffd640 1 -- 172.21.15.8:0/1389056085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc15d3e0 msgr2=0x7f78cc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.380+0000 7f78caffd640 1 --2- 172.21.15.8:0/1389056085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc15d3e0 0x7f78cc0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.380+0000 7f78ca7fc640 1 -- 172.21.15.8:0/1389056085 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122178469 0 0) 0x7f78cc0b5f90 con 0x7f78cc0d1c60 2023-11-18T23:42:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.380+0000 7f78caffd640 1 -- 172.21.15.8:0/1389056085 >> v1:172.21.15.8:6789/0 conn(0x7f78cc0d1c60 legacy=0x7f78cc0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.380+0000 7f78caffd640 1 -- 172.21.15.8:0/1389056085 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0b61e0 con 0x7f78cc0ced30 2023-11-18T23:42:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78caffd640 1 --2- 172.21.15.8:0/1389056085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0d1720 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f78c00097a0 tx=0x7f78c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dbf0221d758a5f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78ca7fc640 1 -- 172.21.15.8:0/1389056085 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0031830 con 0x7f78cc0ced30 2023-11-18T23:42:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78ca7fc640 1 -- 172.21.15.8:0/1389056085 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0031990 con 0x7f78cc0ced30 2023-11-18T23:42:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78ca7fc640 1 -- 172.21.15.8:0/1389056085 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0031d20 con 0x7f78cc0ced30 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 -- 172.21.15.8:0/1389056085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 msgr2=0x7f78cc0d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/1389056085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0d1720 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f78c00097a0 tx=0x7f78c002b8d0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 -- 172.21.15.8:0/1389056085 shutdown_connections 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/1389056085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0d1720 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/1389056085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc15d3e0 0x7f78cc0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 -- 172.21.15.8:0/1389056085 >> 172.21.15.8:0/1389056085 conn(0x7f78cc09c480 msgr2=0x7f78cc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 -- 172.21.15.8:0/1389056085 shutdown_connections 2023-11-18T23:42:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.381+0000 7f78d1f5a640 1 -- 172.21.15.8:0/1389056085 wait complete. 2023-11-18T23:42:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.382+0000 7f78d1f5a640 1 Processor -- start 2023-11-18T23:42:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.383+0000 7f78d1f5a640 1 -- start start 2023-11-18T23:42:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.383+0000 7f78d1f5a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.383+0000 7f78d1f5a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc0d1c60 0x7f78cc0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.383+0000 7f78d1f5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78cc15d3e0 0x7f78cc0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.383+0000 7f78d1f5a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15aa40 con 0x7f78cc0ced30 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.383+0000 7f78d1f5a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0a0ed0 con 0x7f78cc15d3e0 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.383+0000 7f78d1f5a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc159dc0 con 0x7f78cc0d1c60 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33940/0 (socket says 172.21.15.8:33940) 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 -- 172.21.15.8:0/2481575624 learned_addr learned my addr 172.21.15.8:0/2481575624 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78caffd640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc0d1c60 0x7f78cc0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cbfff640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78cc15d3e0 0x7f78cc0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 -- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc0d1c60 msgr2=0x7f78cc0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc0d1c60 0x7f78cc0ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 -- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78cc15d3e0 msgr2=0x7f78cc0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78cc15d3e0 0x7f78cc0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 -- 172.21.15.8:0/2481575624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0009400 con 0x7f78cc0ced30 2023-11-18T23:42:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78cb7fe640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0a0990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c7f0 tx=0x7f78bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78b3fff640 1 -- 172.21.15.8:0/2481575624 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc004220 con 0x7f78cc0ced30 2023-11-18T23:42:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78b3fff640 1 -- 172.21.15.8:0/2481575624 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc004380 con 0x7f78cc0ced30 2023-11-18T23:42:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc15a0a0 con 0x7f78cc0ced30 2023-11-18T23:42:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78b3fff640 1 -- 172.21.15.8:0/2481575624 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc007840 con 0x7f78cc0ced30 2023-11-18T23:42:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.384+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc15a660 con 0x7f78cc0ced30 2023-11-18T23:42:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.385+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc067420 con 0x7f78cc0ced30 2023-11-18T23:42:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.386+0000 7f78b3fff640 1 -- 172.21.15.8:0/2481575624 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78bc0079a0 con 0x7f78cc0ced30 2023-11-18T23:42:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.386+0000 7f78b3fff640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f78b806ae40 0x7f78b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.386+0000 7f78b3fff640 1 -- 172.21.15.8:0/2481575624 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78bc089300 con 0x7f78cc0ced30 2023-11-18T23:42:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.386+0000 7f78caffd640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f78b806ae40 0x7f78b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.387+0000 7f78caffd640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f78b806ae40 0x7f78b806d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f78c0036000 tx=0x7f78c0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:14.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.391+0000 7f78b3fff640 1 -- 172.21.15.8:0/2481575624 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78bc0543b0 con 0x7f78cc0ced30 2023-11-18T23:42:14.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.563+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78cc160d70 con 0x7f78b806ae40 2023-11-18T23:42:14.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.570+0000 7f78b3fff640 1 -- 172.21.15.8:0/2481575624 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277383 (secure 0 0 0) 0x7f78cc160d70 con 0x7f78b806ae40 2023-11-18T23:42:14.574 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:14.575 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f78b806ae40 msgr2=0x7f78b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f78b806ae40 0x7f78b806d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f78c0036000 tx=0x7f78c0008030 comp rx=0 tx=0).stop 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 msgr2=0x7f78cc0a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0a0990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c7f0 tx=0x7f78bc00ccb0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 shutdown_connections 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f78b806ae40 0x7f78b806d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78cc15d3e0 0x7f78cc0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78cc0d1c60 0x7f78cc0ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 --2- 172.21.15.8:0/2481575624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78cc0ced30 0x7f78cc0a0990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:14.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 >> 172.21.15.8:0/2481575624 conn(0x7f78cc09c480 msgr2=0x7f78cc06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:14.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 shutdown_connections 2023-11-18T23:42:14.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:14.573+0000 7f78d1f5a640 1 -- 172.21.15.8:0/2481575624 wait complete. 2023-11-18T23:42:14.585 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-18T23:42:13.258218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236568,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738152,"statfs":{"total":773094113280,"available":772851867648,"internally_reserved":0,"allocated":3776512,"data_stored":2152776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.151268"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113448+0000","last_change":"2023-11-18T23:42:08.113448+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113448+0000","last_undegraded":"2023-11-18T23:42:08.113448+0000","last_fullsized":"2023-11-18T23:42:08.113448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256515+0000","last_change":"2023-11-18T23:42:08.256515+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256515+0000","last_undegraded":"2023-11-18T23:42:08.256515+0000","last_fullsized":"2023-11-18T23:42:08.256515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108510+0000","last_change":"2023-11-18T23:42:08.108510+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108510+0000","last_undegraded":"2023-11-18T23:42:08.108510+0000","last_fullsized":"2023-11-18T23:42:08.108510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111377+0000","last_change":"2023-11-18T23:42:08.111377+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111377+0000","last_undegraded":"2023-11-18T23:42:08.111377+0000","last_fullsized":"2023-11-18T23:42:08.111377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120672+0000","last_change":"2023-11-18T23:42:08.120672+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120672+0000","last_undegraded":"2023-11-18T23:42:08.120672+0000","last_fullsized":"2023-11-18T23:42:08.120672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120004+0000","last_change":"2023-11-18T23:42:08.120004+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120004+0000","last_undegraded":"2023-11-18T23:42:08.120004+0000","last_fullsized":"2023-11-18T23:42:08.120004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108461+0000","last_change":"2023-11-18T23:42:08.108461+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108461+0000","last_undegraded":"2023-11-18T23:42:08.108461+0000","last_fullsized":"2023-11-18T23:42:08.108461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120034+0000","last_change":"2023-11-18T23:42:08.120034+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120034+0000","last_undegraded":"2023-11-18T23:42:08.120034+0000","last_fullsized":"2023-11-18T23:42:08.120034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108512+0000","last_change":"2023-11-18T23:42:08.108512+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108512+0000","last_undegraded":"2023-11-18T23:42:08.108512+0000","last_fullsized":"2023-11-18T23:42:08.108512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255747+0000","last_change":"2023-11-18T23:42:08.255747+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255747+0000","last_undegraded":"2023-11-18T23:42:08.255747+0000","last_fullsized":"2023-11-18T23:42:08.255747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108705+0000","last_change":"2023-11-18T23:42:08.108705+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108705+0000","last_undegraded":"2023-11-18T23:42:08.108705+0000","last_fullsized":"2023-11-18T23:42:08.108705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108482+0000","last_change":"2023-11-18T23:42:08.108482+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108482+0000","last_undegraded":"2023-11-18T23:42:08.108482+0000","last_fullsized":"2023-11-18T23:42:08.108482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120055+0000","last_change":"2023-11-18T23:42:08.120055+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120055+0000","last_undegraded":"2023-11-18T23:42:08.120055+0000","last_fullsized":"2023-11-18T23:42:08.120055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111196+0000","last_change":"2023-11-18T23:42:08.111196+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111196+0000","last_undegraded":"2023-11-18T23:42:08.111196+0000","last_fullsized":"2023-11-18T23:42:08.111196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108938+0000","last_change":"2023-11-18T23:42:08.108938+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108938+0000","last_undegraded":"2023-11-18T23:42:08.108938+0000","last_fullsized":"2023-11-18T23:42:08.108938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108443+0000","last_change":"2023-11-18T23:42:08.108443+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108443+0000","last_undegraded":"2023-11-18T23:42:08.108443+0000","last_fullsized":"2023-11-18T23:42:08.108443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.111185+0000","last_change":"2023-11-18T23:42:08.111185+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.111185+0000","last_undegraded":"2023-11-18T23:42:08.111185+0000","last_fullsized":"2023-11-18T23:42:08.111185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120118+0000","last_change":"2023-11-18T23:42:08.120118+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120118+0000","last_undegraded":"2023-11-18T23:42:08.120118+0000","last_fullsized":"2023-11-18T23:42:08.120118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120056+0000","last_change":"2023-11-18T23:42:08.120056+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120056+0000","last_undegraded":"2023-11-18T23:42:08.120056+0000","last_fullsized":"2023-11-18T23:42:08.120056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120068+0000","last_change":"2023-11-18T23:42:08.120068+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120068+0000","last_undegraded":"2023-11-18T23:42:08.120068+0000","last_fullsized":"2023-11-18T23:42:08.120068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256188+0000","last_change":"2023-11-18T23:42:08.256188+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256188+0000","last_undegraded":"2023-11-18T23:42:08.256188+0000","last_fullsized":"2023-11-18T23:42:08.256188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113454+0000","last_change":"2023-11-18T23:42:08.113454+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113454+0000","last_undegraded":"2023-11-18T23:42:08.113454+0000","last_fullsized":"2023-11-18T23:42:08.113454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120738+0000","last_change":"2023-11-18T23:42:08.120738+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120738+0000","last_undegraded":"2023-11-18T23:42:08.120738+0000","last_fullsized":"2023-11-18T23:42:08.120738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.108715+0000","last_change":"2023-11-18T23:42:08.108715+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.108715+0000","last_undegraded":"2023-11-18T23:42:08.108715+0000","last_fullsized":"2023-11-18T23:42:08.108715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110563+0000","last_change":"2023-11-18T23:42:08.110563+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110563+0000","last_undegraded":"2023-11-18T23:42:08.110563+0000","last_fullsized":"2023-11-18T23:42:08.110563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.256203+0000","last_change":"2023-11-18T23:42:08.256203+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.256203+0000","last_undegraded":"2023-11-18T23:42:08.256203+0000","last_fullsized":"2023-11-18T23:42:08.256203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110498+0000","last_change":"2023-11-18T23:42:08.110498+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110498+0000","last_undegraded":"2023-11-18T23:42:08.110498+0000","last_fullsized":"2023-11-18T23:42:08.110498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.255750+0000","last_change":"2023-11-18T23:42:08.255750+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.255750+0000","last_undegraded":"2023-11-18T23:42:08.255750+0000","last_fullsized":"2023-11-18T23:42:08.255750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.110192+0000","last_change":"2023-11-18T23:42:08.110192+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.110192+0000","last_undegraded":"2023-11-18T23:42:08.110192+0000","last_fullsized":"2023-11-18T23:42:08.110192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.120003+0000","last_change":"2023-11-18T23:42:08.120003+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.120003+0000","last_undegraded":"2023-11-18T23:42:08.120003+0000","last_fullsized":"2023-11-18T23:42:08.120003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.109022+0000","last_change":"2023-11-18T23:42:08.109022+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.109022+0000","last_undegraded":"2023-11-18T23:42:08.109022+0000","last_fullsized":"2023-11-18T23:42:08.109022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-18T23:42:09.106124+0000","last_change":"2023-11-18T23:42:09.106124+0000","last_active":"2023-11-18T23:42:09.106124+0000","last_peered":"2023-11-18T23:42:09.106124+0000","last_clean":"2023-11-18T23:42:09.106124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:09.106124+0000","last_undegraded":"2023-11-18T23:42:09.106124+0000","last_fullsized":"2023-11-18T23:42:09.106124+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-18T23:42:08.113375+0000","last_change":"2023-11-18T23:42:08.113375+0000","last_active":"2023-11-18T23:42:08.102347+0000","last_peered":"2023-11-18T23:42:08.102347+0000","last_clean":"2023-11-18T23:42:08.102347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-18T23:42:08.113375+0000","last_undegraded":"2023-11-18T23:42:08.113375+0000","last_fullsized":"2023-11-18T23:42:08.113375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T23:42:04.104433+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:42:04.104433+0000","last_peered":"2023-11-18T23:42:04.104433+0000","last_clean":"2023-11-18T23:42:04.104433+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:42:04.104433+0000","last_undegraded":"2023-11-18T23:42:04.104433+0000","last_fullsized":"2023-11-18T23:42:04.104433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.622}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45200000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.501}]},{"osd":6,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.625}]},{"osd":7,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.627},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.317},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.443}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.314}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.26500000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.44},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.372}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:42:17.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T23:42:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.710+0000 7fecb91cc640 1 Processor -- start 2023-11-18T23:42:17.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.710+0000 7fecb91cc640 1 -- start start 2023-11-18T23:42:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb91cc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fecb40b2610 0x7fecb40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb91cc640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40b0660 con 0x7fecb415d900 2023-11-18T23:42:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb91cc640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb406c900 con 0x7fecb409a080 2023-11-18T23:42:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb91cc640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb406cbe0 con 0x7fecb40b2610 2023-11-18T23:42:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb359e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fecb40b2610 0x7fecb40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb2d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fecb415d900 0x7fecb4099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58508/0 (socket says 172.21.15.8:58508) 2023-11-18T23:42:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb2d9d640 1 -- 172.21.15.8:0/1329287921 learned_addr learned my addr 172.21.15.8:0/1329287921 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb359e640 1 -- 172.21.15.8:0/1329287921 >> v1:172.21.15.116:6789/0 conn(0x7fecb409a080 legacy=0x7fecb40b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb359e640 1 -- 172.21.15.8:0/1329287921 >> v1:172.21.15.8:6789/0 conn(0x7fecb415d900 legacy=0x7fecb4099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.711+0000 7fecb359e640 1 -- 172.21.15.8:0/1329287921 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb406cec0 con 0x7fecb40b2610 2023-11-18T23:42:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.712+0000 7fecb359e640 1 --2- 172.21.15.8:0/1329287921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb40b2610 0x7fecb40b14e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fecac009d90 tx=0x7fecac02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d2fa680d225573 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.712+0000 7fecb259c640 1 -- 172.21.15.8:0/1329287921 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac02cd00 con 0x7fecb40b2610 2023-11-18T23:42:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.712+0000 7fecb259c640 1 -- 172.21.15.8:0/1329287921 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac02ce60 con 0x7fecb40b2610 2023-11-18T23:42:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.712+0000 7fecb259c640 1 -- 172.21.15.8:0/1329287921 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac034660 con 0x7fecb40b2610 2023-11-18T23:42:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.713+0000 7fecb91cc640 1 -- 172.21.15.8:0/1329287921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb40b2610 msgr2=0x7fecb40b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.713+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1329287921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb40b2610 0x7fecb40b14e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fecac009d90 tx=0x7fecac02bf50 comp rx=0 tx=0).stop 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.713+0000 7fecb91cc640 1 -- 172.21.15.8:0/1329287921 shutdown_connections 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.713+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1329287921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb40b2610 0x7fecb40b14e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.713+0000 7fecb91cc640 1 -- 172.21.15.8:0/1329287921 >> 172.21.15.8:0/1329287921 conn(0x7fecb40b2a70 msgr2=0x7fecb40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.713+0000 7fecb91cc640 1 -- 172.21.15.8:0/1329287921 shutdown_connections 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.713+0000 7fecb91cc640 1 -- 172.21.15.8:0/1329287921 wait complete. 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.714+0000 7fecb91cc640 1 Processor -- start 2023-11-18T23:42:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.714+0000 7fecb91cc640 1 -- start start 2023-11-18T23:42:17.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb91cc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecb409a080 0x7fecb414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb91cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecb40b2610 0x7fecb41f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb91cc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb415d900 0x7fecb40c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb91cc640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40b3d40 con 0x7fecb415d900 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb91cc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41503f0 con 0x7fecb40b2610 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb91cc640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40b5330 con 0x7fecb409a080 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb415d900 0x7fecb40c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb415d900 0x7fecb40c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48292/0 (socket says 172.21.15.8:48292) 2023-11-18T23:42:17.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb359e640 1 -- 172.21.15.8:0/1432726328 learned_addr learned my addr 172.21.15.8:0/1432726328 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecabfff640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecb40b2610 0x7fecb41f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.715+0000 7fecb2d9d640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecb409a080 0x7fecb414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb359e640 1 -- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecb409a080 msgr2=0x7fecb414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb359e640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecb409a080 0x7fecb414feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb359e640 1 -- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecb40b2610 msgr2=0x7fecb41f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb359e640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecb40b2610 0x7fecb41f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb359e640 1 -- 172.21.15.8:0/1432726328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac009a70 con 0x7fecb415d900 2023-11-18T23:42:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb359e640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb415d900 0x7fecb40c5b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fecac009d90 tx=0x7fecac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecab7fe640 1 -- 172.21.15.8:0/1432726328 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac03d600 con 0x7fecb415d900 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecab7fe640 1 -- 172.21.15.8:0/1432726328 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac03d780 con 0x7fecb415d900 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb40c6bb0 con 0x7fecb415d900 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecab7fe640 1 -- 172.21.15.8:0/1432726328 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac03db30 con 0x7fecb415d900 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.716+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb40c7170 con 0x7fecb415d900 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.717+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb40b54a0 con 0x7fecb415d900 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.718+0000 7fecab7fe640 1 -- 172.21.15.8:0/1432726328 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecac03b040 con 0x7fecb415d900 2023-11-18T23:42:17.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.718+0000 7fecab7fe640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fec9406ae40 0x7fec9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:17.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.718+0000 7fecab7fe640 1 -- 172.21.15.8:0/1432726328 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecac0abd30 con 0x7fecb415d900 2023-11-18T23:42:17.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.718+0000 7fecb2d9d640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fec9406ae40 0x7fec9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:17.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.719+0000 7fecb2d9d640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fec9406ae40 0x7fec9406d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feca4005880 tx=0x7feca4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:17.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.722+0000 7fecab7fe640 1 -- 172.21.15.8:0/1432726328 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecb40b54a0 con 0x7fecb415d900 2023-11-18T23:42:17.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.895+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 --> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecb40b36e0 con 0x7fec9406ae40 2023-11-18T23:42:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.903+0000 7fecab7fe640 1 -- 172.21.15.8:0/1432726328 <== mgr.4105 v2:172.21.15.116:6832/4087144077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289476 (secure 0 0 0) 0x7feca40013f0 con 0x7fec9406ae40 2023-11-18T23:42:17.907 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:17.909 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-11-18T23:42:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fec9406ae40 msgr2=0x7fec9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fec9406ae40 0x7fec9406d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feca4005880 tx=0x7feca4009040 comp rx=0 tx=0).stop 2023-11-18T23:42:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb415d900 msgr2=0x7fecb40c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb415d900 0x7fecb40c5b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fecac009d90 tx=0x7fecac004a40 comp rx=0 tx=0).stop 2023-11-18T23:42:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 shutdown_connections 2023-11-18T23:42:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fec9406ae40 0x7fec9406d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecb415d900 0x7fecb40c5b00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecb40b2610 0x7fecb41f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 --2- 172.21.15.8:0/1432726328 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecb409a080 0x7fecb414feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 >> 172.21.15.8:0/1432726328 conn(0x7fecb40b2a70 msgr2=0x7fecb415a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 shutdown_connections 2023-11-18T23:42:17.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:17.906+0000 7fecb91cc640 1 -- 172.21.15.8:0/1432726328 wait complete. 2023-11-18T23:42:17.918 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-18T23:42:17.259205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236968,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737752,"statfs":{"total":773094113280,"available":772851458048,"internally_reserved":0,"allocated":4235264,"data_stored":2358868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001938"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410554+0000","last_change":"2023-11-18T23:42:10.151763+0000","last_active":"2023-11-18T23:42:11.410554+0000","last_peered":"2023-11-18T23:42:11.410554+0000","last_clean":"2023-11-18T23:42:11.410554+0000","last_became_active":"2023-11-18T23:42:10.151363+0000","last_became_peered":"2023-11-18T23:42:10.151363+0000","last_unstale":"2023-11-18T23:42:11.410554+0000","last_undegraded":"2023-11-18T23:42:11.410554+0000","last_fullsized":"2023-11-18T23:42:11.410554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:59.998324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142410+0000","last_change":"2023-11-18T23:42:10.148600+0000","last_active":"2023-11-18T23:42:11.142410+0000","last_peered":"2023-11-18T23:42:11.142410+0000","last_clean":"2023-11-18T23:42:11.142410+0000","last_became_active":"2023-11-18T23:42:10.148329+0000","last_became_peered":"2023-11-18T23:42:10.148329+0000","last_unstale":"2023-11-18T23:42:11.142410+0000","last_undegraded":"2023-11-18T23:42:11.142410+0000","last_fullsized":"2023-11-18T23:42:11.142410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:25:22.467443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141470+0000","last_change":"2023-11-18T23:42:10.155447+0000","last_active":"2023-11-18T23:42:11.141470+0000","last_peered":"2023-11-18T23:42:11.141470+0000","last_clean":"2023-11-18T23:42:11.141470+0000","last_became_active":"2023-11-18T23:42:10.155170+0000","last_became_peered":"2023-11-18T23:42:10.155170+0000","last_unstale":"2023-11-18T23:42:11.141470+0000","last_undegraded":"2023-11-18T23:42:11.141470+0000","last_fullsized":"2023-11-18T23:42:11.141470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:02:41.868670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410029+0000","last_change":"2023-11-18T23:42:10.146242+0000","last_active":"2023-11-18T23:42:11.410029+0000","last_peered":"2023-11-18T23:42:11.410029+0000","last_clean":"2023-11-18T23:42:11.410029+0000","last_became_active":"2023-11-18T23:42:10.145955+0000","last_became_peered":"2023-11-18T23:42:10.145955+0000","last_unstale":"2023-11-18T23:42:11.410029+0000","last_undegraded":"2023-11-18T23:42:11.410029+0000","last_fullsized":"2023-11-18T23:42:11.410029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:12:36.805065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136490+0000","last_change":"2023-11-18T23:42:10.136682+0000","last_active":"2023-11-18T23:42:11.136490+0000","last_peered":"2023-11-18T23:42:11.136490+0000","last_clean":"2023-11-18T23:42:11.136490+0000","last_became_active":"2023-11-18T23:42:10.136397+0000","last_became_peered":"2023-11-18T23:42:10.136397+0000","last_unstale":"2023-11-18T23:42:11.136490+0000","last_undegraded":"2023-11-18T23:42:11.136490+0000","last_fullsized":"2023-11-18T23:42:11.136490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:11:16.710451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142161+0000","last_change":"2023-11-18T23:42:10.151740+0000","last_active":"2023-11-18T23:42:11.142161+0000","last_peered":"2023-11-18T23:42:11.142161+0000","last_clean":"2023-11-18T23:42:11.142161+0000","last_became_active":"2023-11-18T23:42:10.151485+0000","last_became_peered":"2023-11-18T23:42:10.151485+0000","last_unstale":"2023-11-18T23:42:11.142161+0000","last_undegraded":"2023-11-18T23:42:11.142161+0000","last_fullsized":"2023-11-18T23:42:11.142161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:02:41.868670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410174+0000","last_change":"2023-11-18T23:42:10.150645+0000","last_active":"2023-11-18T23:42:11.410174+0000","last_peered":"2023-11-18T23:42:11.410174+0000","last_clean":"2023-11-18T23:42:11.410174+0000","last_became_active":"2023-11-18T23:42:10.150334+0000","last_became_peered":"2023-11-18T23:42:10.150334+0000","last_unstale":"2023-11-18T23:42:11.410174+0000","last_undegraded":"2023-11-18T23:42:11.410174+0000","last_fullsized":"2023-11-18T23:42:11.410174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:53.040821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410320+0000","last_change":"2023-11-18T23:42:10.142810+0000","last_active":"2023-11-18T23:42:11.410320+0000","last_peered":"2023-11-18T23:42:11.410320+0000","last_clean":"2023-11-18T23:42:11.410320+0000","last_became_active":"2023-11-18T23:42:10.141931+0000","last_became_peered":"2023-11-18T23:42:10.141931+0000","last_unstale":"2023-11-18T23:42:11.410320+0000","last_undegraded":"2023-11-18T23:42:11.410320+0000","last_fullsized":"2023-11-18T23:42:11.410320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:02:41.868670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.411227+0000","last_change":"2023-11-18T23:42:10.155703+0000","last_active":"2023-11-18T23:42:11.411227+0000","last_peered":"2023-11-18T23:42:11.411227+0000","last_clean":"2023-11-18T23:42:11.411227+0000","last_became_active":"2023-11-18T23:42:10.155452+0000","last_became_peered":"2023-11-18T23:42:10.155452+0000","last_unstale":"2023-11-18T23:42:11.411227+0000","last_undegraded":"2023-11-18T23:42:11.411227+0000","last_fullsized":"2023-11-18T23:42:11.411227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:47.811619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410027+0000","last_change":"2023-11-18T23:42:10.151013+0000","last_active":"2023-11-18T23:42:11.410027+0000","last_peered":"2023-11-18T23:42:11.410027+0000","last_clean":"2023-11-18T23:42:11.410027+0000","last_became_active":"2023-11-18T23:42:10.150728+0000","last_became_peered":"2023-11-18T23:42:10.150728+0000","last_unstale":"2023-11-18T23:42:11.410027+0000","last_undegraded":"2023-11-18T23:42:11.410027+0000","last_fullsized":"2023-11-18T23:42:11.410027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:06:37.321468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410079+0000","last_change":"2023-11-18T23:42:10.154166+0000","last_active":"2023-11-18T23:42:11.410079+0000","last_peered":"2023-11-18T23:42:11.410079+0000","last_clean":"2023-11-18T23:42:11.410079+0000","last_became_active":"2023-11-18T23:42:10.153872+0000","last_became_peered":"2023-11-18T23:42:10.153872+0000","last_unstale":"2023-11-18T23:42:11.410079+0000","last_undegraded":"2023-11-18T23:42:11.410079+0000","last_fullsized":"2023-11-18T23:42:11.410079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:40:24.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141432+0000","last_change":"2023-11-18T23:42:10.144929+0000","last_active":"2023-11-18T23:42:11.141432+0000","last_peered":"2023-11-18T23:42:11.141432+0000","last_clean":"2023-11-18T23:42:11.141432+0000","last_became_active":"2023-11-18T23:42:10.144684+0000","last_became_peered":"2023-11-18T23:42:10.144684+0000","last_unstale":"2023-11-18T23:42:11.141432+0000","last_undegraded":"2023-11-18T23:42:11.141432+0000","last_fullsized":"2023-11-18T23:42:11.141432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:53.040821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136538+0000","last_change":"2023-11-18T23:42:10.143883+0000","last_active":"2023-11-18T23:42:11.136538+0000","last_peered":"2023-11-18T23:42:11.136538+0000","last_clean":"2023-11-18T23:42:11.136538+0000","last_became_active":"2023-11-18T23:42:10.143638+0000","last_became_peered":"2023-11-18T23:42:10.143638+0000","last_unstale":"2023-11-18T23:42:11.136538+0000","last_undegraded":"2023-11-18T23:42:11.136538+0000","last_fullsized":"2023-11-18T23:42:11.136538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:11:34.481435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142167+0000","last_change":"2023-11-18T23:42:10.138742+0000","last_active":"2023-11-18T23:42:11.142167+0000","last_peered":"2023-11-18T23:42:11.142167+0000","last_clean":"2023-11-18T23:42:11.142167+0000","last_became_active":"2023-11-18T23:42:10.138475+0000","last_became_peered":"2023-11-18T23:42:10.138475+0000","last_unstale":"2023-11-18T23:42:11.142167+0000","last_undegraded":"2023-11-18T23:42:11.142167+0000","last_fullsized":"2023-11-18T23:42:11.142167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:47.919823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141205+0000","last_change":"2023-11-18T23:42:10.148080+0000","last_active":"2023-11-18T23:42:11.141205+0000","last_peered":"2023-11-18T23:42:11.141205+0000","last_clean":"2023-11-18T23:42:11.141205+0000","last_became_active":"2023-11-18T23:42:10.147805+0000","last_became_peered":"2023-11-18T23:42:10.147805+0000","last_unstale":"2023-11-18T23:42:11.141205+0000","last_undegraded":"2023-11-18T23:42:11.141205+0000","last_fullsized":"2023-11-18T23:42:11.141205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:32:39.513782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410778+0000","last_change":"2023-11-18T23:42:10.153474+0000","last_active":"2023-11-18T23:42:11.410778+0000","last_peered":"2023-11-18T23:42:11.410778+0000","last_clean":"2023-11-18T23:42:11.410778+0000","last_became_active":"2023-11-18T23:42:10.153183+0000","last_became_peered":"2023-11-18T23:42:10.153183+0000","last_unstale":"2023-11-18T23:42:11.410778+0000","last_undegraded":"2023-11-18T23:42:11.410778+0000","last_fullsized":"2023-11-18T23:42:11.410778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:36.721476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410310+0000","last_change":"2023-11-18T23:42:10.151773+0000","last_active":"2023-11-18T23:42:11.410310+0000","last_peered":"2023-11-18T23:42:11.410310+0000","last_clean":"2023-11-18T23:42:11.410310+0000","last_became_active":"2023-11-18T23:42:10.151049+0000","last_became_peered":"2023-11-18T23:42:10.151049+0000","last_unstale":"2023-11-18T23:42:11.410310+0000","last_undegraded":"2023-11-18T23:42:11.410310+0000","last_fullsized":"2023-11-18T23:42:11.410310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:12.351763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142401+0000","last_change":"2023-11-18T23:42:10.157331+0000","last_active":"2023-11-18T23:42:11.142401+0000","last_peered":"2023-11-18T23:42:11.142401+0000","last_clean":"2023-11-18T23:42:11.142401+0000","last_became_active":"2023-11-18T23:42:10.157060+0000","last_became_peered":"2023-11-18T23:42:10.157060+0000","last_unstale":"2023-11-18T23:42:11.142401+0000","last_undegraded":"2023-11-18T23:42:11.142401+0000","last_fullsized":"2023-11-18T23:42:11.142401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:27.749637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142214+0000","last_change":"2023-11-18T23:42:10.142299+0000","last_active":"2023-11-18T23:42:11.142214+0000","last_peered":"2023-11-18T23:42:11.142214+0000","last_clean":"2023-11-18T23:42:11.142214+0000","last_became_active":"2023-11-18T23:42:10.142049+0000","last_became_peered":"2023-11-18T23:42:10.142049+0000","last_unstale":"2023-11-18T23:42:11.142214+0000","last_undegraded":"2023-11-18T23:42:11.142214+0000","last_fullsized":"2023-11-18T23:42:11.142214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:08:55.339722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136676+0000","last_change":"2023-11-18T23:42:10.152178+0000","last_active":"2023-11-18T23:42:11.136676+0000","last_peered":"2023-11-18T23:42:11.136676+0000","last_clean":"2023-11-18T23:42:11.136676+0000","last_became_active":"2023-11-18T23:42:10.151798+0000","last_became_peered":"2023-11-18T23:42:10.151798+0000","last_unstale":"2023-11-18T23:42:11.136676+0000","last_undegraded":"2023-11-18T23:42:11.136676+0000","last_fullsized":"2023-11-18T23:42:11.136676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:06:13.503767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.411068+0000","last_change":"2023-11-18T23:42:10.154089+0000","last_active":"2023-11-18T23:42:11.411068+0000","last_peered":"2023-11-18T23:42:11.411068+0000","last_clean":"2023-11-18T23:42:11.411068+0000","last_became_active":"2023-11-18T23:42:10.153702+0000","last_became_peered":"2023-11-18T23:42:10.153702+0000","last_unstale":"2023-11-18T23:42:11.411068+0000","last_undegraded":"2023-11-18T23:42:11.411068+0000","last_fullsized":"2023-11-18T23:42:11.411068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:40.064892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410822+0000","last_change":"2023-11-18T23:42:10.149125+0000","last_active":"2023-11-18T23:42:11.410822+0000","last_peered":"2023-11-18T23:42:11.410822+0000","last_clean":"2023-11-18T23:42:11.410822+0000","last_became_active":"2023-11-18T23:42:10.148737+0000","last_became_peered":"2023-11-18T23:42:10.148737+0000","last_unstale":"2023-11-18T23:42:11.410822+0000","last_undegraded":"2023-11-18T23:42:11.410822+0000","last_fullsized":"2023-11-18T23:42:11.410822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:52:04.755279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409421+0000","last_change":"2023-11-18T23:42:10.144570+0000","last_active":"2023-11-18T23:42:11.409421+0000","last_peered":"2023-11-18T23:42:11.409421+0000","last_clean":"2023-11-18T23:42:11.409421+0000","last_became_active":"2023-11-18T23:42:10.144319+0000","last_became_peered":"2023-11-18T23:42:10.144319+0000","last_unstale":"2023-11-18T23:42:11.409421+0000","last_undegraded":"2023-11-18T23:42:11.409421+0000","last_fullsized":"2023-11-18T23:42:11.409421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:32.175759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141136+0000","last_change":"2023-11-18T23:42:10.140367+0000","last_active":"2023-11-18T23:42:11.141136+0000","last_peered":"2023-11-18T23:42:11.141136+0000","last_clean":"2023-11-18T23:42:11.141136+0000","last_became_active":"2023-11-18T23:42:10.140078+0000","last_became_peered":"2023-11-18T23:42:10.140078+0000","last_unstale":"2023-11-18T23:42:11.141136+0000","last_undegraded":"2023-11-18T23:42:11.141136+0000","last_fullsized":"2023-11-18T23:42:11.141136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:47.811619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410242+0000","last_change":"2023-11-18T23:42:10.147060+0000","last_active":"2023-11-18T23:42:11.410242+0000","last_peered":"2023-11-18T23:42:11.410242+0000","last_clean":"2023-11-18T23:42:11.410242+0000","last_became_active":"2023-11-18T23:42:10.146109+0000","last_became_peered":"2023-11-18T23:42:10.146109+0000","last_unstale":"2023-11-18T23:42:11.410242+0000","last_undegraded":"2023-11-18T23:42:11.410242+0000","last_fullsized":"2023-11-18T23:42:11.410242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:32:39.513782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142471+0000","last_change":"2023-11-18T23:42:10.144175+0000","last_active":"2023-11-18T23:42:11.142471+0000","last_peered":"2023-11-18T23:42:11.142471+0000","last_clean":"2023-11-18T23:42:11.142471+0000","last_became_active":"2023-11-18T23:42:10.143892+0000","last_became_peered":"2023-11-18T23:42:10.143892+0000","last_unstale":"2023-11-18T23:42:11.142471+0000","last_undegraded":"2023-11-18T23:42:11.142471+0000","last_fullsized":"2023-11-18T23:42:11.142471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:39:35.353964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410187+0000","last_change":"2023-11-18T23:42:10.147708+0000","last_active":"2023-11-18T23:42:11.410187+0000","last_peered":"2023-11-18T23:42:11.410187+0000","last_clean":"2023-11-18T23:42:11.410187+0000","last_became_active":"2023-11-18T23:42:10.147460+0000","last_became_peered":"2023-11-18T23:42:10.147460+0000","last_unstale":"2023-11-18T23:42:11.410187+0000","last_undegraded":"2023-11-18T23:42:11.410187+0000","last_fullsized":"2023-11-18T23:42:11.410187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:47.811619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141436+0000","last_change":"2023-11-18T23:42:10.148847+0000","last_active":"2023-11-18T23:42:11.141436+0000","last_peered":"2023-11-18T23:42:11.141436+0000","last_clean":"2023-11-18T23:42:11.141436+0000","last_became_active":"2023-11-18T23:42:10.148595+0000","last_became_peered":"2023-11-18T23:42:10.148595+0000","last_unstale":"2023-11-18T23:42:11.141436+0000","last_undegraded":"2023-11-18T23:42:11.141436+0000","last_fullsized":"2023-11-18T23:42:11.141436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:12.351763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.411070+0000","last_change":"2023-11-18T23:42:10.153732+0000","last_active":"2023-11-18T23:42:11.411070+0000","last_peered":"2023-11-18T23:42:11.411070+0000","last_clean":"2023-11-18T23:42:11.411070+0000","last_became_active":"2023-11-18T23:42:10.152390+0000","last_became_peered":"2023-11-18T23:42:10.152390+0000","last_unstale":"2023-11-18T23:42:11.411070+0000","last_undegraded":"2023-11-18T23:42:11.411070+0000","last_fullsized":"2023-11-18T23:42:11.411070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:06:37.321468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409881+0000","last_change":"2023-11-18T23:42:10.146876+0000","last_active":"2023-11-18T23:42:11.409881+0000","last_peered":"2023-11-18T23:42:11.409881+0000","last_clean":"2023-11-18T23:42:11.409881+0000","last_became_active":"2023-11-18T23:42:10.146332+0000","last_became_peered":"2023-11-18T23:42:10.146332+0000","last_unstale":"2023-11-18T23:42:11.409881+0000","last_undegraded":"2023-11-18T23:42:11.409881+0000","last_fullsized":"2023-11-18T23:42:11.409881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.745622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410091+0000","last_change":"2023-11-18T23:42:10.146525+0000","last_active":"2023-11-18T23:42:11.410091+0000","last_peered":"2023-11-18T23:42:11.410091+0000","last_clean":"2023-11-18T23:42:11.410091+0000","last_became_active":"2023-11-18T23:42:10.146131+0000","last_became_peered":"2023-11-18T23:42:10.146131+0000","last_unstale":"2023-11-18T23:42:11.410091+0000","last_undegraded":"2023-11-18T23:42:11.410091+0000","last_fullsized":"2023-11-18T23:42:11.410091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:38.098051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410439+0000","last_change":"2023-11-18T23:42:10.148568+0000","last_active":"2023-11-18T23:42:11.410439+0000","last_peered":"2023-11-18T23:42:11.410439+0000","last_clean":"2023-11-18T23:42:11.410439+0000","last_became_active":"2023-11-18T23:42:10.147754+0000","last_became_peered":"2023-11-18T23:42:10.147754+0000","last_unstale":"2023-11-18T23:42:11.410439+0000","last_undegraded":"2023-11-18T23:42:11.410439+0000","last_fullsized":"2023-11-18T23:42:11.410439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:08:55.339722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409783+0000","last_change":"2023-11-18T23:42:10.145264+0000","last_active":"2023-11-18T23:42:11.409783+0000","last_peered":"2023-11-18T23:42:11.409783+0000","last_clean":"2023-11-18T23:42:11.409783+0000","last_became_active":"2023-11-18T23:42:10.144991+0000","last_became_peered":"2023-11-18T23:42:10.144991+0000","last_unstale":"2023-11-18T23:42:11.409783+0000","last_undegraded":"2023-11-18T23:42:11.409783+0000","last_fullsized":"2023-11-18T23:42:11.409783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:02:52.588537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.153290+0000","last_change":"2023-11-18T23:42:09.124322+0000","last_active":"2023-11-18T23:42:10.153290+0000","last_peered":"2023-11-18T23:42:10.153290+0000","last_clean":"2023-11-18T23:42:10.153290+0000","last_became_active":"2023-11-18T23:42:09.123983+0000","last_became_peered":"2023-11-18T23:42:09.123983+0000","last_unstale":"2023-11-18T23:42:10.153290+0000","last_undegraded":"2023-11-18T23:42:10.153290+0000","last_fullsized":"2023-11-18T23:42:10.153290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:44:16.047638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410667+0000","last_change":"2023-11-18T23:42:10.149316+0000","last_active":"2023-11-18T23:42:11.410667+0000","last_peered":"2023-11-18T23:42:11.410667+0000","last_clean":"2023-11-18T23:42:11.410667+0000","last_became_active":"2023-11-18T23:42:10.149058+0000","last_became_peered":"2023-11-18T23:42:10.149058+0000","last_unstale":"2023-11-18T23:42:11.410667+0000","last_undegraded":"2023-11-18T23:42:11.410667+0000","last_fullsized":"2023-11-18T23:42:11.410667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:09.178151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.152735+0000","last_change":"2023-11-18T23:42:09.124193+0000","last_active":"2023-11-18T23:42:10.152735+0000","last_peered":"2023-11-18T23:42:10.152735+0000","last_clean":"2023-11-18T23:42:10.152735+0000","last_became_active":"2023-11-18T23:42:09.123930+0000","last_became_peered":"2023-11-18T23:42:09.123930+0000","last_unstale":"2023-11-18T23:42:10.152735+0000","last_undegraded":"2023-11-18T23:42:10.152735+0000","last_fullsized":"2023-11-18T23:42:10.152735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:50:53.205301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.411144+0000","last_change":"2023-11-18T23:42:10.151846+0000","last_active":"2023-11-18T23:42:11.411144+0000","last_peered":"2023-11-18T23:42:11.411144+0000","last_clean":"2023-11-18T23:42:11.411144+0000","last_became_active":"2023-11-18T23:42:10.151469+0000","last_became_peered":"2023-11-18T23:42:10.151469+0000","last_unstale":"2023-11-18T23:42:11.411144+0000","last_undegraded":"2023-11-18T23:42:11.411144+0000","last_fullsized":"2023-11-18T23:42:11.411144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:12:36.805065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.160133+0000","last_change":"2023-11-18T23:42:09.119257+0000","last_active":"2023-11-18T23:42:10.160133+0000","last_peered":"2023-11-18T23:42:10.160133+0000","last_clean":"2023-11-18T23:42:10.160133+0000","last_became_active":"2023-11-18T23:42:09.118993+0000","last_became_peered":"2023-11-18T23:42:09.118993+0000","last_unstale":"2023-11-18T23:42:10.160133+0000","last_undegraded":"2023-11-18T23:42:10.160133+0000","last_fullsized":"2023-11-18T23:42:10.160133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:06:36.317691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410306+0000","last_change":"2023-11-18T23:42:10.147036+0000","last_active":"2023-11-18T23:42:11.410306+0000","last_peered":"2023-11-18T23:42:11.410306+0000","last_clean":"2023-11-18T23:42:11.410306+0000","last_became_active":"2023-11-18T23:42:10.146719+0000","last_became_peered":"2023-11-18T23:42:10.146719+0000","last_unstale":"2023-11-18T23:42:11.410306+0000","last_undegraded":"2023-11-18T23:42:11.410306+0000","last_fullsized":"2023-11-18T23:42:11.410306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:40:24.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.158817+0000","last_change":"2023-11-18T23:42:09.132063+0000","last_active":"2023-11-18T23:42:10.158817+0000","last_peered":"2023-11-18T23:42:10.158817+0000","last_clean":"2023-11-18T23:42:10.158817+0000","last_became_active":"2023-11-18T23:42:09.131759+0000","last_became_peered":"2023-11-18T23:42:09.131759+0000","last_unstale":"2023-11-18T23:42:10.158817+0000","last_undegraded":"2023-11-18T23:42:10.158817+0000","last_fullsized":"2023-11-18T23:42:10.158817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:49:51.090306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410344+0000","last_change":"2023-11-18T23:42:10.147905+0000","last_active":"2023-11-18T23:42:11.410344+0000","last_peered":"2023-11-18T23:42:11.410344+0000","last_clean":"2023-11-18T23:42:11.410344+0000","last_became_active":"2023-11-18T23:42:10.147452+0000","last_became_peered":"2023-11-18T23:42:10.147452+0000","last_unstale":"2023-11-18T23:42:11.410344+0000","last_undegraded":"2023-11-18T23:42:11.410344+0000","last_fullsized":"2023-11-18T23:42:11.410344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:47.919823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.160386+0000","last_change":"2023-11-18T23:42:09.128976+0000","last_active":"2023-11-18T23:42:10.160386+0000","last_peered":"2023-11-18T23:42:10.160386+0000","last_clean":"2023-11-18T23:42:10.160386+0000","last_became_active":"2023-11-18T23:42:09.128703+0000","last_became_peered":"2023-11-18T23:42:09.128703+0000","last_unstale":"2023-11-18T23:42:10.160386+0000","last_undegraded":"2023-11-18T23:42:10.160386+0000","last_fullsized":"2023-11-18T23:42:10.160386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:37.094273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141299+0000","last_change":"2023-11-18T23:42:10.159232+0000","last_active":"2023-11-18T23:42:11.141299+0000","last_peered":"2023-11-18T23:42:11.141299+0000","last_clean":"2023-11-18T23:42:11.141299+0000","last_became_active":"2023-11-18T23:42:10.158909+0000","last_became_peered":"2023-11-18T23:42:10.158909+0000","last_unstale":"2023-11-18T23:42:11.141299+0000","last_undegraded":"2023-11-18T23:42:11.141299+0000","last_fullsized":"2023-11-18T23:42:11.141299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:40:24.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.157595+0000","last_change":"2023-11-18T23:42:09.128935+0000","last_active":"2023-11-18T23:42:10.157595+0000","last_peered":"2023-11-18T23:42:10.157595+0000","last_clean":"2023-11-18T23:42:10.157595+0000","last_became_active":"2023-11-18T23:42:09.128674+0000","last_became_peered":"2023-11-18T23:42:09.128674+0000","last_unstale":"2023-11-18T23:42:10.157595+0000","last_undegraded":"2023-11-18T23:42:10.157595+0000","last_fullsized":"2023-11-18T23:42:10.157595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:50:53.205301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409953+0000","last_change":"2023-11-18T23:42:10.153281+0000","last_active":"2023-11-18T23:42:11.409953+0000","last_peered":"2023-11-18T23:42:11.409953+0000","last_clean":"2023-11-18T23:42:11.409953+0000","last_became_active":"2023-11-18T23:42:10.153021+0000","last_became_peered":"2023-11-18T23:42:10.153021+0000","last_unstale":"2023-11-18T23:42:11.409953+0000","last_undegraded":"2023-11-18T23:42:11.409953+0000","last_fullsized":"2023-11-18T23:42:11.409953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:09.178151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.131808+0000","last_change":"2023-11-18T23:42:09.126286+0000","last_active":"2023-11-18T23:42:10.131808+0000","last_peered":"2023-11-18T23:42:10.131808+0000","last_clean":"2023-11-18T23:42:10.131808+0000","last_became_active":"2023-11-18T23:42:09.125954+0000","last_became_peered":"2023-11-18T23:42:09.125954+0000","last_unstale":"2023-11-18T23:42:10.131808+0000","last_undegraded":"2023-11-18T23:42:10.131808+0000","last_fullsized":"2023-11-18T23:42:10.131808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:31.171982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409617+0000","last_change":"2023-11-18T23:42:10.152958+0000","last_active":"2023-11-18T23:42:11.409617+0000","last_peered":"2023-11-18T23:42:11.409617+0000","last_clean":"2023-11-18T23:42:11.409617+0000","last_became_active":"2023-11-18T23:42:10.152693+0000","last_became_peered":"2023-11-18T23:42:10.152693+0000","last_unstale":"2023-11-18T23:42:11.409617+0000","last_undegraded":"2023-11-18T23:42:11.409617+0000","last_fullsized":"2023-11-18T23:42:11.409617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:52:04.755279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.134663+0000","last_change":"2023-11-18T23:42:09.128072+0000","last_active":"2023-11-18T23:42:10.134663+0000","last_peered":"2023-11-18T23:42:10.134663+0000","last_clean":"2023-11-18T23:42:10.134663+0000","last_became_active":"2023-11-18T23:42:09.127750+0000","last_became_peered":"2023-11-18T23:42:09.127750+0000","last_unstale":"2023-11-18T23:42:10.134663+0000","last_undegraded":"2023-11-18T23:42:10.134663+0000","last_fullsized":"2023-11-18T23:42:10.134663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:48.727187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141612+0000","last_change":"2023-11-18T23:42:10.143672+0000","last_active":"2023-11-18T23:42:11.141612+0000","last_peered":"2023-11-18T23:42:11.141612+0000","last_clean":"2023-11-18T23:42:11.141612+0000","last_became_active":"2023-11-18T23:42:10.143424+0000","last_became_peered":"2023-11-18T23:42:10.143424+0000","last_unstale":"2023-11-18T23:42:11.141612+0000","last_undegraded":"2023-11-18T23:42:11.141612+0000","last_fullsized":"2023-11-18T23:42:11.141612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:08:55.339722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.132331+0000","last_change":"2023-11-18T23:42:09.125706+0000","last_active":"2023-11-18T23:42:10.132331+0000","last_peered":"2023-11-18T23:42:10.132331+0000","last_clean":"2023-11-18T23:42:10.132331+0000","last_became_active":"2023-11-18T23:42:09.125122+0000","last_became_peered":"2023-11-18T23:42:09.125122+0000","last_unstale":"2023-11-18T23:42:10.132331+0000","last_undegraded":"2023-11-18T23:42:10.132331+0000","last_fullsized":"2023-11-18T23:42:10.132331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:02:51.584760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142329+0000","last_change":"2023-11-18T23:42:10.157693+0000","last_active":"2023-11-18T23:42:11.142329+0000","last_peered":"2023-11-18T23:42:11.142329+0000","last_clean":"2023-11-18T23:42:11.142329+0000","last_became_active":"2023-11-18T23:42:10.157029+0000","last_became_peered":"2023-11-18T23:42:10.157029+0000","last_unstale":"2023-11-18T23:42:11.142329+0000","last_undegraded":"2023-11-18T23:42:11.142329+0000","last_fullsized":"2023-11-18T23:42:11.142329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:36.721476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.131248+0000","last_change":"2023-11-18T23:42:09.129215+0000","last_active":"2023-11-18T23:42:10.131248+0000","last_peered":"2023-11-18T23:42:10.131248+0000","last_clean":"2023-11-18T23:42:10.131248+0000","last_became_active":"2023-11-18T23:42:09.128920+0000","last_became_peered":"2023-11-18T23:42:09.128920+0000","last_unstale":"2023-11-18T23:42:10.131248+0000","last_undegraded":"2023-11-18T23:42:10.131248+0000","last_fullsized":"2023-11-18T23:42:10.131248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:06:12.499990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142460+0000","last_change":"2023-11-18T23:42:10.142858+0000","last_active":"2023-11-18T23:42:11.142460+0000","last_peered":"2023-11-18T23:42:11.142460+0000","last_clean":"2023-11-18T23:42:11.142460+0000","last_became_active":"2023-11-18T23:42:10.142605+0000","last_became_peered":"2023-11-18T23:42:10.142605+0000","last_unstale":"2023-11-18T23:42:11.142460+0000","last_undegraded":"2023-11-18T23:42:11.142460+0000","last_fullsized":"2023-11-18T23:42:11.142460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:44:28.430657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.153111+0000","last_change":"2023-11-18T23:42:09.127463+0000","last_active":"2023-11-18T23:42:10.153111+0000","last_peered":"2023-11-18T23:42:10.153111+0000","last_clean":"2023-11-18T23:42:10.153111+0000","last_became_active":"2023-11-18T23:42:09.127127+0000","last_became_peered":"2023-11-18T23:42:09.127127+0000","last_unstale":"2023-11-18T23:42:10.153111+0000","last_undegraded":"2023-11-18T23:42:10.153111+0000","last_fullsized":"2023-11-18T23:42:10.153111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:06:36.317691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141482+0000","last_change":"2023-11-18T23:42:10.154895+0000","last_active":"2023-11-18T23:42:11.141482+0000","last_peered":"2023-11-18T23:42:11.141482+0000","last_clean":"2023-11-18T23:42:11.141482+0000","last_became_active":"2023-11-18T23:42:10.154618+0000","last_became_peered":"2023-11-18T23:42:10.154618+0000","last_unstale":"2023-11-18T23:42:11.141482+0000","last_undegraded":"2023-11-18T23:42:11.141482+0000","last_fullsized":"2023-11-18T23:42:11.141482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:40:47.919823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.162096+0000","last_change":"2023-11-18T23:42:09.127247+0000","last_active":"2023-11-18T23:42:10.162096+0000","last_peered":"2023-11-18T23:42:10.162096+0000","last_clean":"2023-11-18T23:42:10.162096+0000","last_became_active":"2023-11-18T23:42:09.127001+0000","last_became_peered":"2023-11-18T23:42:09.127001+0000","last_unstale":"2023-11-18T23:42:10.162096+0000","last_undegraded":"2023-11-18T23:42:10.162096+0000","last_fullsized":"2023-11-18T23:42:10.162096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:40:23.431484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409682+0000","last_change":"2023-11-18T23:42:10.154540+0000","last_active":"2023-11-18T23:42:11.409682+0000","last_peered":"2023-11-18T23:42:11.409682+0000","last_clean":"2023-11-18T23:42:11.409682+0000","last_became_active":"2023-11-18T23:42:10.154248+0000","last_became_peered":"2023-11-18T23:42:10.154248+0000","last_unstale":"2023-11-18T23:42:11.409682+0000","last_undegraded":"2023-11-18T23:42:11.409682+0000","last_fullsized":"2023-11-18T23:42:11.409682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:07:40.064892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.159099+0000","last_change":"2023-11-18T23:42:09.127098+0000","last_active":"2023-11-18T23:42:10.159099+0000","last_peered":"2023-11-18T23:42:10.159099+0000","last_clean":"2023-11-18T23:42:10.159099+0000","last_became_active":"2023-11-18T23:42:09.126828+0000","last_became_peered":"2023-11-18T23:42:09.126828+0000","last_unstale":"2023-11-18T23:42:10.159099+0000","last_undegraded":"2023-11-18T23:42:10.159099+0000","last_fullsized":"2023-11-18T23:42:10.159099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:28:53.106825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.142241+0000","last_change":"2023-11-18T23:42:10.154321+0000","last_active":"2023-11-18T23:42:11.142241+0000","last_peered":"2023-11-18T23:42:11.142241+0000","last_clean":"2023-11-18T23:42:11.142241+0000","last_became_active":"2023-11-18T23:42:10.153783+0000","last_became_peered":"2023-11-18T23:42:10.153783+0000","last_unstale":"2023-11-18T23:42:11.142241+0000","last_undegraded":"2023-11-18T23:42:11.142241+0000","last_fullsized":"2023-11-18T23:42:11.142241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:18:22.493531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.136224+0000","last_change":"2023-11-18T23:42:09.128433+0000","last_active":"2023-11-18T23:42:10.136224+0000","last_peered":"2023-11-18T23:42:10.136224+0000","last_clean":"2023-11-18T23:42:10.136224+0000","last_became_active":"2023-11-18T23:42:09.128154+0000","last_became_peered":"2023-11-18T23:42:09.128154+0000","last_unstale":"2023-11-18T23:42:10.136224+0000","last_undegraded":"2023-11-18T23:42:10.136224+0000","last_fullsized":"2023-11-18T23:42:10.136224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:44:16.047638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410564+0000","last_change":"2023-11-18T23:42:10.148401+0000","last_active":"2023-11-18T23:42:11.410564+0000","last_peered":"2023-11-18T23:42:11.410564+0000","last_clean":"2023-11-18T23:42:11.410564+0000","last_became_active":"2023-11-18T23:42:10.148112+0000","last_became_peered":"2023-11-18T23:42:10.148112+0000","last_unstale":"2023-11-18T23:42:11.410564+0000","last_undegraded":"2023-11-18T23:42:11.410564+0000","last_fullsized":"2023-11-18T23:42:11.410564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:18:22.493531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.131648+0000","last_change":"2023-11-18T23:42:09.125596+0000","last_active":"2023-11-18T23:42:10.131648+0000","last_peered":"2023-11-18T23:42:10.131648+0000","last_clean":"2023-11-18T23:42:10.131648+0000","last_became_active":"2023-11-18T23:42:09.125084+0000","last_became_peered":"2023-11-18T23:42:09.125084+0000","last_unstale":"2023-11-18T23:42:10.131648+0000","last_undegraded":"2023-11-18T23:42:10.131648+0000","last_fullsized":"2023-11-18T23:42:10.131648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:28:53.106825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410161+0000","last_change":"2023-11-18T23:42:10.149957+0000","last_active":"2023-11-18T23:42:11.410161+0000","last_peered":"2023-11-18T23:42:11.410161+0000","last_clean":"2023-11-18T23:42:11.410161+0000","last_became_active":"2023-11-18T23:42:10.149637+0000","last_became_peered":"2023-11-18T23:42:10.149637+0000","last_unstale":"2023-11-18T23:42:11.410161+0000","last_undegraded":"2023-11-18T23:42:11.410161+0000","last_fullsized":"2023-11-18T23:42:11.410161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:28:54.110602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.160583+0000","last_change":"2023-11-18T23:42:09.118202+0000","last_active":"2023-11-18T23:42:10.160583+0000","last_peered":"2023-11-18T23:42:10.160583+0000","last_clean":"2023-11-18T23:42:10.160583+0000","last_became_active":"2023-11-18T23:42:09.117933+0000","last_became_peered":"2023-11-18T23:42:09.117933+0000","last_unstale":"2023-11-18T23:42:10.160583+0000","last_undegraded":"2023-11-18T23:42:10.160583+0000","last_fullsized":"2023-11-18T23:42:10.160583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:46.807841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.411181+0000","last_change":"2023-11-18T23:42:10.154901+0000","last_active":"2023-11-18T23:42:11.411181+0000","last_peered":"2023-11-18T23:42:11.411181+0000","last_clean":"2023-11-18T23:42:11.411181+0000","last_became_active":"2023-11-18T23:42:10.154622+0000","last_became_peered":"2023-11-18T23:42:10.154622+0000","last_unstale":"2023-11-18T23:42:11.411181+0000","last_undegraded":"2023-11-18T23:42:11.411181+0000","last_fullsized":"2023-11-18T23:42:11.411181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.745622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.150134+0000","last_change":"2023-11-18T23:42:09.125525+0000","last_active":"2023-11-18T23:42:10.150134+0000","last_peered":"2023-11-18T23:42:10.150134+0000","last_clean":"2023-11-18T23:42:10.150134+0000","last_became_active":"2023-11-18T23:42:09.125266+0000","last_became_peered":"2023-11-18T23:42:09.125266+0000","last_unstale":"2023-11-18T23:42:10.150134+0000","last_undegraded":"2023-11-18T23:42:10.150134+0000","last_fullsized":"2023-11-18T23:42:10.150134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:58.994546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141709+0000","last_change":"2023-11-18T23:42:10.155950+0000","last_active":"2023-11-18T23:42:11.141709+0000","last_peered":"2023-11-18T23:42:11.141709+0000","last_clean":"2023-11-18T23:42:11.141709+0000","last_became_active":"2023-11-18T23:42:10.155659+0000","last_became_peered":"2023-11-18T23:42:10.155659+0000","last_unstale":"2023-11-18T23:42:11.141709+0000","last_undegraded":"2023-11-18T23:42:11.141709+0000","last_fullsized":"2023-11-18T23:42:11.141709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:18:22.493531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.158814+0000","last_change":"2023-11-18T23:42:09.127728+0000","last_active":"2023-11-18T23:42:10.158814+0000","last_peered":"2023-11-18T23:42:10.158814+0000","last_clean":"2023-11-18T23:42:10.158814+0000","last_became_active":"2023-11-18T23:42:09.127475+0000","last_became_peered":"2023-11-18T23:42:09.127475+0000","last_unstale":"2023-11-18T23:42:10.158814+0000","last_undegraded":"2023-11-18T23:42:10.158814+0000","last_fullsized":"2023-11-18T23:42:10.158814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:06:12.499990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410042+0000","last_change":"2023-11-18T23:42:10.145573+0000","last_active":"2023-11-18T23:42:11.410042+0000","last_peered":"2023-11-18T23:42:11.410042+0000","last_clean":"2023-11-18T23:42:11.410042+0000","last_became_active":"2023-11-18T23:42:10.145253+0000","last_became_peered":"2023-11-18T23:42:10.145253+0000","last_unstale":"2023-11-18T23:42:11.410042+0000","last_undegraded":"2023-11-18T23:42:11.410042+0000","last_fullsized":"2023-11-18T23:42:11.410042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.745622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.156323+0000","last_change":"2023-11-18T23:42:09.123637+0000","last_active":"2023-11-18T23:42:10.156323+0000","last_peered":"2023-11-18T23:42:10.156323+0000","last_clean":"2023-11-18T23:42:10.156323+0000","last_became_active":"2023-11-18T23:42:09.123334+0000","last_became_peered":"2023-11-18T23:42:09.123334+0000","last_unstale":"2023-11-18T23:42:10.156323+0000","last_undegraded":"2023-11-18T23:42:10.156323+0000","last_fullsized":"2023-11-18T23:42:10.156323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:53:02.981349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136563+0000","last_change":"2023-11-18T23:42:10.141333+0000","last_active":"2023-11-18T23:42:11.136563+0000","last_peered":"2023-11-18T23:42:11.136563+0000","last_clean":"2023-11-18T23:42:11.136563+0000","last_became_active":"2023-11-18T23:42:10.141038+0000","last_became_peered":"2023-11-18T23:42:10.141038+0000","last_unstale":"2023-11-18T23:42:11.136563+0000","last_undegraded":"2023-11-18T23:42:11.136563+0000","last_fullsized":"2023-11-18T23:42:11.136563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:16.651771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.142698+0000","last_change":"2023-11-18T23:42:09.125853+0000","last_active":"2023-11-18T23:42:10.142698+0000","last_peered":"2023-11-18T23:42:10.142698+0000","last_clean":"2023-11-18T23:42:10.142698+0000","last_became_active":"2023-11-18T23:42:09.125607+0000","last_became_peered":"2023-11-18T23:42:09.125607+0000","last_unstale":"2023-11-18T23:42:10.142698+0000","last_undegraded":"2023-11-18T23:42:10.142698+0000","last_fullsized":"2023-11-18T23:42:10.142698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:31.171982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136582+0000","last_change":"2023-11-18T23:42:10.152723+0000","last_active":"2023-11-18T23:42:11.136582+0000","last_peered":"2023-11-18T23:42:11.136582+0000","last_clean":"2023-11-18T23:42:11.136582+0000","last_became_active":"2023-11-18T23:42:10.152461+0000","last_became_peered":"2023-11-18T23:42:10.152461+0000","last_unstale":"2023-11-18T23:42:11.136582+0000","last_undegraded":"2023-11-18T23:42:11.136582+0000","last_fullsized":"2023-11-18T23:42:11.136582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:53:00.815305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.156125+0000","last_change":"2023-11-18T23:42:09.129788+0000","last_active":"2023-11-18T23:42:10.156125+0000","last_peered":"2023-11-18T23:42:10.156125+0000","last_clean":"2023-11-18T23:42:10.156125+0000","last_became_active":"2023-11-18T23:42:09.129464+0000","last_became_peered":"2023-11-18T23:42:09.129464+0000","last_unstale":"2023-11-18T23:42:10.156125+0000","last_undegraded":"2023-11-18T23:42:10.156125+0000","last_fullsized":"2023-11-18T23:42:10.156125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:37.094273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136642+0000","last_change":"2023-11-18T23:42:10.135550+0000","last_active":"2023-11-18T23:42:11.136642+0000","last_peered":"2023-11-18T23:42:11.136642+0000","last_clean":"2023-11-18T23:42:11.136642+0000","last_became_active":"2023-11-18T23:42:10.135253+0000","last_became_peered":"2023-11-18T23:42:10.135253+0000","last_unstale":"2023-11-18T23:42:11.136642+0000","last_undegraded":"2023-11-18T23:42:11.136642+0000","last_fullsized":"2023-11-18T23:42:11.136642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:43.984429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.135628+0000","last_change":"2023-11-18T23:42:09.130084+0000","last_active":"2023-11-18T23:42:10.135628+0000","last_peered":"2023-11-18T23:42:10.135628+0000","last_clean":"2023-11-18T23:42:10.135628+0000","last_became_active":"2023-11-18T23:42:09.129765+0000","last_became_peered":"2023-11-18T23:42:09.129765+0000","last_unstale":"2023-11-18T23:42:10.135628+0000","last_undegraded":"2023-11-18T23:42:10.135628+0000","last_fullsized":"2023-11-18T23:42:10.135628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:06:12.499990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136463+0000","last_change":"2023-11-18T23:42:10.135464+0000","last_active":"2023-11-18T23:42:11.136463+0000","last_peered":"2023-11-18T23:42:11.136463+0000","last_clean":"2023-11-18T23:42:11.136463+0000","last_became_active":"2023-11-18T23:42:10.134968+0000","last_became_peered":"2023-11-18T23:42:10.134968+0000","last_unstale":"2023-11-18T23:42:11.136463+0000","last_undegraded":"2023-11-18T23:42:11.136463+0000","last_fullsized":"2023-11-18T23:42:11.136463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:49:09.080037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.137989+0000","last_change":"2023-11-18T23:42:09.129580+0000","last_active":"2023-11-18T23:42:10.137989+0000","last_peered":"2023-11-18T23:42:10.137989+0000","last_clean":"2023-11-18T23:42:10.137989+0000","last_became_active":"2023-11-18T23:42:09.129332+0000","last_became_peered":"2023-11-18T23:42:09.129332+0000","last_unstale":"2023-11-18T23:42:10.137989+0000","last_undegraded":"2023-11-18T23:42:10.137989+0000","last_fullsized":"2023-11-18T23:42:10.137989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:11:33.477658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410006+0000","last_change":"2023-11-18T23:42:10.150531+0000","last_active":"2023-11-18T23:42:11.410006+0000","last_peered":"2023-11-18T23:42:11.410006+0000","last_clean":"2023-11-18T23:42:11.410006+0000","last_became_active":"2023-11-18T23:42:10.150211+0000","last_became_peered":"2023-11-18T23:42:10.150211+0000","last_unstale":"2023-11-18T23:42:11.410006+0000","last_undegraded":"2023-11-18T23:42:11.410006+0000","last_fullsized":"2023-11-18T23:42:11.410006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:32:39.513782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.134187+0000","last_change":"2023-11-18T23:42:09.124809+0000","last_active":"2023-11-18T23:42:10.134187+0000","last_peered":"2023-11-18T23:42:10.134187+0000","last_clean":"2023-11-18T23:42:10.134187+0000","last_became_active":"2023-11-18T23:42:09.124514+0000","last_became_peered":"2023-11-18T23:42:09.124514+0000","last_unstale":"2023-11-18T23:42:10.134187+0000","last_undegraded":"2023-11-18T23:42:10.134187+0000","last_fullsized":"2023-11-18T23:42:10.134187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:37.094273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.136605+0000","last_change":"2023-11-18T23:42:10.137234+0000","last_active":"2023-11-18T23:42:11.136605+0000","last_peered":"2023-11-18T23:42:11.136605+0000","last_clean":"2023-11-18T23:42:11.136605+0000","last_became_active":"2023-11-18T23:42:10.136957+0000","last_became_peered":"2023-11-18T23:42:10.136957+0000","last_unstale":"2023-11-18T23:42:11.136605+0000","last_undegraded":"2023-11-18T23:42:11.136605+0000","last_fullsized":"2023-11-18T23:42:11.136605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:50:54.209078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.154070+0000","last_change":"2023-11-18T23:42:09.122685+0000","last_active":"2023-11-18T23:42:10.154070+0000","last_peered":"2023-11-18T23:42:10.154070+0000","last_clean":"2023-11-18T23:42:10.154070+0000","last_became_active":"2023-11-18T23:42:09.122389+0000","last_became_peered":"2023-11-18T23:42:09.122389+0000","last_unstale":"2023-11-18T23:42:10.154070+0000","last_undegraded":"2023-11-18T23:42:10.154070+0000","last_fullsized":"2023-11-18T23:42:10.154070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:08.174374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141724+0000","last_change":"2023-11-18T23:42:10.143847+0000","last_active":"2023-11-18T23:42:11.141724+0000","last_peered":"2023-11-18T23:42:11.141724+0000","last_clean":"2023-11-18T23:42:11.141724+0000","last_became_active":"2023-11-18T23:42:10.143153+0000","last_became_peered":"2023-11-18T23:42:10.143153+0000","last_unstale":"2023-11-18T23:42:11.141724+0000","last_undegraded":"2023-11-18T23:42:11.141724+0000","last_fullsized":"2023-11-18T23:42:11.141724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:36.721476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409861+0000","last_change":"2023-11-18T23:42:09.122202+0000","last_active":"2023-11-18T23:42:11.409861+0000","last_peered":"2023-11-18T23:42:11.409861+0000","last_clean":"2023-11-18T23:42:11.409861+0000","last_became_active":"2023-11-18T23:42:09.121943+0000","last_became_peered":"2023-11-18T23:42:09.121943+0000","last_unstale":"2023-11-18T23:42:11.409861+0000","last_undegraded":"2023-11-18T23:42:11.409861+0000","last_fullsized":"2023-11-18T23:42:11.409861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:42.980652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409711+0000","last_change":"2023-11-18T23:42:10.142208+0000","last_active":"2023-11-18T23:42:11.409711+0000","last_peered":"2023-11-18T23:42:11.409711+0000","last_clean":"2023-11-18T23:42:11.409711+0000","last_became_active":"2023-11-18T23:42:10.141881+0000","last_became_peered":"2023-11-18T23:42:10.141881+0000","last_unstale":"2023-11-18T23:42:11.409711+0000","last_undegraded":"2023-11-18T23:42:11.409711+0000","last_fullsized":"2023-11-18T23:42:11.409711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:59.998324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.137767+0000","last_change":"2023-11-18T23:42:09.126718+0000","last_active":"2023-11-18T23:42:10.137767+0000","last_peered":"2023-11-18T23:42:10.137767+0000","last_clean":"2023-11-18T23:42:10.137767+0000","last_became_active":"2023-11-18T23:42:09.126170+0000","last_became_peered":"2023-11-18T23:42:09.126170+0000","last_unstale":"2023-11-18T23:42:10.137767+0000","last_undegraded":"2023-11-18T23:42:10.137767+0000","last_fullsized":"2023-11-18T23:42:10.137767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:02:51.584760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410356+0000","last_change":"2023-11-18T23:42:10.151225+0000","last_active":"2023-11-18T23:42:11.410356+0000","last_peered":"2023-11-18T23:42:11.410356+0000","last_clean":"2023-11-18T23:42:11.410356+0000","last_became_active":"2023-11-18T23:42:10.150990+0000","last_became_peered":"2023-11-18T23:42:10.150990+0000","last_unstale":"2023-11-18T23:42:11.410356+0000","last_undegraded":"2023-11-18T23:42:11.410356+0000","last_fullsized":"2023-11-18T23:42:11.410356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:32:32.175759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.131486+0000","last_change":"2023-11-18T23:42:09.121990+0000","last_active":"2023-11-18T23:42:10.131486+0000","last_peered":"2023-11-18T23:42:10.131486+0000","last_clean":"2023-11-18T23:42:10.131486+0000","last_became_active":"2023-11-18T23:42:09.121549+0000","last_became_peered":"2023-11-18T23:42:09.121549+0000","last_unstale":"2023-11-18T23:42:10.131486+0000","last_undegraded":"2023-11-18T23:42:10.131486+0000","last_fullsized":"2023-11-18T23:42:10.131486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:28:53.106825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409728+0000","last_change":"2023-11-18T23:42:10.151163+0000","last_active":"2023-11-18T23:42:11.409728+0000","last_peered":"2023-11-18T23:42:11.409728+0000","last_clean":"2023-11-18T23:42:11.409728+0000","last_became_active":"2023-11-18T23:42:10.150865+0000","last_became_peered":"2023-11-18T23:42:10.150865+0000","last_unstale":"2023-11-18T23:42:11.409728+0000","last_undegraded":"2023-11-18T23:42:11.409728+0000","last_fullsized":"2023-11-18T23:42:11.409728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:09.178151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.136317+0000","last_change":"2023-11-18T23:42:09.122975+0000","last_active":"2023-11-18T23:42:10.136317+0000","last_peered":"2023-11-18T23:42:10.136317+0000","last_clean":"2023-11-18T23:42:10.136317+0000","last_became_active":"2023-11-18T23:42:09.120956+0000","last_became_peered":"2023-11-18T23:42:09.120956+0000","last_unstale":"2023-11-18T23:42:10.136317+0000","last_undegraded":"2023-11-18T23:42:10.136317+0000","last_fullsized":"2023-11-18T23:42:10.136317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:37.094273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.141974+0000","last_change":"2023-11-18T23:42:10.141440+0000","last_active":"2023-11-18T23:42:11.141974+0000","last_peered":"2023-11-18T23:42:11.141974+0000","last_clean":"2023-11-18T23:42:11.141974+0000","last_became_active":"2023-11-18T23:42:10.141167+0000","last_became_peered":"2023-11-18T23:42:10.141167+0000","last_unstale":"2023-11-18T23:42:11.141974+0000","last_undegraded":"2023-11-18T23:42:11.141974+0000","last_fullsized":"2023-11-18T23:42:11.141974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:01:12.351763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.138024+0000","last_change":"2023-11-18T23:42:09.122546+0000","last_active":"2023-11-18T23:42:10.138024+0000","last_peered":"2023-11-18T23:42:10.138024+0000","last_clean":"2023-11-18T23:42:10.138024+0000","last_became_active":"2023-11-18T23:42:09.122252+0000","last_became_peered":"2023-11-18T23:42:09.122252+0000","last_unstale":"2023-11-18T23:42:10.138024+0000","last_undegraded":"2023-11-18T23:42:10.138024+0000","last_fullsized":"2023-11-18T23:42:10.138024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:15.647994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.410560+0000","last_change":"2023-11-18T23:42:10.158005+0000","last_active":"2023-11-18T23:42:11.410560+0000","last_peered":"2023-11-18T23:42:11.410560+0000","last_clean":"2023-11-18T23:42:11.410560+0000","last_became_active":"2023-11-18T23:42:10.157735+0000","last_became_peered":"2023-11-18T23:42:10.157735+0000","last_unstale":"2023-11-18T23:42:11.410560+0000","last_undegraded":"2023-11-18T23:42:11.410560+0000","last_fullsized":"2023-11-18T23:42:11.410560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:02:52.588537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.133324+0000","last_change":"2023-11-18T23:42:09.126626+0000","last_active":"2023-11-18T23:42:10.133324+0000","last_peered":"2023-11-18T23:42:10.133324+0000","last_clean":"2023-11-18T23:42:10.133324+0000","last_became_active":"2023-11-18T23:42:09.126318+0000","last_became_peered":"2023-11-18T23:42:09.126318+0000","last_unstale":"2023-11-18T23:42:10.133324+0000","last_undegraded":"2023-11-18T23:42:10.133324+0000","last_fullsized":"2023-11-18T23:42:10.133324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:12:35.801287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-18T23:42:11.409921+0000","last_change":"2023-11-18T23:42:10.142513+0000","last_active":"2023-11-18T23:42:11.409921+0000","last_peered":"2023-11-18T23:42:11.409921+0000","last_clean":"2023-11-18T23:42:11.409921+0000","last_became_active":"2023-11-18T23:42:10.142242+0000","last_became_peered":"2023-11-18T23:42:10.142242+0000","last_unstale":"2023-11-18T23:42:11.409921+0000","last_undegraded":"2023-11-18T23:42:11.409921+0000","last_fullsized":"2023-11-18T23:42:11.409921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:09.106124+0000","last_clean_scrub_stamp":"2023-11-18T23:42:09.106124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:47.811619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.134822+0000","last_change":"2023-11-18T23:42:09.125302+0000","last_active":"2023-11-18T23:42:10.134822+0000","last_peered":"2023-11-18T23:42:10.134822+0000","last_clean":"2023-11-18T23:42:10.134822+0000","last_became_active":"2023-11-18T23:42:09.124920+0000","last_became_peered":"2023-11-18T23:42:09.124920+0000","last_unstale":"2023-11-18T23:42:10.134822+0000","last_undegraded":"2023-11-18T23:42:10.134822+0000","last_fullsized":"2023-11-18T23:42:10.134822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:42:08.102347+0000","last_clean_scrub_stamp":"2023-11-18T23:42:08.102347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:15.647994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-18T23:42:10.137933+0000","last_change":"2023-11-18T23:41:00.349917+0000","last_active":"2023-11-18T23:42:10.137933+0000","last_peered":"2023-11-18T23:42:10.137933+0000","last_clean":"2023-11-18T23:42:10.137933+0000","last_became_active":"2023-11-18T23:41:00.348954+0000","last_became_peered":"2023-11-18T23:41:00.348954+0000","last_unstale":"2023-11-18T23:42:10.137933+0000","last_undegraded":"2023-11-18T23:42:10.137933+0000","last_fullsized":"2023-11-18T23:42:10.137933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T23:40:59.309788+0000","last_clean_scrub_stamp":"2023-11-18T23:40:59.309788+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:04.598263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":737122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.626},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.441}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.372},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.5}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.41499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64000000000000001}]},{"osd":2,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.62},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48699999999999999}]},{"osd":7,"last update":"Sat Nov 18 23:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.502}]},{"osd":3,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52700000000000002}]},{"osd":4,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58399999999999996}]},{"osd":7,"last update":"Sat Nov 18 23:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.433}]},{"osd":2,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58599999999999997}]},{"osd":5,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69299999999999995}]},{"osd":7,"last update":"Sat Nov 18 23:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":148298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.28599999999999998}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.377},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.42199999999999999}]},{"osd":2,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.47799999999999998}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.70799999999999996}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":146734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.315}]},{"osd":1,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.254},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.379}]},{"osd":4,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.498},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Nov 18 23:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.56799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":148298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.46400000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.626}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":737032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.52600000000000002}]},{"osd":2,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.504},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77400000000000002}]},{"osd":5,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.79900000000000004}]},{"osd":7,"last update":"Sat Nov 18 23:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T23:42:17.922 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T23:42:17.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-18T23:42:18.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.070+0000 7f6915c2d640 1 Processor -- start 2023-11-18T23:42:18.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.070+0000 7f6915c2d640 1 -- start start 2023-11-18T23:42:18.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f6915c2d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6910160b70 0x7f69100d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f6915c2d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f6915c2d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69100ce360 con 0x7f69100b2aa0 2023-11-18T23:42:18.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f6915c2d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69100b2f20 con 0x7f6910160b70 2023-11-18T23:42:18.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f6915c2d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69100cdd50 con 0x7f69100cef00 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f690f7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6910160b70 0x7f69100d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f690effd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f69100b2aa0 0x7f69100ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58518/0 (socket says 172.21.15.8:58518) 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.071+0000 7f690effd640 1 -- 172.21.15.8:0/1590913257 learned_addr learned my addr 172.21.15.8:0/1590913257 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.072+0000 7f690ffff640 1 --2- 172.21.15.8:0/1590913257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.072+0000 7f690f7fe640 1 -- 172.21.15.8:0/1590913257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 msgr2=0x7f6910161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.072+0000 7f690f7fe640 1 --2- 172.21.15.8:0/1590913257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.072+0000 7f690f7fe640 1 -- 172.21.15.8:0/1590913257 >> v1:172.21.15.8:6789/0 conn(0x7f69100b2aa0 legacy=0x7f69100ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.072+0000 7f690f7fe640 1 -- 172.21.15.8:0/1590913257 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100d1c70 con 0x7f6910160b70 2023-11-18T23:42:18.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.072+0000 7f690e7fc640 1 -- 172.21.15.8:0/1590913257 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983040498 0 0) 0x7f69100ce360 con 0x7f69100b2aa0 2023-11-18T23:42:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.072+0000 7f690f7fe640 1 --2- 172.21.15.8:0/1590913257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f69100d1570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f69000097a0 tx=0x7f690002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777294ada935c711 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f690e7fc640 1 -- 172.21.15.8:0/1590913257 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900031830 con 0x7f6910160b70 2023-11-18T23:42:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f690e7fc640 1 -- 172.21.15.8:0/1590913257 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900031990 con 0x7f6910160b70 2023-11-18T23:42:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f690e7fc640 1 -- 172.21.15.8:0/1590913257 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900031d20 con 0x7f6910160b70 2023-11-18T23:42:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 -- 172.21.15.8:0/1590913257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 msgr2=0x7f69100d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 --2- 172.21.15.8:0/1590913257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f69100d1570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f69000097a0 tx=0x7f690002b8d0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 -- 172.21.15.8:0/1590913257 shutdown_connections 2023-11-18T23:42:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 --2- 172.21.15.8:0/1590913257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 --2- 172.21.15.8:0/1590913257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f69100d1570 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 -- 172.21.15.8:0/1590913257 >> 172.21.15.8:0/1590913257 conn(0x7f691009c470 msgr2=0x7f69100d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 -- 172.21.15.8:0/1590913257 shutdown_connections 2023-11-18T23:42:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.073+0000 7f6915c2d640 1 -- 172.21.15.8:0/1590913257 wait complete. 2023-11-18T23:42:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.074+0000 7f6915c2d640 1 Processor -- start 2023-11-18T23:42:18.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f6915c2d640 1 -- start start 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f6915c2d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69100b2aa0 0x7f6910159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f6915c2d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f6915c2d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f6910158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f6915c2d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69100cc7c0 con 0x7f6910160b70 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f6915c2d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69100cca10 con 0x7f69100b2aa0 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f6915c2d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69100cccf0 con 0x7f69100cef00 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f690ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f6910158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f690ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f6910158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48314/0 (socket says 172.21.15.8:48314) 2023-11-18T23:42:18.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.075+0000 7f690ffff640 1 -- 172.21.15.8:0/3877829059 learned_addr learned my addr 172.21.15.8:0/3877829059 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690effd640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690f7fe640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69100b2aa0 0x7f6910159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690ffff640 1 -- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 msgr2=0x7f6910158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690ffff640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690ffff640 1 -- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69100b2aa0 msgr2=0x7f6910159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690ffff640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69100b2aa0 0x7f6910159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690ffff640 1 -- 172.21.15.8:0/3877829059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6900009400 con 0x7f6910160b70 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690f7fe640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69100b2aa0 0x7f6910159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f690ffff640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f6910158b60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6908007e60 tx=0x7f690800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f68f7fff640 1 -- 172.21.15.8:0/3877829059 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908014420 con 0x7f6910160b70 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f68f7fff640 1 -- 172.21.15.8:0/3877829059 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69080145a0 con 0x7f6910160b70 2023-11-18T23:42:18.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69100ccfd0 con 0x7f6910160b70 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f68f7fff640 1 -- 172.21.15.8:0/3877829059 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908014950 con 0x7f6910160b70 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.076+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6910159ac0 con 0x7f6910160b70 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.077+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6910159c80 con 0x7f6910160b70 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.078+0000 7f68f7fff640 1 -- 172.21.15.8:0/3877829059 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6908014ab0 con 0x7f6910160b70 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.078+0000 7f68f7fff640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f68fc06ae40 0x7f68fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.078+0000 7f68f7fff640 1 -- 172.21.15.8:0/3877829059 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6908089e60 con 0x7f6910160b70 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.078+0000 7f690f7fe640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f68fc06ae40 0x7f68fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.079+0000 7f690f7fe640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f68fc06ae40 0x7f68fc06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6900036000 tx=0x7f6900008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:18.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.082+0000 7f68f7fff640 1 -- 172.21.15.8:0/3877829059 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6908054fa0 con 0x7f6910160b70 2023-11-18T23:42:18.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.332+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f69100a1150 con 0x7f6910160b70 2023-11-18T23:42:18.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.334+0000 7f68f7fff640 1 -- 172.21.15.8:0/3877829059 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f69080585c0 con 0x7f6910160b70 2023-11-18T23:42:18.336 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-11-18T23:42:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfS1llAtO6HhAAmnJ2CjYeVW/+aFk46V8/ag== 2023-11-18T23:42:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: caps mds = "allow" 2023-11-18T23:42:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: caps mon = "allow r" 2023-11-18T23:42:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-18T23:42:18.337 INFO:teuthology.orchestra.run.smithi008.stderr:updated caps for client.0 2023-11-18T23:42:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.336+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f68fc06ae40 msgr2=0x7f68fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.336+0000 7f6915c2d640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f68fc06ae40 0x7f68fc06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6900036000 tx=0x7f6900008030 comp rx=0 tx=0).stop 2023-11-18T23:42:18.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.336+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 msgr2=0x7f6910158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.336+0000 7f6915c2d640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f6910158b60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6908007e60 tx=0x7f690800e4b0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 shutdown_connections 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f68fc06ae40 0x7f68fc06d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6910160b70 0x7f6910158b60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69100cef00 0x7f6910158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 --2- 172.21.15.8:0/3877829059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69100b2aa0 0x7f6910159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 >> 172.21.15.8:0/3877829059 conn(0x7f691009c470 msgr2=0x7f691006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 shutdown_connections 2023-11-18T23:42:18.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.337+0000 7f6915c2d640 1 -- 172.21.15.8:0/3877829059 wait complete. 2023-11-18T23:42:18.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T23:42:18.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.453+0000 7f914900e640 1 Processor -- start 2023-11-18T23:42:18.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.453+0000 7f914900e640 1 -- start start 2023-11-18T23:42:18.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f914900e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f914415d3e0 0x7f91440ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f914900e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f91440ced30 0x7f91440d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f914900e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440b5f90 con 0x7f91440d1c60 2023-11-18T23:42:18.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f914900e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440cf170 con 0x7f914415d3e0 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f914900e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440d20d0 con 0x7f91440ced30 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f9142d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f914415d3e0 0x7f91440ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f914359e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f91440d1c60 0x7f91440b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:58528/0 (socket says 172.21.15.8:58528) 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.454+0000 7f914359e640 1 -- 172.21.15.8:0/3801290179 learned_addr learned my addr 172.21.15.8:0/3801290179 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.455+0000 7f914259c640 1 --2- 172.21.15.8:0/3801290179 >> v2:172.21.15.116:3300/0 conn(0x7f91440ced30 0x7f91440d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.455+0000 7f9142d9d640 1 -- 172.21.15.8:0/3801290179 >> v2:172.21.15.116:3300/0 conn(0x7f91440ced30 msgr2=0x7f91440d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.455+0000 7f9142d9d640 1 --2- 172.21.15.8:0/3801290179 >> v2:172.21.15.116:3300/0 conn(0x7f91440ced30 0x7f91440d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.455+0000 7f9142d9d640 1 -- 172.21.15.8:0/3801290179 >> v1:172.21.15.8:6789/0 conn(0x7f91440d1c60 legacy=0x7f91440b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.455+0000 7f9141d9b640 1 -- 172.21.15.8:0/3801290179 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758740487 0 0) 0x7f91440b5f90 con 0x7f91440d1c60 2023-11-18T23:42:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.455+0000 7f9142d9d640 1 -- 172.21.15.8:0/3801290179 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440b61e0 con 0x7f914415d3e0 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f9142d9d640 1 --2- 172.21.15.8:0/3801290179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914415d3e0 0x7f91440ce7f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9144073d50 tx=0x7f913c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef9a0ab71640bc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f9141d9b640 1 -- 172.21.15.8:0/3801290179 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c031830 con 0x7f914415d3e0 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f9141d9b640 1 -- 172.21.15.8:0/3801290179 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c031990 con 0x7f914415d3e0 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f9141d9b640 1 -- 172.21.15.8:0/3801290179 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c031d20 con 0x7f914415d3e0 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 -- 172.21.15.8:0/3801290179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914415d3e0 msgr2=0x7f91440ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 --2- 172.21.15.8:0/3801290179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914415d3e0 0x7f91440ce7f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9144073d50 tx=0x7f913c02b8d0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 -- 172.21.15.8:0/3801290179 shutdown_connections 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 --2- 172.21.15.8:0/3801290179 >> v2:172.21.15.116:3300/0 conn(0x7f91440ced30 0x7f91440d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 --2- 172.21.15.8:0/3801290179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f914415d3e0 0x7f91440ce7f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 -- 172.21.15.8:0/3801290179 >> 172.21.15.8:0/3801290179 conn(0x7f914409c480 msgr2=0x7f91440d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:18.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 -- 172.21.15.8:0/3801290179 shutdown_connections 2023-11-18T23:42:18.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.456+0000 7f914900e640 1 -- 172.21.15.8:0/3801290179 wait complete. 2023-11-18T23:42:18.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.458+0000 7f914900e640 1 Processor -- start 2023-11-18T23:42:18.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.458+0000 7f914900e640 1 -- start start 2023-11-18T23:42:18.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.458+0000 7f914900e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91440ced30 0x7f9144151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.458+0000 7f914900e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91440d1c60 0x7f9144151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.458+0000 7f914900e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f914415d3e0 0x7f914414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.458+0000 7f914900e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91440a02b0 con 0x7f91440d1c60 2023-11-18T23:42:18.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914900e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91440ccc60 con 0x7f91440ced30 2023-11-18T23:42:18.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914900e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914414c370 con 0x7f914415d3e0 2023-11-18T23:42:18.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91440d1c60 0x7f9144151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91440d1c60 0x7f9144151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48328/0 (socket says 172.21.15.8:48328) 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 -- 172.21.15.8:0/1156354610 learned_addr learned my addr 172.21.15.8:0/1156354610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f9142d9d640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91440ced30 0x7f9144151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914359e640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f914415d3e0 0x7f914414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 -- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f914415d3e0 msgr2=0x7f914414ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f914415d3e0 0x7f914414ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 -- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91440ced30 msgr2=0x7f9144151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91440ced30 0x7f9144151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 -- 172.21.15.8:0/1156354610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c009400 con 0x7f91440d1c60 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914259c640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91440d1c60 0x7f9144151640 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c7f0 tx=0x7f912c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f913b7fe640 1 -- 172.21.15.8:0/1156354610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c004220 con 0x7f91440d1c60 2023-11-18T23:42:18.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f913b7fe640 1 -- 172.21.15.8:0/1156354610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c0043a0 con 0x7f91440d1c60 2023-11-18T23:42:18.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f913b7fe640 1 -- 172.21.15.8:0/1156354610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c007860 con 0x7f91440d1c60 2023-11-18T23:42:18.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91440cc980 con 0x7f91440d1c60 2023-11-18T23:42:18.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.459+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914414c000 con 0x7f91440d1c60 2023-11-18T23:42:18.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.460+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91440d0000 con 0x7f91440d1c60 2023-11-18T23:42:18.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.461+0000 7f913b7fe640 1 -- 172.21.15.8:0/1156354610 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f912c0079c0 con 0x7f91440d1c60 2023-11-18T23:42:18.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.461+0000 7f913b7fe640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f912406ae40 0x7f912406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:18.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.461+0000 7f913b7fe640 1 -- 172.21.15.8:0/1156354610 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f912c0893f0 con 0x7f91440d1c60 2023-11-18T23:42:18.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.461+0000 7f9142d9d640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f912406ae40 0x7f912406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:18.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.462+0000 7f9142d9d640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f912406ae40 0x7f912406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f913c036000 tx=0x7f913c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:18.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.466+0000 7f913b7fe640 1 -- 172.21.15.8:0/1156354610 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f912c054490 con 0x7f91440d1c60 2023-11-18T23:42:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.677+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9144067420 con 0x7f91440d1c60 2023-11-18T23:42:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.678+0000 7f913b7fe640 1 -- 172.21.15.8:0/1156354610 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f912c057ab0 con 0x7f91440d1c60 2023-11-18T23:42:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:18.679 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2766026998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6835","nonce":2766026998},{"type":"v1","addr":"172.21.15.116:6837","nonce":2766026998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6836/2655733368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":2655733368},{"type":"v1","addr":"172.21.15.116:6836","nonce":2655733368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5050,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/3557217311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3557217311},{"type":"v1","addr":"172.21.15.8:6834","nonce":3557217311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T23:42:09.482337+0000","modified":"2023-11-18T23:42:11.495128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5053":{"gid":5053,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6835/3317836505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":3317836505},{"type":"v1","addr":"172.21.15.8:6835","nonce":3317836505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-18T23:42:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 15 2023-11-18T23:42:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f912406ae40 msgr2=0x7f912406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f912406ae40 0x7f912406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f913c036000 tx=0x7f913c03c040 comp rx=0 tx=0).stop 2023-11-18T23:42:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91440d1c60 msgr2=0x7f9144151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91440d1c60 0x7f9144151640 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c7f0 tx=0x7f912c00ccb0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 shutdown_connections 2023-11-18T23:42:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f912406ae40 0x7f912406d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f914415d3e0 0x7f914414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91440d1c60 0x7f9144151640 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 --2- 172.21.15.8:0/1156354610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91440ced30 0x7f9144151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 >> 172.21.15.8:0/1156354610 conn(0x7f914409c480 msgr2=0x7f91440ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 shutdown_connections 2023-11-18T23:42:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:18.680+0000 7f914900e640 1 -- 172.21.15.8:0/1156354610 wait complete. 2023-11-18T23:42:19.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T23:42:09.482337+0000', 'modified': '2023-11-18T23:42:11.495128+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5053}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5053': {'gid': 5053, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.8:6835/3317836505', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6833', 'nonce': 3317836505}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 3317836505}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T23:42:19.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T23:42:19.094 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-18T23:42:19.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.205+0000 7fc4412bb640 1 Processor -- start 2023-11-18T23:42:19.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.205+0000 7fc4412bb640 1 -- start start 2023-11-18T23:42:19.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.205+0000 7fc4412bb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc43c0b3440 0x7fc43c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.205+0000 7fc4412bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c160d70 0x7fc43c161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.205+0000 7fc4412bb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0b38d0 con 0x7fc43c06f0d0 2023-11-18T23:42:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.205+0000 7fc4412bb640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c161760 con 0x7fc43c0b3440 2023-11-18T23:42:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.205+0000 7fc4412bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0adda0 con 0x7fc43c160d70 2023-11-18T23:42:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc433fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc43c0b3440 0x7fc43c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc43affd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc43c06f0d0 0x7fc43c0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.8:34152/0 (socket says 172.21.15.8:34152) 2023-11-18T23:42:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc43b7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c160d70 0x7fc43c161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc43affd640 1 -- 172.21.15.8:0/3282615005 learned_addr learned my addr 172.21.15.8:0/3282615005 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc43a7fc640 1 -- 172.21.15.8:0/3282615005 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115162437 0 0) 0x7fc43c0b38d0 con 0x7fc43c06f0d0 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc43a7fc640 1 -- 172.21.15.8:0/3282615005 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc428003520 con 0x7fc43c06f0d0 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc433fff640 1 -- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c160d70 msgr2=0x7fc43c161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc433fff640 1 --2- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c160d70 0x7fc43c161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc433fff640 1 -- 172.21.15.8:0/3282615005 >> v1:172.21.15.116:6789/0 conn(0x7fc43c06f0d0 legacy=0x7fc43c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc433fff640 1 -- 172.21.15.8:0/3282615005 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0b3bb0 con 0x7fc43c0b3440 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.206+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c160d70 0x7fc43c161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.207+0000 7fc433fff640 1 --2- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c0b3440 0x7fc43c0b4970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4240097d0 tx=0x7fc42402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee78544401eaee67 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.207+0000 7fc43a7fc640 1 -- 172.21.15.8:0/3282615005 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424031800 con 0x7fc43c0b3440 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.207+0000 7fc43a7fc640 1 -- 172.21.15.8:0/3282615005 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424031960 con 0x7fc43c0b3440 2023-11-18T23:42:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.207+0000 7fc43a7fc640 1 -- 172.21.15.8:0/3282615005 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424031cf0 con 0x7fc43c0b3440 2023-11-18T23:42:19.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 -- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c0b3440 msgr2=0x7fc43c0b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 --2- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c0b3440 0x7fc43c0b4970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4240097d0 tx=0x7fc42402b8a0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 -- 172.21.15.8:0/3282615005 shutdown_connections 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 --2- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c160d70 0x7fc43c161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 --2- 172.21.15.8:0/3282615005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c0b3440 0x7fc43c0b4970 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 -- 172.21.15.8:0/3282615005 >> 172.21.15.8:0/3282615005 conn(0x7fc43c0b1670 msgr2=0x7fc43c0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 -- 172.21.15.8:0/3282615005 shutdown_connections 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.208+0000 7fc4412bb640 1 -- 172.21.15.8:0/3282615005 wait complete. 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.209+0000 7fc4412bb640 1 Processor -- start 2023-11-18T23:42:19.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.209+0000 7fc4412bb640 1 -- start start 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc4412bb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c06f0d0 0x7fc43c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc4412bb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c160d70 0x7fc43c144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc4412bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c1e6bb0 0x7fc43c1e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc4412bb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1446c0 con 0x7fc43c160d70 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc4412bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1e7120 con 0x7fc43c1e6bb0 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc4412bb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1e7400 con 0x7fc43c06f0d0 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c160d70 0x7fc43c144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c160d70 0x7fc43c144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48344/0 (socket says 172.21.15.8:48344) 2023-11-18T23:42:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 -- 172.21.15.8:0/2541798295 learned_addr learned my addr 172.21.15.8:0/2541798295 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c1e6bb0 0x7fc43c1e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc43affd640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c06f0d0 0x7fc43c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 -- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c06f0d0 msgr2=0x7fc43c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c06f0d0 0x7fc43c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 -- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c1e6bb0 msgr2=0x7fc43c1e81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c1e6bb0 0x7fc43c1e81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 -- 172.21.15.8:0/2541798295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434009a70 con 0x7fc43c160d70 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.210+0000 7fc433fff640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c160d70 0x7fc43c144180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098f0 tx=0x7fc4240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.211+0000 7fc4337fe640 1 -- 172.21.15.8:0/2541798295 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42403bc70 con 0x7fc43c160d70 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.211+0000 7fc4337fe640 1 -- 172.21.15.8:0/2541798295 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42403be10 con 0x7fc43c160d70 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.211+0000 7fc4337fe640 1 -- 172.21.15.8:0/2541798295 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424045630 con 0x7fc43c160d70 2023-11-18T23:42:19.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.211+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc424009400 con 0x7fc43c160d70 2023-11-18T23:42:19.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.211+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c1e79c0 con 0x7fc43c160d70 2023-11-18T23:42:19.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.212+0000 7fc4337fe640 1 -- 172.21.15.8:0/2541798295 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc42404e450 con 0x7fc43c160d70 2023-11-18T23:42:19.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.212+0000 7fc4337fe640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc41c06ae70 0x7fc41c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.213+0000 7fc4337fe640 1 -- 172.21.15.8:0/2541798295 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc42402e070 con 0x7fc43c160d70 2023-11-18T23:42:19.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.213+0000 7fc43affd640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc41c06ae70 0x7fc41c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.213+0000 7fc43affd640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc41c06ae70 0x7fc41c06d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0011e0 tx=0x7fc42c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.213+0000 7fc443e54740 1 Processor -- start 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc443e54740 1 -- start start 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1d8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc443e54740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1a9070 0x56443f1d8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc443e54740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f1698c0 con 0x56443f1a9070 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f11bb90 con 0x56443f1d5f70 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443f119280 con 0x56443f1d5b90 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc43b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1a9070 0x56443f1d8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc43b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1a9070 0x56443f1d8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48360/0 (socket says 172.21.15.8:48360) 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.214+0000 7fc43b7fe640 1 -- 172.21.15.8:0/2208343870 learned_addr learned my addr 172.21.15.8:0/2208343870 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:19.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc43affd640 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc433fff640 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1d8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc43b7fe640 1 -- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 msgr2=0x56443f1a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1a8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc43b7fe640 1 -- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 msgr2=0x56443f1d8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1d8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc43b7fe640 1 -- 172.21.15.8:0/2208343870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443f0da500 con 0x56443f1a9070 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1a9070 0x56443f1d8e60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc434011660 tx=0x7fc434009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64626c1ee1c88b87 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc430ff9640 1 -- 172.21.15.8:0/2208343870 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400e040 con 0x56443f1a9070 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc430ff9640 1 -- 172.21.15.8:0/2208343870 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400f040 con 0x56443f1a9070 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.215+0000 7fc430ff9640 1 -- 172.21.15.8:0/2208343870 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434003dd0 con 0x56443f1a9070 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 -- 172.21.15.8:0/2208343870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1a9070 msgr2=0x56443f1d8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1a9070 0x56443f1d8e60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc434011660 tx=0x7fc434009750 comp rx=0 tx=0).stop 2023-11-18T23:42:19.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 -- 172.21.15.8:0/2208343870 shutdown_connections 2023-11-18T23:42:19.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1a9070 0x56443f1d8e60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1d8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 --2- 172.21.15.8:0/2208343870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 -- 172.21.15.8:0/2208343870 >> 172.21.15.8:0/2208343870 conn(0x56443f1aada0 msgr2=0x56443f1f3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 -- 172.21.15.8:0/2208343870 shutdown_connections 2023-11-18T23:42:19.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 -- 172.21.15.8:0/2208343870 wait complete. 2023-11-18T23:42:19.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.216+0000 7fc443e54740 1 -- start start 2023-11-18T23:42:19.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 1 Processor -- start 2023-11-18T23:42:19.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1dc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1eab40 0x56443f1eafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f114b70 con 0x56443f1eab40 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f0cee00 con 0x56443f1d5f70 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443f0ceaa0 con 0x56443f1d5b90 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc443e54740 10 client.0 _ll_register_callbacks cb 0x56443ee26ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc43b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1eab40 0x56443f1eafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc43b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1eab40 0x56443f1eafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48374/0 (socket says 172.21.15.8:48374) 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.217+0000 7fc43b7fe640 1 -- 172.21.15.8:0/3930543753 learned_addr learned my addr 172.21.15.8:0/3930543753 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc43affd640 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc433fff640 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1dc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc43b7fe640 1 -- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 msgr2=0x56443f1d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc43b7fe640 1 -- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 msgr2=0x56443f1dc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1dc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc43b7fe640 1 -- 172.21.15.8:0/3930543753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc434011310 con 0x56443f1eab40 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1eab40 0x56443f1eafc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc434018000 tx=0x7fc434004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b97b9f85e11710 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc419ffb640 1 -- 172.21.15.8:0/3930543753 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400e050 con 0x56443f1eab40 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56443f10db50 con 0x56443f1eab40 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc419ffb640 1 -- 172.21.15.8:0/3930543753 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc434015c70 con 0x56443f1eab40 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc419ffb640 1 -- 172.21.15.8:0/3930543753 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc434015e30 con 0x56443f1eab40 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc443e54740 10 client.5523 fetch_fsmap learned FSMap version 15 2023-11-18T23:42:19.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.218+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56443f1131f0 con 0x56443f1eab40 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc419ffb640 1 -- 172.21.15.8:0/3930543753 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56443f10db50 con 0x56443f1eab40 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc419ffb640 1 -- 172.21.15.8:0/3930543753 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc434004040 con 0x56443f1eab40 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc443e54740 10 client.5523 fetch_fsmap finished waiting for FSMap version 15 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc443e54740 10 client.5523 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc443e54740 20 client.5523 populate_metadata read hostname 'smithi008' 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc443e54740 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f1d7f80 0x56443f206f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc443e54740 4 client.5523 mds_command: new command op to 5053 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 --> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56443f10d870 con 0x56443f1d7f80 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc43affd640 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f1d7f80 0x56443f206f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc43affd640 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f1d7f80 0x56443f206f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa567150990914d server_cookie=5d20761707d14dc5 in_seq=0 out_seq=0 2023-11-18T23:42:19.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.219+0000 7fc419ffb640 10 client.5523 ms_handle_connect on v2:172.21.15.8:6833/3317836505 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc419ffb640 1 -- 172.21.15.8:0/3930543753 <== mds.0 v2:172.21.15.8:6833/3317836505 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56443f10d870 con 0x56443f1d7f80 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc419ffb640 10 client.5523 handle_command_reply: tid=0 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 client.5523 shutdown 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1eab40 msgr2=0x56443f1eafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1eab40 0x56443f1eafc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc434018000 tx=0x7fc434004ab0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 shutdown_connections 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f1d7f80 0x56443f206f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1eab40 0x56443f1eafc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5f70 0x56443f1dc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 --2- 172.21.15.8:0/3930543753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc419ffb640 0 client.5523 ms_handle_reset on v2:172.21.15.8:6833/3317836505 2023-11-18T23:42:19.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 >> 172.21.15.8:0/3930543753 conn(0x56443f1a9070 msgr2=0x56443f1acb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 shutdown_connections 2023-11-18T23:42:19.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 1 -- 172.21.15.8:0/3930543753 wait complete. 2023-11-18T23:42:19.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.220+0000 7fc443e54740 20 client.5523 trim_cache size 0 max 16384 2023-11-18T23:42:19.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 Processor -- start 2023-11-18T23:42:19.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 -- start start 2023-11-18T23:42:19.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1ac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1eab40 0x56443f1ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f094270 con 0x56443f1d5f70 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f1d6c20 con 0x56443f1eab40 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443f2165a0 con 0x56443f1d5b90 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc433fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc433fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48390/0 (socket says 172.21.15.8:48390) 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.236+0000 7fc433fff640 1 -- 172.21.15.8:0/3956518554 learned_addr learned my addr 172.21.15.8:0/3956518554 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc433fff640 1 -- 172.21.15.8:0/3956518554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 msgr2=0x56443f1ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc433fff640 1 --2- 172.21.15.8:0/3956518554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc433fff640 1 -- 172.21.15.8:0/3956518554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1eab40 msgr2=0x56443f1ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc433fff640 1 --2- 172.21.15.8:0/3956518554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1eab40 0x56443f1ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc433fff640 1 -- 172.21.15.8:0/3956518554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443f0b0d00 con 0x56443f1d5f70 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc433fff640 1 --2- 172.21.15.8:0/3956518554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1acbd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc4240768d0 tx=0x7fc4240ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27380b310428729 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc4317fa640 1 -- 172.21.15.8:0/3956518554 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42407a420 con 0x56443f1d5f70 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc4317fa640 1 -- 172.21.15.8:0/3956518554 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42407e570 con 0x56443f1d5f70 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.237+0000 7fc4317fa640 1 -- 172.21.15.8:0/3956518554 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424082720 con 0x56443f1d5f70 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 -- 172.21.15.8:0/3956518554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 msgr2=0x56443f1acbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 --2- 172.21.15.8:0/3956518554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1acbd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc4240768d0 tx=0x7fc4240ab040 comp rx=0 tx=0).stop 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 -- 172.21.15.8:0/3956518554 shutdown_connections 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 --2- 172.21.15.8:0/3956518554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1eab40 0x56443f1ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 --2- 172.21.15.8:0/3956518554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1acbd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 --2- 172.21.15.8:0/3956518554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1d5b90 0x56443f1ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 -- 172.21.15.8:0/3956518554 >> 172.21.15.8:0/3956518554 conn(0x56443f1a9070 msgr2=0x56443f1a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 -- 172.21.15.8:0/3956518554 shutdown_connections 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 -- 172.21.15.8:0/3956518554 wait complete. 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 -- start start 2023-11-18T23:42:19.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.238+0000 7fc443e54740 1 Processor -- start 2023-11-18T23:42:19.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5b90 0x56443f1eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc443e54740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc443e54740 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1eab40 0x56443f25db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc443e54740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f1f3b60 con 0x56443f1d5f70 2023-11-18T23:42:19.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443f25e060 con 0x56443f1d5b90 2023-11-18T23:42:19.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc443e54740 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443f1e9bb0 con 0x56443f1eab40 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc443e54740 10 client.0 _ll_register_callbacks cb 0x7fc434009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1e92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48398/0 (socket says 172.21.15.8:48398) 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 -- 172.21.15.8:0/498570622 learned_addr learned my addr 172.21.15.8:0/498570622 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1eab40 0x56443f25db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc43affd640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5b90 0x56443f1eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 -- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1eab40 msgr2=0x56443f25db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1eab40 0x56443f25db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 -- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5b90 msgr2=0x56443f1eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5b90 0x56443f1eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc433fff640 1 -- 172.21.15.8:0/498570622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c1e79c0 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc43b7fe640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1eab40 0x56443f25db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.239+0000 7fc43affd640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5b90 0x56443f1eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc433fff640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1e92b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc42407a120 tx=0x7fc4240a9ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c211bde1311cd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc419ffb640 1 -- 172.21.15.8:0/498570622 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42407a420 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc419ffb640 1 -- 172.21.15.8:0/498570622 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc424082720 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc43400f040 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc419ffb640 1 -- 172.21.15.8:0/498570622 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4240787c0 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 10 client.5529 fetch_fsmap learned FSMap version 15 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56443f0d64f0 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc419ffb640 1 -- 172.21.15.8:0/498570622 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400f040 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc419ffb640 1 -- 172.21.15.8:0/498570622 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc424080040 con 0x56443f1d5f70 2023-11-18T23:42:19.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 10 client.5529 fetch_fsmap finished waiting for FSMap version 15 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 10 client.5529 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 20 client.5529 populate_metadata read hostname 'smithi008' 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f208040 0x56443f208420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 4 client.5529 mds_command: new command op to 5053 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 --> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56443ee156c0 con 0x56443f208040 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.240+0000 7fc43affd640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f208040 0x56443f208420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc419ffb640 10 client.5529 ms_handle_connect on v2:172.21.15.8:6833/3317836505 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc43affd640 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f208040 0x56443f208420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a461cdff915975 server_cookie=9219e1e9fa186d0c in_seq=0 out_seq=0 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc419ffb640 1 -- 172.21.15.8:0/498570622 <== mds.0 v2:172.21.15.8:6833/3317836505 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56443ee156c0 con 0x56443f208040 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc419ffb640 10 client.5529 handle_command_reply: tid=0 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 client.5529 shutdown 2023-11-18T23:42:19.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 msgr2=0x56443f1e92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1e92b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc42407a120 tx=0x7fc4240a9ab0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 shutdown_connections 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:6833/3317836505,v1:172.21.15.8:6835/3317836505] conn(0x56443f208040 0x56443f208420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56443f1eab40 0x56443f25db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc419ffb640 0 client.5529 ms_handle_reset on v2:172.21.15.8:6833/3317836505 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56443f1d5f70 0x56443f1e92b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 --2- 172.21.15.8:0/498570622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56443f1d5b90 0x56443f1eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 >> 172.21.15.8:0/498570622 conn(0x56443f1a9070 msgr2=0x56443f1d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 shutdown_connections 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 1 -- 172.21.15.8:0/498570622 wait complete. 2023-11-18T23:42:19.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc443e54740 20 client.5529 trim_cache size 0 max 16384 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "45315d48-6a4a-4df1-b021-4a12da37b9ab", 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5053, 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 9.1169866919999993, 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 15, 2023-11-18T23:42:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 33, 2023-11-18T23:42:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 33, 2023-11-18T23:42:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 16.145916239999998 2023-11-18T23:42:19.251 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-11-18T23:42:19.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc41c06ae70 msgr2=0x7fc41c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.241+0000 7fc4412bb640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc41c06ae70 0x7fc41c06d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0011e0 tx=0x7fc42c007d30 comp rx=0 tx=0).stop 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c160d70 msgr2=0x7fc43c144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c160d70 0x7fc43c144180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098f0 tx=0x7fc4240046c0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 shutdown_connections 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7fc41c06ae70 0x7fc41c06d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc43c1e6bb0 0x7fc43c1e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c160d70 0x7fc43c144180 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 --2- 172.21.15.8:0/2541798295 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc43c06f0d0 0x7fc43c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 >> 172.21.15.8:0/2541798295 conn(0x7fc43c0b1670 msgr2=0x7fc43c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 shutdown_connections 2023-11-18T23:42:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.242+0000 7fc4412bb640 1 -- 172.21.15.8:0/2541798295 wait complete. 2023-11-18T23:42:19.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T23:42:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.359+0000 7f29eacb4640 1 Processor -- start 2023-11-18T23:42:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.359+0000 7f29eacb4640 1 -- start start 2023-11-18T23:42:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29eacb4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f29e4142d20 0x7f29e4071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29eacb4640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29eacb4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f29e406da60 0x7f29e40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29eacb4640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e406def0 con 0x7f29e406da60 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29eacb4640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e40b3130 con 0x7f29e4142d20 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29eacb4640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4143100 con 0x7f29e40b1df0 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f29e406da60 0x7f29e40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f29e406da60 0x7f29e40b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48414/0 (socket says 172.21.15.8:48414) 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 -- 172.21.15.8:0/322617274 learned_addr learned my addr 172.21.15.8:0/322617274 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e3fff640 1 --2- 172.21.15.8:0/322617274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e8a50640 1 --2- 172.21.15.8:0/322617274 >> v2:172.21.15.116:3300/0 conn(0x7f29e4142d20 0x7f29e4071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 -- 172.21.15.8:0/322617274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 msgr2=0x7f29e406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 --2- 172.21.15.8:0/322617274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e406d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 -- 172.21.15.8:0/322617274 >> v2:172.21.15.116:3300/0 conn(0x7f29e4142d20 msgr2=0x7f29e4071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:42:19.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 --2- 172.21.15.8:0/322617274 >> v2:172.21.15.116:3300/0 conn(0x7f29e4142d20 0x7f29e4071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e9251640 1 -- 172.21.15.8:0/322617274 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40b2250 con 0x7f29e406da60 2023-11-18T23:42:19.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.360+0000 7f29e8a50640 1 --2- 172.21.15.8:0/322617274 >> v2:172.21.15.116:3300/0 conn(0x7f29e4142d20 0x7f29e4071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:42:19.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.361+0000 7f29e9251640 1 --2- 172.21.15.8:0/322617274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e406da60 0x7f29e40b3b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f29e406ba70 tx=0x7f29dc02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6002af7521460c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.361+0000 7f29e37fe640 1 -- 172.21.15.8:0/322617274 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc02ea80 con 0x7f29e406da60 2023-11-18T23:42:19.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.361+0000 7f29e37fe640 1 -- 172.21.15.8:0/322617274 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc02ebe0 con 0x7f29e406da60 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.361+0000 7f29e37fe640 1 -- 172.21.15.8:0/322617274 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc009600 con 0x7f29e406da60 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 -- 172.21.15.8:0/322617274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e406da60 msgr2=0x7f29e40b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 --2- 172.21.15.8:0/322617274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e406da60 0x7f29e40b3b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f29e406ba70 tx=0x7f29dc02e0e0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 -- 172.21.15.8:0/322617274 shutdown_connections 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 --2- 172.21.15.8:0/322617274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e406da60 0x7f29e40b3b60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 --2- 172.21.15.8:0/322617274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e406d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 --2- 172.21.15.8:0/322617274 >> v2:172.21.15.116:3300/0 conn(0x7f29e4142d20 0x7f29e4071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 -- 172.21.15.8:0/322617274 >> 172.21.15.8:0/322617274 conn(0x7f29e40b0af0 msgr2=0x7f29e40b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 -- 172.21.15.8:0/322617274 shutdown_connections 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.362+0000 7f29eacb4640 1 -- 172.21.15.8:0/322617274 wait complete. 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.363+0000 7f29eacb4640 1 Processor -- start 2023-11-18T23:42:19.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.363+0000 7f29eacb4640 1 -- start start 2023-11-18T23:42:19.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29eacb4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f29e406da60 0x7f29e41594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29eacb4640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e413c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29eacb4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4142d20 0x7f29e413c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29eacb4640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e415b8e0 con 0x7f29e4142d20 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29eacb4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40ad6d0 con 0x7f29e406da60 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29eacb4640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40ae770 con 0x7f29e40b1df0 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4142d20 0x7f29e413c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4142d20 0x7f29e413c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48420/0 (socket says 172.21.15.8:48420) 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 -- 172.21.15.8:0/1525572592 learned_addr learned my addr 172.21.15.8:0/1525572592 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e3fff640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e413c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e8a50640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f29e406da60 0x7f29e41594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 -- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 msgr2=0x7f29e413c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e413c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 -- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f29e406da60 msgr2=0x7f29e41594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f29e406da60 0x7f29e41594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e9251640 1 -- 172.21.15.8:0/1525572592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc00bd40 con 0x7f29e4142d20 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e3fff640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e413c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.364+0000 7f29e8a50640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f29e406da60 0x7f29e41594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.365+0000 7f29e9251640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4142d20 0x7f29e413c620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00d240 tx=0x7f29dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.365+0000 7f29e17fa640 1 -- 172.21.15.8:0/1525572592 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc02ea80 con 0x7f29e4142d20 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.365+0000 7f29e17fa640 1 -- 172.21.15.8:0/1525572592 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc036820 con 0x7f29e4142d20 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.365+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e4159a30 con 0x7f29e4142d20 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.365+0000 7f29e17fa640 1 -- 172.21.15.8:0/1525572592 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc036bd0 con 0x7f29e4142d20 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.365+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e40acbf0 con 0x7f29e4142d20 2023-11-18T23:42:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.366+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e4067420 con 0x7f29e4142d20 2023-11-18T23:42:19.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.366+0000 7f29e17fa640 1 -- 172.21.15.8:0/1525572592 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29dc02ed50 con 0x7f29e4142d20 2023-11-18T23:42:19.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.367+0000 7f29e17fa640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f29c406ae40 0x7f29c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:42:19.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.367+0000 7f29e17fa640 1 -- 172.21.15.8:0/1525572592 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29dc0ac630 con 0x7f29e4142d20 2023-11-18T23:42:19.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.367+0000 7f29e8a50640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f29c406ae40 0x7f29c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:42:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.368+0000 7f29e8a50640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f29c406ae40 0x7f29c406d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29e406d9d0 tx=0x7f29d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:42:19.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.371+0000 7f29e17fa640 1 -- 172.21.15.8:0/1525572592 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29dc077810 con 0x7f29e4142d20 2023-11-18T23:42:19.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.584+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29e40719a0 con 0x7f29e4142d20 2023-11-18T23:42:19.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.584+0000 7f29e17fa640 1 -- 172.21.15.8:0/1525572592 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f29dc035e80 con 0x7f29e4142d20 2023-11-18T23:42:19.586 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f29c406ae40 msgr2=0x7f29c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f29c406ae40 0x7f29c406d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29e406d9d0 tx=0x7f29d4008040 comp rx=0 tx=0).stop 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4142d20 msgr2=0x7f29e413c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4142d20 0x7f29e413c620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00d240 tx=0x7f29dc004a40 comp rx=0 tx=0).stop 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 shutdown_connections 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f29c406ae40 0x7f29c406d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4142d20 0x7f29e413c620 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f29e40b1df0 0x7f29e413c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 --2- 172.21.15.8:0/1525572592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f29e406da60 0x7f29e41594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:42:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 >> 172.21.15.8:0/1525572592 conn(0x7f29e40b0af0 msgr2=0x7f29e4072010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:42:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 shutdown_connections 2023-11-18T23:42:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:19.586+0000 7f29eacb4640 1 -- 172.21.15.8:0/1525572592 wait complete. 2023-11-18T23:42:19.598 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T23:42:19.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T23:42:19.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-11-18T23:42:19.598 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T23:42:19.598 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T23:42:19.598 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T23:42:19.598 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T23:42:19.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T23:42:19.599 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T23:42:19.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:19.599 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-11-18T23:42:19.615 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42624sec preferred_lft 42624sec 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-11-18T23:42:19.616 INFO:teuthology.orchestra.run.smithi008.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 9e:71:02:ce:29:b9 brd ff:ff:ff:ff:ff:ff 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::6034:e4ff:feb6:ecb/64 scope link 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 9e:71:02:ce:29:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::9c71:2ff:fece:29b9/64 scope link 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether f2:20:94:9e:56:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::f020:94ff:fe9e:56ca/64 scope link 2023-11-18T23:42:19.617 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-11-18T23:42:19.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:19.618 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T23:42:19.685 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-11-18T23:42:19.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:19.686 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-11-18T23:42:19.742 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-11-18T23:42:19.742 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T23:42:19.742 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-18T23:42:19.742 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-18T23:42:19.742 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T23:42:19.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:19.743 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-11-18T23:42:19.743 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-11-18T23:42:19.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-18T23:42:19.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-18T23:42:19.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-18T23:42:19.743 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-11-18T23:42:19.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:19.848 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-11-18T23:42:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-18T23:42:19.863 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T23:42:19.863 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T23:42:19.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:19.863 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-11-18T23:42:19.933 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-18T23:42:19.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:42:19.934 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T23:42:19.989 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T23:42:19.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T23:42:19.990 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T23:42:20.045 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-11-18T23:42:20.116 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:42:20.171 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-11-18T23:42:20.171 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-11-18T23:42:20.171 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-11-18T23:42:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T23:42:20.173 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T23:42:20.174 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T23:42:20.174 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-11-18T23:42:20.174 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:42:20.174 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:42:20.174 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:42:20.174 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:42:20.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:20.175 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-11-18T23:42:20.230 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-18T23:42:20.230 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-18T23:42:20.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-11-18T23:42:20.302 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T23:42:20.359 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-11-18T23:42:20.359 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-11-18T23:42:20.359 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-11-18T23:42:20.359 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-11-18T23:42:20.359 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-11-18T23:42:20.359 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-11-18T23:42:20.359 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-11-18T23:42:20.360 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-11-18T23:42:20.361 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:42:20.362 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T23:42:20.362 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:42:20.362 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-18T23:42:20.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:20.362 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-11-18T23:42:20.365 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:2023-11-18T23:42:20.364+0000 7f2f5bc41480 -1 init, newargv = 0x55bb185f2420 newargc=15 2023-11-18T23:42:20.365 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[101198]: starting ceph client 2023-11-18T23:42:20.370 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[101198]: starting fuse 2023-11-18T23:42:20.381 INFO:teuthology.orchestra.run.smithi008.stdout:42 2023-11-18T23:42:20.381 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> sudo stdin-killer -- python3 -c ' 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> import re 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-18T23:42:20.382 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> return f 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T23:42:20.383 DEBUG:teuthology.orchestra.run.smithi008:> 2023-11-18T23:42:20.384 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.0")) 2023-11-18T23:42:20.384 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-11-18T23:42:20.507 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.0.101198.asok 2023-11-18T23:42:20.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T23:42:20.518 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.101198.asok 2023-11-18T23:42:20.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:20.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.101198.asok status 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "0", 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "101198", 2023-11-18T23:42:20.661 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5538, 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 5538 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-11-18T23:42:20.662 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3035828523 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3035828523 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.5538 192.168.0.1:0/3035828523", 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "192.168.0.1:0/3035828523", 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 15, 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 33, 2023-11-18T23:42:20.663 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2023-11-18T23:42:20.664 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2023-11-18T23:42:20.664 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2023-11-18T23:42:20.664 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-11-18T23:42:20.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:20.669 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2023-11-18T23:42:20.670 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-18T23:42:20.685 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2023-11-18T23:42:20.685 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-18T23:42:20.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:20.685 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T23:42:20.756 DEBUG:teuthology.orchestra.run.smithi008:> mktemp -d --suffix=xfstests-dev 2023-11-18T23:42:20.811 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.kYHL8e4YNuxfstests-dev 2023-11-18T23:42:20.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:20.811 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.kYHL8e4YNuxfstests-dev) 2023-11-18T23:42:20.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:20.883 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.kYHL8e4YNuxfstests-dev) 2023-11-18T23:42:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:Cloning into '/tmp/tmp.kYHL8e4YNuxfstests-dev'... 2023-11-18T23:42:21.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:21.666 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-18T23:42:21.727 DEBUG:teuthology.orchestra.run.smithi008:> mktemp -d --suffix=test 2023-11-18T23:42:21.782 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.hQpPz0d1gttest 2023-11-18T23:42:21.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:42:21.783 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-18T23:42:21.840 DEBUG:teuthology.orchestra.run.smithi008:> mktemp -d --suffix=scratch 2023-11-18T23:42:21.896 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.UZylhDXC2cscratch 2023-11-18T23:42:21.896 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-11-18T23:42:21.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-11-18T23:42:22.547 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:25 ago on Sat 18 Nov 2023 11:38:57 PM UTC. 2023-11-18T23:42:22.646 INFO:teuthology.orchestra.run.smithi008.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-11-18T23:42:22.647 INFO:teuthology.orchestra.run.smithi008.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-11-18T23:42:22.648 INFO:teuthology.orchestra.run.smithi008.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-11-18T23:42:22.649 INFO:teuthology.orchestra.run.smithi008.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-11-18T23:42:22.650 INFO:teuthology.orchestra.run.smithi008.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-11-18T23:42:22.652 INFO:teuthology.orchestra.run.smithi008.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-11-18T23:42:22.653 INFO:teuthology.orchestra.run.smithi008.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-11-18T23:42:22.654 INFO:teuthology.orchestra.run.smithi008.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-11-18T23:42:22.656 INFO:teuthology.orchestra.run.smithi008.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2023-11-18T23:42:22.659 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-11-18T23:42:22.660 INFO:teuthology.orchestra.run.smithi008.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-11-18T23:42:22.661 INFO:teuthology.orchestra.run.smithi008.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-11-18T23:42:22.662 INFO:teuthology.orchestra.run.smithi008.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-11-18T23:42:22.663 INFO:teuthology.orchestra.run.smithi008.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-11-18T23:42:22.664 INFO:teuthology.orchestra.run.smithi008.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-11-18T23:42:22.665 INFO:teuthology.orchestra.run.smithi008.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-11-18T23:42:22.666 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-11-18T23:42:22.667 INFO:teuthology.orchestra.run.smithi008.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-11-18T23:42:22.668 INFO:teuthology.orchestra.run.smithi008.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-11-18T23:42:22.671 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-18T23:42:22.733 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-11-18T23:42:22.736 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-11-18T23:42:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-11-18T23:42:22.736 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-11-18T23:42:22.736 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-11-18T23:42:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-11-18T23:42:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-devel x86_64 5.14.0-384.el9 CentOS-AppStream 21 M 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-11-18T23:42:22.737 INFO:teuthology.orchestra.run.smithi008.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-11-18T23:42:22.738 INFO:teuthology.orchestra.run.smithi008.stdout: python-unversioned-command noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: libnbd x86_64 1.18.1-2.el9 CentOS-AppStream 164 k 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout:Installing weak dependencies: 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-11-18T23:42:22.739 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout:Install 17 Packages 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 16 Packages 2023-11-18T23:42:22.740 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:42:22.741 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 96 M 2023-11-18T23:42:22.741 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-11-18T23:42:23.435 INFO:teuthology.orchestra.run.smithi008.stdout:(1/33): fio-engine-libaio-3.35-1.el9.x86_64.rpm 54 kB/s | 14 kB 00:00 2023-11-18T23:42:23.460 INFO:teuthology.orchestra.run.smithi008.stdout:(2/33): fio-engine-http-3.35-1.el9.x86_64.rpm 58 kB/s | 17 kB 00:00 2023-11-18T23:42:23.619 INFO:teuthology.orchestra.run.smithi008.stdout:(3/33): fio-3.35-1.el9.x86_64.rpm 14 MB/s | 6.2 MB 00:00 2023-11-18T23:42:23.644 INFO:teuthology.orchestra.run.smithi008.stdout:(4/33): fio-engine-nbd-3.35-1.el9.x86_64.rpm 65 kB/s | 13 kB 00:00 2023-11-18T23:42:23.669 INFO:teuthology.orchestra.run.smithi008.stdout:(5/33): fio-engine-rados-3.35-1.el9.x86_64.rpm 70 kB/s | 15 kB 00:00 2023-11-18T23:42:23.770 INFO:teuthology.orchestra.run.smithi008.stdout:(6/33): fio-engine-rbd-3.35-1.el9.x86_64.rpm 101 kB/s | 15 kB 00:00 2023-11-18T23:42:23.803 INFO:teuthology.orchestra.run.smithi008.stdout:(7/33): fio-engine-rdma-3.35-1.el9.x86_64.rpm 146 kB/s | 20 kB 00:00 2023-11-18T23:42:23.945 INFO:teuthology.orchestra.run.smithi008.stdout:(8/33): libcap-devel-2.48-9.el9.x86_64.rpm 188 kB/s | 33 kB 00:00 2023-11-18T23:42:23.996 INFO:teuthology.orchestra.run.smithi008.stdout:(9/33): sqlite-3.34.1-6.el9.x86_64.rpm 15 MB/s | 747 kB 00:00 2023-11-18T23:42:24.021 INFO:teuthology.orchestra.run.smithi008.stdout:(10/33): libnbd-1.18.1-2.el9.x86_64.rpm 758 kB/s | 164 kB 00:00 2023-11-18T23:42:24.163 INFO:teuthology.orchestra.run.smithi008.stdout:(11/33): rmt-1.6-6.el9.x86_64.rpm 323 kB/s | 45 kB 00:00 2023-11-18T23:42:24.388 INFO:teuthology.orchestra.run.smithi008.stdout:(12/33): kernel-devel-5.14.0-384.el9.x86_64.rpm 29 MB/s | 21 MB 00:00 2023-11-18T23:42:24.418 INFO:teuthology.orchestra.run.smithi008.stdout:(13/33): udftools-2.2-5.el9.x86_64.rpm 340 kB/s | 144 kB 00:00 2023-11-18T23:42:24.680 INFO:teuthology.orchestra.run.smithi008.stdout:(14/33): dump-0.4-0.51.b47.el9.x86_64.rpm 336 kB/s | 88 kB 00:00 2023-11-18T23:42:24.839 INFO:teuthology.orchestra.run.smithi008.stdout:(15/33): indent-2.2.13-4.el9.x86_64.rpm 1.1 MB/s | 179 kB 00:00 2023-11-18T23:42:24.889 INFO:teuthology.orchestra.run.smithi008.stdout:(16/33): gdbm-devel-1.19-4.el9.x86_64.rpm 124 kB/s | 59 kB 00:00 2023-11-18T23:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout:(17/33): gdbm-1.19-4.el9.x86_64.rpm 167 kB/s | 132 kB 00:00 2023-11-18T23:42:25.290 INFO:teuthology.orchestra.run.smithi008.stdout:(18/33): cpp-11.4.1-2.3.el9.x86_64.rpm 24 MB/s | 11 MB 00:00 2023-11-18T23:42:25.498 INFO:teuthology.orchestra.run.smithi008.stdout:(19/33): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 24 MB/s | 13 MB 00:00 2023-11-18T23:42:25.841 INFO:teuthology.orchestra.run.smithi008.stdout:(20/33): gcc-11.4.1-2.3.el9.x86_64.rpm 34 MB/s | 32 MB 00:00 2023-11-18T23:42:25.857 INFO:teuthology.orchestra.run.smithi008.stdout:(21/33): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 82 kB/s | 47 kB 00:00 2023-11-18T23:42:25.916 INFO:teuthology.orchestra.run.smithi008.stdout:(22/33): libstdc++-devel-11.4.1-2.3.el9.x86_64. 5.4 MB/s | 2.2 MB 00:00 2023-11-18T23:42:26.008 INFO:teuthology.orchestra.run.smithi008.stdout:(23/33): python-unversioned-command-3.9.18-1.el 59 kB/s | 8.8 kB 00:00 2023-11-18T23:42:26.083 INFO:teuthology.orchestra.run.smithi008.stdout:(24/33): python3-devel-3.9.18-1.el9.x86_64.rpm 915 kB/s | 204 kB 00:00 2023-11-18T23:42:26.175 INFO:teuthology.orchestra.run.smithi008.stdout:(25/33): e2fsprogs-1.46.5-4.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2023-11-18T23:42:26.234 INFO:teuthology.orchestra.run.smithi008.stdout:(26/33): libcom_err-1.46.5-4.el9.x86_64.rpm 168 kB/s | 25 kB 00:00 2023-11-18T23:42:26.259 INFO:teuthology.orchestra.run.smithi008.stdout:(27/33): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 882 kB/s | 221 kB 00:00 2023-11-18T23:42:26.326 INFO:teuthology.orchestra.run.smithi008.stdout:(28/33): libgcc-11.4.1-2.3.el9.x86_64.rpm 614 kB/s | 92 kB 00:00 2023-11-18T23:42:26.410 INFO:teuthology.orchestra.run.smithi008.stdout:(29/33): libss-1.46.5-4.el9.x86_64.rpm 204 kB/s | 31 kB 00:00 2023-11-18T23:42:26.460 INFO:teuthology.orchestra.run.smithi008.stdout:(30/33): libgomp-11.4.1-2.3.el9.x86_64.rpm 1.2 MB/s | 268 kB 00:00 2023-11-18T23:42:26.569 INFO:teuthology.orchestra.run.smithi008.stdout:(31/33): libstdc++-11.4.1-2.3.el9.x86_64.rpm 3.0 MB/s | 735 kB 00:00 2023-11-18T23:42:26.594 INFO:teuthology.orchestra.run.smithi008.stdout:(32/33): python3-3.9.18-1.el9.x86_64.rpm 139 kB/s | 26 kB 00:00 2023-11-18T23:42:26.894 INFO:teuthology.orchestra.run.smithi008.stdout:(33/33): python3-libs-3.9.18-1.el9.x86_64.rpm 17 MB/s | 7.3 MB 00:00 2023-11-18T23:42:26.899 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-11-18T23:42:26.899 INFO:teuthology.orchestra.run.smithi008.stdout:Total 23 MB/s | 96 MB 00:04 2023-11-18T23:42:26.923 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-11-18T23:42:27.211 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-11-18T23:42:27.211 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-11-18T23:42:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-11-18T23:42:28.273 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-11-18T23:42:30.372 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-11-18T23:42:30.444 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/49 2023-11-18T23:42:30.478 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-11-18T23:42:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-11-18T23:42:30.626 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/49 2023-11-18T23:42:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/49 2023-11-18T23:42:31.294 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/49 2023-11-18T23:42:32.626 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/49 2023-11-18T23:42:32.757 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/49 2023-11-18T23:42:32.803 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/49 2023-11-18T23:42:32.834 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/49 2023-11-18T23:42:33.192 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/49 2023-11-18T23:42:34.304 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/49 2023-11-18T23:42:34.593 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/49 2023-11-18T23:42:34.640 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/49 2023-11-18T23:42:34.682 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 13/49 2023-11-18T23:42:34.718 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rmt-2:1.6-6.el9.x86_64 14/49 2023-11-18T23:42:34.746 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libnbd-1.18.1-2.el9.x86_64 15/49 2023-11-18T23:42:34.772 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 16/49 2023-11-18T23:42:34.805 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 17/49 2023-11-18T23:42:34.831 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 18/49 2023-11-18T23:42:34.856 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 19/49 2023-11-18T23:42:34.881 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 20/49 2023-11-18T23:42:35.045 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 21/49 2023-11-18T23:42:35.089 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fio-3.35-1.el9.x86_64 22/49 2023-11-18T23:42:35.119 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 23/49 2023-11-18T23:42:42.839 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:42:42.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:42:44.905 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 24/49 2023-11-18T23:42:45.106 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-devel-5.14.0-384.el9.x86_64 25/49 2023-11-18T23:42:56.083 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-devel-5.14.0-384.el9.x86_64 25/49 2023-11-18T23:42:56.157 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 26/49 2023-11-18T23:42:56.189 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-11-18T23:42:56.299 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-11-18T23:42:56.420 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 28/49 2023-11-18T23:42:56.581 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 29/49 2023-11-18T23:42:56.631 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : indent-2.2.13-4.el9.x86_64 30/49 2023-11-18T23:42:56.672 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : udftools-2.2-5.el9.x86_64 31/49 2023-11-18T23:42:56.715 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 32/49 2023-11-18T23:42:56.743 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 33/49 2023-11-18T23:42:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 34/49 2023-11-18T23:42:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 35/49 2023-11-18T23:42:56.833 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 36/49 2023-11-18T23:42:56.858 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 37/49 2023-11-18T23:42:56.884 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 38/49 2023-11-18T23:42:56.884 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-11-18T23:42:56.930 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-11-18T23:42:56.960 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 40/49 2023-11-18T23:42:56.985 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 41/49 2023-11-18T23:42:57.023 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 42/49 2023-11-18T23:42:57.053 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 43/49 2023-11-18T23:42:57.078 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 44/49 2023-11-18T23:42:57.078 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-11-18T23:42:57.155 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-11-18T23:42:57.180 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 46/49 2023-11-18T23:42:57.197 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 47/49 2023-11-18T23:42:57.258 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 48/49 2023-11-18T23:42:57.351 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-18T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-18T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fio-3.35-1.el9.x86_64 1/49 2023-11-18T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/49 2023-11-18T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/49 2023-11-18T23:42:59.914 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-devel-5.14.0-384.el9.x86_64 8/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 9/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libnbd-1.18.1-2.el9.x86_64 10/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 11/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : udftools-2.2-5.el9.x86_64 12/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 13/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/49 2023-11-18T23:42:59.915 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : indent-2.2.13-4.el9.x86_64 17/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 18/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 20/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 22/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 24/49 2023-11-18T23:42:59.916 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/49 2023-11-18T23:42:59.918 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 26/49 2023-11-18T23:42:59.918 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 27/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 28/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 29/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 30/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 31/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 32/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 33/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 34/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 35/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 36/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 37/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 38/49 2023-11-18T23:42:59.919 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 39/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 40/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 41/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libss-1.46.5-4.el9.x86_64 42/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libss-1.46.5-3.el9.x86_64 43/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 44/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 45/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-3.9.18-1.el9.x86_64 46/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-3.9.17-2.el9.x86_64 47/49 2023-11-18T23:42:59.920 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 48/49 2023-11-18T23:43:01.033 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-18T23:43:01.033 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:43:01.033 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-11-18T23:43:01.033 INFO:teuthology.orchestra.run.smithi008.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.033 INFO:teuthology.orchestra.run.smithi008.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: libss-1.46.5-4.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-11-18T23:43:01.034 INFO:teuthology.orchestra.run.smithi008.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: python3-3.9.18-1.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: indent-2.2.13-4.el9.x86_64 kernel-devel-5.14.0-384.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-2.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-11-18T23:43:01.035 INFO:teuthology.orchestra.run.smithi008.stdout: udftools-2.2-5.el9.x86_64 2023-11-18T23:43:01.036 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:43:01.036 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-11-18T23:43:01.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo useradd -m fsgqa 2023-11-18T23:43:01.742 INFO:teuthology.orchestra.run.smithi008.stderr:useradd: user 'fsgqa' already exists 2023-11-18T23:43:01.743 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-18T23:43:01.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo groupadd fsgqa 2023-11-18T23:43:01.815 INFO:teuthology.orchestra.run.smithi008.stderr:groupadd: group 'fsgqa' already exists 2023-11-18T23:43:01.816 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-18T23:43:01.816 DEBUG:teuthology.orchestra.run.smithi008:> sudo useradd fsgqa2 2023-11-18T23:43:02.509 DEBUG:teuthology.orchestra.run.smithi008:> sudo useradd 123456-fsgqa 2023-11-18T23:43:03.006 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-18T23:43:03.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.119+0000 7f05fda56640 1 Processor -- start 2023-11-18T23:43:03.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.119+0000 7f05fda56640 1 -- start start 2023-11-18T23:43:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05fda56640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f05f8142d20 0x7f05f8071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05fda56640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f80b1df0 0x7f05f806d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05fda56640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f05f806da60 0x7f05f80b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05fda56640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806def0 con 0x7f05f806da60 2023-11-18T23:43:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05fda56640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f80b3130 con 0x7f05f8142d20 2023-11-18T23:43:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05fda56640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8143100 con 0x7f05f80b1df0 2023-11-18T23:43:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05f77fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f05f806da60 0x7f05f80b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05f77fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f05f806da60 0x7f05f80b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43278/0 (socket says 172.21.15.8:43278) 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.120+0000 7f05f77fe640 1 -- 172.21.15.8:0/4076127445 learned_addr learned my addr 172.21.15.8:0/4076127445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f6ffd640 1 --2- 172.21.15.8:0/4076127445 >> v2:172.21.15.116:3300/0 conn(0x7f05f8142d20 0x7f05f8071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f67fc640 1 --2- 172.21.15.8:0/4076127445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f80b1df0 0x7f05f806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f77fe640 1 -- 172.21.15.8:0/4076127445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f80b1df0 msgr2=0x7f05f806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f77fe640 1 --2- 172.21.15.8:0/4076127445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f80b1df0 0x7f05f806d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f77fe640 1 -- 172.21.15.8:0/4076127445 >> v2:172.21.15.116:3300/0 conn(0x7f05f8142d20 msgr2=0x7f05f8071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f77fe640 1 --2- 172.21.15.8:0/4076127445 >> v2:172.21.15.116:3300/0 conn(0x7f05f8142d20 0x7f05f8071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f77fe640 1 -- 172.21.15.8:0/4076127445 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80b2250 con 0x7f05f806da60 2023-11-18T23:43:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.121+0000 7f05f77fe640 1 --2- 172.21.15.8:0/4076127445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f806da60 0x7f05f80b3b60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f05f806ba70 tx=0x7f05e802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429d8e61e16aa68 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:43:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05f5ffb640 1 -- 172.21.15.8:0/4076127445 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e802ca70 con 0x7f05f806da60 2023-11-18T23:43:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05f5ffb640 1 -- 172.21.15.8:0/4076127445 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e802cbd0 con 0x7f05f806da60 2023-11-18T23:43:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05f5ffb640 1 -- 172.21.15.8:0/4076127445 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e80343f0 con 0x7f05f806da60 2023-11-18T23:43:03.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 -- 172.21.15.8:0/4076127445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f806da60 msgr2=0x7f05f80b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 --2- 172.21.15.8:0/4076127445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f806da60 0x7f05f80b3b60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f05f806ba70 tx=0x7f05e802bed0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 -- 172.21.15.8:0/4076127445 shutdown_connections 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 --2- 172.21.15.8:0/4076127445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f806da60 0x7f05f80b3b60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 --2- 172.21.15.8:0/4076127445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f80b1df0 0x7f05f806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 --2- 172.21.15.8:0/4076127445 >> v2:172.21.15.116:3300/0 conn(0x7f05f8142d20 0x7f05f8071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 -- 172.21.15.8:0/4076127445 >> 172.21.15.8:0/4076127445 conn(0x7f05f80b0af0 msgr2=0x7f05f80b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 -- 172.21.15.8:0/4076127445 shutdown_connections 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.122+0000 7f05fda56640 1 -- 172.21.15.8:0/4076127445 wait complete. 2023-11-18T23:43:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 Processor -- start 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 -- start start 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f806da60 0x7f05f80ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f80b1df0 0x7f05f815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f8142d20 0x7f05f81409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80ae650 con 0x7f05f80b1df0 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815b640 con 0x7f05f8142d20 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.124+0000 7f05fda56640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815aac0 con 0x7f05f806da60 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f80b1df0 0x7f05f815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f80b1df0 0x7f05f815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43282/0 (socket says 172.21.15.8:43282) 2023-11-18T23:43:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 -- 172.21.15.8:0/2041045434 learned_addr learned my addr 172.21.15.8:0/2041045434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f6ffd640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f806da60 0x7f05f80ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f77fe640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f8142d20 0x7f05f81409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 -- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f806da60 msgr2=0x7f05f80ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f806da60 0x7f05f80ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 -- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f8142d20 msgr2=0x7f05f81409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f8142d20 0x7f05f81409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 -- 172.21.15.8:0/2041045434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8009b30 con 0x7f05f80b1df0 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05f67fc640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f80b1df0 0x7f05f815c230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d800 tx=0x7f05ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05dffff640 1 -- 172.21.15.8:0/2041045434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00b6c0 con 0x7f05f80b1df0 2023-11-18T23:43:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05dffff640 1 -- 172.21.15.8:0/2041045434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec00b820 con 0x7f05f80b1df0 2023-11-18T23:43:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f815ada0 con 0x7f05f80b1df0 2023-11-18T23:43:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05dffff640 1 -- 172.21.15.8:0/2041045434 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00bbb0 con 0x7f05f80b1df0 2023-11-18T23:43:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.125+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f815b360 con 0x7f05f80b1df0 2023-11-18T23:43:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.126+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f8067420 con 0x7f05f80b1df0 2023-11-18T23:43:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.127+0000 7f05dffff640 1 -- 172.21.15.8:0/2041045434 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05ec00bd10 con 0x7f05f80b1df0 2023-11-18T23:43:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.127+0000 7f05dffff640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f05e406ae40 0x7f05e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.127+0000 7f05dffff640 1 -- 172.21.15.8:0/2041045434 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05ec089b90 con 0x7f05f80b1df0 2023-11-18T23:43:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.128+0000 7f05f6ffd640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f05e406ae40 0x7f05e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.128+0000 7f05f6ffd640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f05e406ae40 0x7f05e406d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05f0006fd0 tx=0x7f05f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:43:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.132+0000 7f05dffff640 1 -- 172.21.15.8:0/2041045434 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05ec054c40 con 0x7f05f80b1df0 2023-11-18T23:43:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.378+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f05f81f2f10 con 0x7f05f80b1df0 2023-11-18T23:43:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.379+0000 7f05dffff640 1 -- 172.21.15.8:0/2041045434 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1272 (secure 0 0 0) 0x7f05ec058260 con 0x7f05f80b1df0 2023-11-18T23:43:03.381 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:43:03.381 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":1,"fsid":"45315d48-6a4a-4df1-b021-4a12da37b9ab","modified":"2023-11-18T23:40:14.376851Z","created":"2023-11-18T23:40:14.376851Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3301","nonce":0},{"type":"v1","addr":"172.21.15.116:6790","nonce":0}]},"addr":"172.21.15.116:6790/0","public_addr":"172.21.15.116:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-18T23:43:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:dumped monmap epoch 1 2023-11-18T23:43:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.380+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f05e406ae40 msgr2=0x7f05e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.380+0000 7f05fda56640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f05e406ae40 0x7f05e406d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05f0006fd0 tx=0x7f05f0008040 comp rx=0 tx=0).stop 2023-11-18T23:43:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.380+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f80b1df0 msgr2=0x7f05f815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.380+0000 7f05fda56640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f80b1df0 0x7f05f815c230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d800 tx=0x7f05ec00dcc0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 shutdown_connections 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f05e406ae40 0x7f05e406d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05f8142d20 0x7f05f81409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05f80b1df0 0x7f05f815c230 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 --2- 172.21.15.8:0/2041045434 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05f806da60 0x7f05f80ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 >> 172.21.15.8:0/2041045434 conn(0x7f05f80b0af0 msgr2=0x7f05f813fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 shutdown_connections 2023-11-18T23:43:03.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.381+0000 7f05fda56640 1 -- 172.21.15.8:0/2041045434 wait complete. 2023-11-18T23:43:03.394 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-11-18T23:43:03.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.499+0000 7f2e711c9640 1 Processor -- start 2023-11-18T23:43:03.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.499+0000 7f2e711c9640 1 -- start start 2023-11-18T23:43:03.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e711c9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2e6c0d1570 0x7f2e6c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e711c9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e6c0cef00 0x7f2e6c161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e711c9640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c0ce360 con 0x7f2e6c160b70 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e711c9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c0d19f0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e711c9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c0cdd50 con 0x7f2e6c0cef00 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e6a59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2e6c0d1570 0x7f2e6c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e6a59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2e6c0d1570 0x7f2e6c0b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43284/0 (socket says 172.21.15.8:43284) 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e6a59c640 1 -- 172.21.15.8:0/2410431558 learned_addr learned my addr 172.21.15.8:0/2410431558 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.500+0000 7f2e6b59e640 1 --2- 172.21.15.8:0/2410431558 >> v2:172.21.15.116:3300/0 conn(0x7f2e6c0cef00 0x7f2e6c161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.501+0000 7f2e6a59c640 1 -- 172.21.15.8:0/2410431558 >> v2:172.21.15.116:3300/0 conn(0x7f2e6c0cef00 msgr2=0x7f2e6c161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T23:43:03.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.501+0000 7f2e6a59c640 1 --2- 172.21.15.8:0/2410431558 >> v2:172.21.15.116:3300/0 conn(0x7f2e6c0cef00 0x7f2e6c161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.501+0000 7f2e6a59c640 1 -- 172.21.15.8:0/2410431558 >> v1:172.21.15.116:6789/0 conn(0x7f2e6c160b70 legacy=0x7f2e6c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.501+0000 7f2e6a59c640 1 -- 172.21.15.8:0/2410431558 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0d1c70 con 0x7f2e6c0d1570 2023-11-18T23:43:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.501+0000 7f2e6a59c640 1 --2- 172.21.15.8:0/2410431558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c0b2aa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c072b40 tx=0x7f2e5402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d0bc5814b832e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:43:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.501+0000 7f2e69d9b640 1 -- 172.21.15.8:0/2410431558 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54030860 con 0x7f2e6c0d1570 2023-11-18T23:43:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e69d9b640 1 -- 172.21.15.8:0/2410431558 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e540309c0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e69d9b640 1 -- 172.21.15.8:0/2410431558 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54030d50 con 0x7f2e6c0d1570 2023-11-18T23:43:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 -- 172.21.15.8:0/2410431558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 msgr2=0x7f2e6c0b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 --2- 172.21.15.8:0/2410431558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c0b2aa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c072b40 tx=0x7f2e5402b9a0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 -- 172.21.15.8:0/2410431558 shutdown_connections 2023-11-18T23:43:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 --2- 172.21.15.8:0/2410431558 >> v2:172.21.15.116:3300/0 conn(0x7f2e6c0cef00 0x7f2e6c161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 --2- 172.21.15.8:0/2410431558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c0b2aa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 -- 172.21.15.8:0/2410431558 >> 172.21.15.8:0/2410431558 conn(0x7f2e6c09c470 msgr2=0x7f2e6c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:43:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 -- 172.21.15.8:0/2410431558 shutdown_connections 2023-11-18T23:43:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.502+0000 7f2e711c9640 1 -- 172.21.15.8:0/2410431558 wait complete. 2023-11-18T23:43:03.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 Processor -- start 2023-11-18T23:43:03.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 -- start start 2023-11-18T23:43:03.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e6c0cef00 0x7f2e6c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c1f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6c160b70 0x7f2e6c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1f5100 con 0x7f2e6c0d1570 2023-11-18T23:43:03.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1f4810 con 0x7f2e6c0cef00 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e711c9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c15fe20 con 0x7f2e6c160b70 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e6a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c1f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e6a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c1f42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43294/0 (socket says 172.21.15.8:43294) 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.504+0000 7f2e6a59c640 1 -- 172.21.15.8:0/3125904477 learned_addr learned my addr 172.21.15.8:0/3125904477 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6ad9d640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e6c0cef00 0x7f2e6c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6b59e640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6c160b70 0x7f2e6c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6a59c640 1 -- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6c160b70 msgr2=0x7f2e6c0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6a59c640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6c160b70 0x7f2e6c0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6a59c640 1 -- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e6c0cef00 msgr2=0x7f2e6c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6a59c640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e6c0cef00 0x7f2e6c1568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6a59c640 1 -- 172.21.15.8:0/3125904477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540094d0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6ad9d640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e6c0cef00 0x7f2e6c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T23:43:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e6a59c640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c1f42d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e54000c00 tx=0x7f2e54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:43:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e637fe640 1 -- 172.21.15.8:0/3125904477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54039a90 con 0x7f2e6c0d1570 2023-11-18T23:43:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e637fe640 1 -- 172.21.15.8:0/3125904477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e54039bf0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c160100 con 0x7f2e6c0d1570 2023-11-18T23:43:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e637fe640 1 -- 172.21.15.8:0/3125904477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54043410 con 0x7f2e6c0d1570 2023-11-18T23:43:03.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.505+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c1f4d90 con 0x7f2e6c0d1570 2023-11-18T23:43:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.506+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c1f52b0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.507+0000 7f2e637fe640 1 -- 172.21.15.8:0/3125904477 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e5404c3b0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.507+0000 7f2e637fe640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2e4c06ae40 0x7f2e4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T23:43:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.507+0000 7f2e637fe640 1 -- 172.21.15.8:0/3125904477 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e540abbd0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.507+0000 7f2e6ad9d640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2e4c06ae40 0x7f2e4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T23:43:03.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.508+0000 7f2e6ad9d640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2e4c06ae40 0x7f2e4c06d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e64001680 tx=0x7f2e64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T23:43:03.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.512+0000 7f2e637fe640 1 -- 172.21.15.8:0/3125904477 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e6c1f52b0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.754+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f2e6c1f52b0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.755+0000 7f2e637fe640 1 -- 172.21.15.8:0/3125904477 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f2e6c1f52b0 con 0x7f2e6c0d1570 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stdout:[client.admin] 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBeS1llm7ikIhAA0EPHZPDIhUMhx8eYs2+2KA== 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: caps mds = "allow *" 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: caps mgr = "allow *" 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: caps mon = "allow *" 2023-11-18T23:43:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: caps osd = "allow *" 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2e4c06ae40 msgr2=0x7f2e4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2e4c06ae40 0x7f2e4c06d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e64001680 tx=0x7f2e64009040 comp rx=0 tx=0).stop 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 msgr2=0x7f2e6c1f42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c1f42d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e54000c00 tx=0x7f2e54004730 comp rx=0 tx=0).stop 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 shutdown_connections 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:6832/4087144077,v1:172.21.15.116:6833/4087144077] conn(0x7f2e4c06ae40 0x7f2e4c06d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6c160b70 0x7f2e6c0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e6c0d1570 0x7f2e6c1f42d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 --2- 172.21.15.8:0/3125904477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e6c0cef00 0x7f2e6c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T23:43:03.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 >> 172.21.15.8:0/3125904477 conn(0x7f2e6c09c470 msgr2=0x7f2e6c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T23:43:03.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.756+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 shutdown_connections 2023-11-18T23:43:03.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-11-18T23:43:03.757+0000 7f2e711c9640 1 -- 172.21.15.8:0/3125904477 wait complete. 2023-11-18T23:43:03.769 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-11-18T23:43:03.785 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.b8trvJLtSh 2023-11-18T23:43:03.785 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:43:03.785 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/tmp/tmp.b8trvJLtSh 2023-11-18T23:43:03.840 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:43:03.840 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/tmp/tmp.kYHL8e4YNuxfstests-dev/local.config 2023-11-18T23:43:03.910 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.hQpPz0d1gttest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.UZylhDXC2cscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.8:6789 -k /tmp/tmp.b8trvJLtSh --client_mountpoint /test" 2023-11-18T23:43:03.910 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-18T23:43:03.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/tmp/tmp.kYHL8e4YNuxfstests-dev/ceph.exclude 2023-11-18T23:43:03.980 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo make) 2023-11-18T23:43:04.070 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize -cfi 2023-11-18T23:43:04.520 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-18T23:43:04.520 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file './config.guess' 2023-11-18T23:43:04.523 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file './config.sub' 2023-11-18T23:43:04.527 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file './install-sh' 2023-11-18T23:43:04.531 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file './ltmain.sh' 2023-11-18T23:43:04.553 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-18T23:43:04.554 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-18T23:43:04.558 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-18T23:43:04.562 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-18T23:43:04.567 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-18T23:43:04.571 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-18T23:43:04.578 INFO:teuthology.orchestra.run.smithi008.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-18T23:43:04.579 INFO:teuthology.orchestra.run.smithi008.stdout:cp include/install-sh . 2023-11-18T23:43:04.580 INFO:teuthology.orchestra.run.smithi008.stdout:aclocal -I m4 2023-11-18T23:43:05.646 INFO:teuthology.orchestra.run.smithi008.stdout:autoheader 2023-11-18T23:43:05.954 INFO:teuthology.orchestra.run.smithi008.stdout:autoconf 2023-11-18T23:43:06.127 INFO:teuthology.orchestra.run.smithi008.stdout:./configure \ 2023-11-18T23:43:06.127 INFO:teuthology.orchestra.run.smithi008.stdout: --libexecdir=/usr/lib \ 2023-11-18T23:43:06.128 INFO:teuthology.orchestra.run.smithi008.stdout: --exec_prefix=/var/lib 2023-11-18T23:43:06.343 INFO:teuthology.orchestra.run.smithi008.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-18T23:43:06.343 INFO:teuthology.orchestra.run.smithi008.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-18T23:43:06.345 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to print strings... printf 2023-11-18T23:43:06.345 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gcc... gcc 2023-11-18T23:43:06.402 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether the C compiler works... yes 2023-11-18T23:43:06.402 INFO:teuthology.orchestra.run.smithi008.stdout:checking for C compiler default output file name... a.out 2023-11-18T23:43:06.430 INFO:teuthology.orchestra.run.smithi008.stdout:checking for suffix of executables... 2023-11-18T23:43:06.476 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether we are cross compiling... no 2023-11-18T23:43:06.493 INFO:teuthology.orchestra.run.smithi008.stdout:checking for suffix of object files... o 2023-11-18T23:43:06.509 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether we are using the GNU C compiler... yes 2023-11-18T23:43:06.525 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether gcc accepts -g... yes 2023-11-18T23:43:06.551 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gcc option to accept ISO C89... none needed 2023-11-18T23:43:06.554 INFO:teuthology.orchestra.run.smithi008.stdout:checking for a sed that does not truncate output... /bin/sed 2023-11-18T23:43:06.556 INFO:teuthology.orchestra.run.smithi008.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-11-18T23:43:06.557 INFO:teuthology.orchestra.run.smithi008.stdout:checking for egrep... /bin/grep -E 2023-11-18T23:43:06.558 INFO:teuthology.orchestra.run.smithi008.stdout:checking for fgrep... /bin/grep -F 2023-11-18T23:43:06.561 INFO:teuthology.orchestra.run.smithi008.stdout:checking for ld used by gcc... /bin/ld 2023-11-18T23:43:06.563 INFO:teuthology.orchestra.run.smithi008.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-11-18T23:43:06.569 INFO:teuthology.orchestra.run.smithi008.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-11-18T23:43:07.539 INFO:teuthology.orchestra.run.smithi008.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-11-18T23:43:07.539 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether ln -s works... yes 2023-11-18T23:43:07.545 INFO:teuthology.orchestra.run.smithi008.stdout:checking the maximum length of command line arguments... 1572864 2023-11-18T23:43:07.550 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-18T23:43:07.550 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-18T23:43:07.550 INFO:teuthology.orchestra.run.smithi008.stdout:checking for /bin/ld option to reload object files... -r 2023-11-18T23:43:07.551 INFO:teuthology.orchestra.run.smithi008.stdout:checking for objdump... objdump 2023-11-18T23:43:07.551 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to recognize dependent libraries... pass_all 2023-11-18T23:43:07.551 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dlltool... no 2023-11-18T23:43:07.551 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-18T23:43:07.551 INFO:teuthology.orchestra.run.smithi008.stdout:checking for ar... ar 2023-11-18T23:43:07.600 INFO:teuthology.orchestra.run.smithi008.stdout:checking for archiver @FILE support... @ 2023-11-18T23:43:07.600 INFO:teuthology.orchestra.run.smithi008.stdout:checking for strip... strip 2023-11-18T23:43:07.600 INFO:teuthology.orchestra.run.smithi008.stdout:checking for ranlib... ranlib 2023-11-18T23:43:07.600 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gawk... gawk 2023-11-18T23:43:07.668 INFO:teuthology.orchestra.run.smithi008.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-11-18T23:43:07.669 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sysroot... no 2023-11-18T23:43:07.672 INFO:teuthology.orchestra.run.smithi008.stdout:checking for a working dd... /bin/dd 2023-11-18T23:43:07.675 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-11-18T23:43:07.688 INFO:teuthology.orchestra.run.smithi008.stdout:checking for mt... no 2023-11-18T23:43:07.690 INFO:teuthology.orchestra.run.smithi008.stdout:checking if : is a manifest tool... no 2023-11-18T23:43:07.735 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to run the C preprocessor... gcc -E 2023-11-18T23:43:07.906 INFO:teuthology.orchestra.run.smithi008.stdout:checking for ANSI C header files... yes 2023-11-18T23:43:07.927 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/types.h... yes 2023-11-18T23:43:07.957 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/stat.h... yes 2023-11-18T23:43:07.980 INFO:teuthology.orchestra.run.smithi008.stdout:checking for stdlib.h... yes 2023-11-18T23:43:08.006 INFO:teuthology.orchestra.run.smithi008.stdout:checking for string.h... yes 2023-11-18T23:43:08.039 INFO:teuthology.orchestra.run.smithi008.stdout:checking for memory.h... yes 2023-11-18T23:43:08.064 INFO:teuthology.orchestra.run.smithi008.stdout:checking for strings.h... yes 2023-11-18T23:43:08.092 INFO:teuthology.orchestra.run.smithi008.stdout:checking for inttypes.h... yes 2023-11-18T23:43:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:checking for stdint.h... yes 2023-11-18T23:43:08.149 INFO:teuthology.orchestra.run.smithi008.stdout:checking for unistd.h... yes 2023-11-18T23:43:08.179 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dlfcn.h... yes 2023-11-18T23:43:08.182 INFO:teuthology.orchestra.run.smithi008.stdout:checking for objdir... .libs 2023-11-18T23:43:08.246 INFO:teuthology.orchestra.run.smithi008.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-18T23:43:08.247 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-18T23:43:08.261 INFO:teuthology.orchestra.run.smithi008.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-18T23:43:08.279 INFO:teuthology.orchestra.run.smithi008.stdout:checking if gcc static flag -static works... no 2023-11-18T23:43:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:checking if gcc supports -c -o file.o... yes 2023-11-18T23:43:08.300 INFO:teuthology.orchestra.run.smithi008.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-18T23:43:08.306 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-18T23:43:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether -lc should be explicitly linked in... no 2023-11-18T23:43:08.398 INFO:teuthology.orchestra.run.smithi008.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-18T23:43:08.398 INFO:teuthology.orchestra.run.smithi008.stdout:checking how to hardcode library paths into programs... immediate 2023-11-18T23:43:08.399 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether stripping libraries is possible... yes 2023-11-18T23:43:08.399 INFO:teuthology.orchestra.run.smithi008.stdout:checking if libtool supports shared libraries... yes 2023-11-18T23:43:08.400 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether to build shared libraries... yes 2023-11-18T23:43:08.400 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether to build static libraries... yes 2023-11-18T23:43:08.406 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gcc... (cached) gcc 2023-11-18T23:43:08.422 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-11-18T23:43:08.423 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-18T23:43:08.423 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-11-18T23:43:08.423 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gmake... /usr/bin/gmake 2023-11-18T23:43:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-11-18T23:43:08.424 INFO:teuthology.orchestra.run.smithi008.stdout:checking for tar... /bin/tar 2023-11-18T23:43:08.425 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gzip... /bin/gzip 2023-11-18T23:43:08.431 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether gcc -MM is supported... yes 2023-11-18T23:43:08.432 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sort... /bin/sort 2023-11-18T23:43:08.432 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether ln -s works... yes 2023-11-18T23:43:08.432 INFO:teuthology.orchestra.run.smithi008.stdout:checking for rpm... /bin/rpm 2023-11-18T23:43:08.435 INFO:teuthology.orchestra.run.smithi008.stdout:checking for rpmbuild... no 2023-11-18T23:43:08.459 INFO:teuthology.orchestra.run.smithi008.stdout:checking assert.h usability... yes 2023-11-18T23:43:08.468 INFO:teuthology.orchestra.run.smithi008.stdout:checking assert.h presence... yes 2023-11-18T23:43:08.468 INFO:teuthology.orchestra.run.smithi008.stdout:checking for assert.h... yes 2023-11-18T23:43:08.495 INFO:teuthology.orchestra.run.smithi008.stdout:checking bstring.h usability... no 2023-11-18T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stdout:checking bstring.h presence... no 2023-11-18T23:43:08.506 INFO:teuthology.orchestra.run.smithi008.stdout:checking for bstring.h... no 2023-11-18T23:43:08.531 INFO:teuthology.orchestra.run.smithi008.stdout:checking libgen.h usability... yes 2023-11-18T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stdout:checking libgen.h presence... yes 2023-11-18T23:43:08.539 INFO:teuthology.orchestra.run.smithi008.stdout:checking for libgen.h... yes 2023-11-18T23:43:08.577 INFO:teuthology.orchestra.run.smithi008.stdout:checking dirent.h usability... yes 2023-11-18T23:43:08.586 INFO:teuthology.orchestra.run.smithi008.stdout:checking dirent.h presence... yes 2023-11-18T23:43:08.586 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dirent.h... yes 2023-11-18T23:43:08.630 INFO:teuthology.orchestra.run.smithi008.stdout:checking errno.h usability... yes 2023-11-18T23:43:08.638 INFO:teuthology.orchestra.run.smithi008.stdout:checking errno.h presence... yes 2023-11-18T23:43:08.638 INFO:teuthology.orchestra.run.smithi008.stdout:checking for errno.h... yes 2023-11-18T23:43:08.670 INFO:teuthology.orchestra.run.smithi008.stdout:checking malloc.h usability... yes 2023-11-18T23:43:08.680 INFO:teuthology.orchestra.run.smithi008.stdout:checking malloc.h presence... yes 2023-11-18T23:43:08.681 INFO:teuthology.orchestra.run.smithi008.stdout:checking for malloc.h... yes 2023-11-18T23:43:08.707 INFO:teuthology.orchestra.run.smithi008.stdout:checking uuid.h usability... no 2023-11-18T23:43:08.718 INFO:teuthology.orchestra.run.smithi008.stdout:checking uuid.h presence... no 2023-11-18T23:43:08.718 INFO:teuthology.orchestra.run.smithi008.stdout:checking for uuid.h... no 2023-11-18T23:43:08.758 INFO:teuthology.orchestra.run.smithi008.stdout:checking uuid/uuid.h usability... yes 2023-11-18T23:43:08.769 INFO:teuthology.orchestra.run.smithi008.stdout:checking uuid/uuid.h presence... yes 2023-11-18T23:43:08.769 INFO:teuthology.orchestra.run.smithi008.stdout:checking for uuid/uuid.h... yes 2023-11-18T23:43:08.802 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/uuid.h usability... no 2023-11-18T23:43:08.813 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/uuid.h presence... no 2023-11-18T23:43:08.813 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/uuid.h... no 2023-11-18T23:43:08.856 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/file.h usability... yes 2023-11-18T23:43:08.865 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/file.h presence... yes 2023-11-18T23:43:08.865 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/file.h... yes 2023-11-18T23:43:08.901 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/fcntl.h usability... yes 2023-11-18T23:43:08.910 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/fcntl.h presence... yes 2023-11-18T23:43:08.910 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/fcntl.h... yes 2023-11-18T23:43:08.937 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/syssgi.h usability... no 2023-11-18T23:43:08.948 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/syssgi.h presence... no 2023-11-18T23:43:08.948 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/syssgi.h... no 2023-11-18T23:43:08.993 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/param.h usability... yes 2023-11-18T23:43:09.005 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/param.h presence... yes 2023-11-18T23:43:09.005 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/param.h... yes 2023-11-18T23:43:09.010 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/stat.h... (cached) yes 2023-11-18T23:43:09.038 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/statvfs.h usability... yes 2023-11-18T23:43:09.047 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/statvfs.h presence... yes 2023-11-18T23:43:09.047 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/statvfs.h... yes 2023-11-18T23:43:09.074 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/time.h usability... yes 2023-11-18T23:43:09.083 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/time.h presence... yes 2023-11-18T23:43:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/time.h... yes 2023-11-18T23:43:09.119 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/ioctl.h usability... yes 2023-11-18T23:43:09.128 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/ioctl.h presence... yes 2023-11-18T23:43:09.128 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/ioctl.h... yes 2023-11-18T23:43:09.166 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/wait.h usability... yes 2023-11-18T23:43:09.176 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/wait.h presence... yes 2023-11-18T23:43:09.177 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/wait.h... yes 2023-11-18T23:43:09.181 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/types.h... (cached) yes 2023-11-18T23:43:09.186 INFO:teuthology.orchestra.run.smithi008.stdout:checking for strings.h... (cached) yes 2023-11-18T23:43:09.214 INFO:teuthology.orchestra.run.smithi008.stdout:checking err.h usability... yes 2023-11-18T23:43:09.222 INFO:teuthology.orchestra.run.smithi008.stdout:checking err.h presence... yes 2023-11-18T23:43:09.222 INFO:teuthology.orchestra.run.smithi008.stdout:checking for err.h... yes 2023-11-18T23:43:09.251 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/falloc.h usability... yes 2023-11-18T23:43:09.259 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/falloc.h presence... yes 2023-11-18T23:43:09.259 INFO:teuthology.orchestra.run.smithi008.stdout:checking for linux/falloc.h... yes 2023-11-18T23:43:09.286 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-11-18T23:43:09.297 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-11-18T23:43:09.297 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-18T23:43:09.321 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/fs/xfs_itable.h usability... no 2023-11-18T23:43:09.332 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/fs/xfs_itable.h presence... no 2023-11-18T23:43:09.332 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-18T23:43:09.356 INFO:teuthology.orchestra.run.smithi008.stdout:checking xfs/platform_defs.h usability... no 2023-11-18T23:43:09.367 INFO:teuthology.orchestra.run.smithi008.stdout:checking xfs/platform_defs.h presence... no 2023-11-18T23:43:09.367 INFO:teuthology.orchestra.run.smithi008.stdout:checking for xfs/platform_defs.h... no 2023-11-18T23:43:09.391 INFO:teuthology.orchestra.run.smithi008.stdout:checking btrfs/ioctl.h usability... no 2023-11-18T23:43:09.402 INFO:teuthology.orchestra.run.smithi008.stdout:checking btrfs/ioctl.h presence... no 2023-11-18T23:43:09.402 INFO:teuthology.orchestra.run.smithi008.stdout:checking for btrfs/ioctl.h... no 2023-11-18T23:43:09.426 INFO:teuthology.orchestra.run.smithi008.stdout:checking cifs/ioctl.h usability... no 2023-11-18T23:43:09.437 INFO:teuthology.orchestra.run.smithi008.stdout:checking cifs/ioctl.h presence... no 2023-11-18T23:43:09.437 INFO:teuthology.orchestra.run.smithi008.stdout:checking for cifs/ioctl.h... no 2023-11-18T23:43:09.464 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/mman.h usability... yes 2023-11-18T23:43:09.473 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/mman.h presence... yes 2023-11-18T23:43:09.473 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/mman.h... yes 2023-11-18T23:43:09.488 INFO:teuthology.orchestra.run.smithi008.stdout:checking for xfs/xfs_log_format.h... no 2023-11-18T23:43:09.523 INFO:teuthology.orchestra.run.smithi008.stdout:checking for uuid_compare... no 2023-11-18T23:43:09.554 INFO:teuthology.orchestra.run.smithi008.stdout:checking for uuid_compare in -luuid... yes 2023-11-18T23:43:09.612 INFO:teuthology.orchestra.run.smithi008.stdout:checking for xfs/xfs.h... yes 2023-11-18T23:43:09.624 INFO:teuthology.orchestra.run.smithi008.stdout:checking for xfs/libxfs.h... no 2023-11-18T23:43:09.640 INFO:teuthology.orchestra.run.smithi008.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-18T23:43:09.671 INFO:teuthology.orchestra.run.smithi008.stdout:checking for xfs/xqm.h... yes 2023-11-18T23:43:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-18T23:43:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:checking xfs/handle.h usability... yes 2023-11-18T23:43:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:checking xfs/handle.h presence... yes 2023-11-18T23:43:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:checking for xfs/handle.h... yes 2023-11-18T23:43:09.793 INFO:teuthology.orchestra.run.smithi008.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-18T23:43:09.817 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/acl.h usability... yes 2023-11-18T23:43:09.827 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/acl.h presence... yes 2023-11-18T23:43:09.828 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/acl.h... yes 2023-11-18T23:43:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:checking acl/libacl.h usability... yes 2023-11-18T23:43:09.861 INFO:teuthology.orchestra.run.smithi008.stdout:checking acl/libacl.h presence... yes 2023-11-18T23:43:09.861 INFO:teuthology.orchestra.run.smithi008.stdout:checking for acl/libacl.h... yes 2023-11-18T23:43:09.893 INFO:teuthology.orchestra.run.smithi008.stdout:checking for acl_init in -lacl... yes 2023-11-18T23:43:09.916 INFO:teuthology.orchestra.run.smithi008.stdout:checking gdbm-ndbm.h usability... no 2023-11-18T23:43:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:checking gdbm-ndbm.h presence... no 2023-11-18T23:43:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gdbm-ndbm.h... no 2023-11-18T23:43:09.950 INFO:teuthology.orchestra.run.smithi008.stdout:checking gdbm/ndbm.h usability... yes 2023-11-18T23:43:09.960 INFO:teuthology.orchestra.run.smithi008.stdout:checking gdbm/ndbm.h presence... yes 2023-11-18T23:43:09.960 INFO:teuthology.orchestra.run.smithi008.stdout:checking for gdbm/ndbm.h... yes 2023-11-18T23:43:09.996 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_open in -lgdbm... no 2023-11-18T23:43:10.031 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_fetch in -lgdbm... no 2023-11-18T23:43:10.066 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_store in -lgdbm... no 2023-11-18T23:43:10.100 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_close in -lgdbm... no 2023-11-18T23:43:10.145 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-11-18T23:43:10.177 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-11-18T23:43:10.210 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-11-18T23:43:10.243 INFO:teuthology.orchestra.run.smithi008.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-11-18T23:43:10.267 INFO:teuthology.orchestra.run.smithi008.stdout:checking libaio.h usability... yes 2023-11-18T23:43:10.278 INFO:teuthology.orchestra.run.smithi008.stdout:checking libaio.h presence... yes 2023-11-18T23:43:10.278 INFO:teuthology.orchestra.run.smithi008.stdout:checking for libaio.h... yes 2023-11-18T23:43:10.301 INFO:teuthology.orchestra.run.smithi008.stdout:checking liburing.h usability... no 2023-11-18T23:43:10.312 INFO:teuthology.orchestra.run.smithi008.stdout:checking liburing.h presence... no 2023-11-18T23:43:10.312 INFO:teuthology.orchestra.run.smithi008.stdout:checking for liburing.h... no 2023-11-18T23:43:10.342 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/capability.h usability... yes 2023-11-18T23:43:10.353 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/capability.h presence... yes 2023-11-18T23:43:10.353 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/capability.h... yes 2023-11-18T23:43:10.377 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/fiemap.h usability... yes 2023-11-18T23:43:10.385 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/fiemap.h presence... yes 2023-11-18T23:43:10.385 INFO:teuthology.orchestra.run.smithi008.stdout:checking for linux/fiemap.h... yes 2023-11-18T23:43:10.420 INFO:teuthology.orchestra.run.smithi008.stdout:checking for fallocate... yes 2023-11-18T23:43:10.454 INFO:teuthology.orchestra.run.smithi008.stdout:checking for open_by_handle_at... yes 2023-11-18T23:43:10.479 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/prctl.h usability... yes 2023-11-18T23:43:10.488 INFO:teuthology.orchestra.run.smithi008.stdout:checking sys/prctl.h presence... yes 2023-11-18T23:43:10.488 INFO:teuthology.orchestra.run.smithi008.stdout:checking for sys/prctl.h... yes 2023-11-18T23:43:10.512 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/fs.h usability... yes 2023-11-18T23:43:10.521 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/fs.h presence... yes 2023-11-18T23:43:10.521 INFO:teuthology.orchestra.run.smithi008.stdout:checking for linux/fs.h... yes 2023-11-18T23:43:10.543 INFO:teuthology.orchestra.run.smithi008.stdout:checking btrfsutil.h usability... no 2023-11-18T23:43:10.554 INFO:teuthology.orchestra.run.smithi008.stdout:checking btrfsutil.h presence... no 2023-11-18T23:43:10.554 INFO:teuthology.orchestra.run.smithi008.stdout:checking for btrfsutil.h... no 2023-11-18T23:43:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:checking for copy_file_range... yes 2023-11-18T23:43:10.628 INFO:teuthology.orchestra.run.smithi008.stdout:checking for SEEK_DATA... yes 2023-11-18T23:43:10.678 INFO:teuthology.orchestra.run.smithi008.stdout:checking for BMV_OF_SHARED... yes 2023-11-18T23:43:10.715 INFO:teuthology.orchestra.run.smithi008.stdout:checking for nftw... yes 2023-11-18T23:43:10.751 INFO:teuthology.orchestra.run.smithi008.stdout:checking for RLIMIT_NOFILE... yes 2023-11-18T23:43:10.769 INFO:teuthology.orchestra.run.smithi008.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-18T23:43:10.803 INFO:teuthology.orchestra.run.smithi008.stdout:checking for renameat2... yes 2023-11-18T23:43:10.838 INFO:teuthology.orchestra.run.smithi008.stdout:checking for reallocarray... yes 2023-11-18T23:43:10.869 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct mount_attr... yes 2023-11-18T23:43:10.902 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-18T23:43:10.935 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-18T23:43:10.968 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-18T23:43:11.000 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-18T23:43:11.033 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-18T23:43:11.066 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-18T23:43:11.098 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-18T23:43:11.125 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/btrfs.h usability... yes 2023-11-18T23:43:11.134 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/btrfs.h presence... yes 2023-11-18T23:43:11.134 INFO:teuthology.orchestra.run.smithi008.stdout:checking for linux/btrfs.h... yes 2023-11-18T23:43:11.168 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/btrfs_tree.h usability... yes 2023-11-18T23:43:11.178 INFO:teuthology.orchestra.run.smithi008.stdout:checking linux/btrfs_tree.h presence... yes 2023-11-18T23:43:11.178 INFO:teuthology.orchestra.run.smithi008.stdout:checking for linux/btrfs_tree.h... yes 2023-11-18T23:43:11.199 INFO:teuthology.orchestra.run.smithi008.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-18T23:43:11.215 INFO:teuthology.orchestra.run.smithi008.stdout:configure: creating ./config.status 2023-11-18T23:43:11.522 INFO:teuthology.orchestra.run.smithi008.stdout:config.status: creating include/builddefs 2023-11-18T23:43:11.532 INFO:teuthology.orchestra.run.smithi008.stdout:config.status: creating include/config.h 2023-11-18T23:43:11.541 INFO:teuthology.orchestra.run.smithi008.stdout:config.status: executing libtool commands 2023-11-18T23:43:11.579 INFO:teuthology.orchestra.run.smithi008.stdout:Building include 2023-11-18T23:43:11.582 INFO:teuthology.orchestra.run.smithi008.stdout:Building lib 2023-11-18T23:43:11.585 INFO:teuthology.orchestra.run.smithi008.stdout: [LTDEP] 2023-11-18T23:43:11.724 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dataascii.lo 2023-11-18T23:43:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] databin.lo 2023-11-18T23:43:11.973 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] datapid.lo 2023-11-18T23:43:12.071 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] file_lock.lo 2023-11-18T23:43:12.209 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] forker.lo 2023-11-18T23:43:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] pattern.lo 2023-11-18T23:43:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] open_flags.lo 2023-11-18T23:43:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] random_range.lo 2023-11-18T23:43:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] string_to_tokens.lo 2023-11-18T23:43:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] str_to_bytes.lo 2023-11-18T23:43:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] tlibio.lo 2023-11-18T23:43:13.020 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:43:13.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:43:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] write_log.lo 2023-11-18T23:43:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] random.lo 2023-11-18T23:43:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: [LD] 2023-11-18T23:43:13.635 INFO:teuthology.orchestra.run.smithi008.stdout:Building ltp 2023-11-18T23:43:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: [DEP] 2023-11-18T23:43:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] doio 2023-11-18T23:43:14.412 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fsstress 2023-11-18T23:43:15.789 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fsx 2023-11-18T23:43:16.490 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] growfiles 2023-11-18T23:43:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] iogen 2023-11-18T23:43:17.305 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-stress 2023-11-18T23:43:17.701 INFO:teuthology.orchestra.run.smithi008.stdout:Building src 2023-11-18T23:43:17.707 INFO:teuthology.orchestra.run.smithi008.stdout: [DEP] 2023-11-18T23:43:19.448 INFO:teuthology.orchestra.run.smithi008.stdout: [DEP] 2023-11-18T23:43:19.478 INFO:teuthology.orchestra.run.smithi008.stdout: [DEP] 2023-11-18T23:43:19.486 INFO:teuthology.orchestra.run.smithi008.stdout: [DEP] 2023-11-18T23:43:19.703 INFO:teuthology.orchestra.run.smithi008.stdout: [DEP] 2023-11-18T23:43:19.724 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dirstress 2023-11-18T23:43:19.940 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fill 2023-11-18T23:43:20.076 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fill2 2023-11-18T23:43:20.282 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] getpagesize 2023-11-18T23:43:20.400 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] holes 2023-11-18T23:43:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] lstat64 2023-11-18T23:43:20.737 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] nametest 2023-11-18T23:43:20.953 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] permname 2023-11-18T23:43:21.131 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] randholes 2023-11-18T23:43:21.354 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] runas 2023-11-18T23:43:21.508 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] truncfile 2023-11-18T23:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] usemem 2023-11-18T23:43:21.797 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] mmapcat 2023-11-18T23:43:21.926 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] append_reader 2023-11-18T23:43:22.059 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] append_writer 2023-11-18T23:43:22.192 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dirperf 2023-11-18T23:43:22.396 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] metaperf 2023-11-18T23:43:22.644 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] devzero 2023-11-18T23:43:22.797 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] feature 2023-11-18T23:43:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] alloc 2023-11-18T23:43:23.176 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fault 2023-11-18T23:43:23.317 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fstest 2023-11-18T23:43:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_access_root 2023-11-18T23:43:23.664 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] godown 2023-11-18T23:43:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] resvtest 2023-11-18T23:43:23.975 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] writemod 2023-11-18T23:43:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] writev_on_pagefault 2023-11-18T23:43:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] makeextents 2023-11-18T23:43:24.404 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] itrash 2023-11-18T23:43:24.536 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] rename 2023-11-18T23:43:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] multi_open_unlink 2023-11-18T23:43:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] unwritten_sync 2023-11-18T23:43:24.960 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] genhashnames 2023-11-18T23:43:25.132 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_holes 2023-11-18T23:43:25.260 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_writev 2023-11-18T23:43:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_truncate_cmtime 2023-11-18T23:43:25.528 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dirhash_collide 2023-11-18T23:43:25.689 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_rename_overwrite 2023-11-18T23:43:25.811 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] holetest 2023-11-18T23:43:26.020 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_truncate_self 2023-11-18T23:43:26.143 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] af_unix 2023-11-18T23:43:26.276 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_stale_pmd 2023-11-18T23:43:26.411 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_cow_race 2023-11-18T23:43:26.555 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_fallocate 2023-11-18T23:43:26.687 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fsync-err 2023-11-18T23:43:26.851 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_write_ro 2023-11-18T23:43:26.984 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-18T23:43:27.126 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-18T23:43:27.263 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_ofd_locks 2023-11-18T23:43:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_collision 2023-11-18T23:43:27.613 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] mmap-write-concurrent 2023-11-18T23:43:27.761 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_get_file_time 2023-11-18T23:43:27.890 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_create_short_dirs 2023-11-18T23:43:28.040 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_create_long_dirs 2023-11-18T23:43:28.185 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_enospc 2023-11-18T23:43:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_writev_overlap 2023-11-18T23:43:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] checkpoint_journal 2023-11-18T23:43:28.634 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] mmap-rw-fault 2023-11-18T23:43:28.796 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] allocstale 2023-11-18T23:43:28.944 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_cow_memory_failure 2023-11-18T23:43:29.094 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fake-dump-rootino 2023-11-18T23:43:29.225 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dio-buf-fault 2023-11-18T23:43:29.360 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] rewinddir-test 2023-11-18T23:43:29.509 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] xfsctl 2023-11-18T23:43:29.678 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] bstat 2023-11-18T23:43:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mtab 2023-11-18T23:43:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] getdevicesize 2023-11-18T23:43:30.154 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] preallo_rw_pattern_reader 2023-11-18T23:43:30.292 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] preallo_rw_pattern_writer 2023-11-18T23:43:30.430 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] ftrunc 2023-11-18T23:43:30.559 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] trunc 2023-11-18T23:43:30.701 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fs_perms 2023-11-18T23:43:30.845 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] testx 2023-11-18T23:43:30.959 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] looptest 2023-11-18T23:43:31.131 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] locktest 2023-11-18T23:43:31.416 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] unwritten_mmap 2023-11-18T23:43:31.559 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] bulkstat_unlink_test 2023-11-18T23:43:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] deduperace 2023-11-18T23:43:31.909 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] bulkstat_unlink_test_modified 2023-11-18T23:43:32.085 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_dir_offset 2023-11-18T23:43:32.215 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_futimens 2023-11-18T23:43:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_immutable 2023-11-18T23:43:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] stale_handle 2023-11-18T23:43:33.068 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] pwrite_mmap_blocked 2023-11-18T23:43:33.203 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_dir_offset2 2023-11-18T23:43:33.374 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] seek_sanity_test 2023-11-18T23:43:33.785 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] seek_copy_test 2023-11-18T23:43:33.942 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_readdir_1 2023-11-18T23:43:34.071 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_readdir_2 2023-11-18T23:43:34.203 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fsync-tester 2023-11-18T23:43:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] nsexec 2023-11-18T23:43:34.591 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] cloner 2023-11-18T23:43:34.748 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] renameat2 2023-11-18T23:43:34.895 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_getcwd 2023-11-18T23:43:35.035 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] e4compact 2023-11-18T23:43:35.215 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] test-nextquota 2023-11-18T23:43:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] punch-alternating 2023-11-18T23:43:35.517 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-18T23:43:35.664 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] listxattr 2023-11-18T23:43:35.793 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dio-interleaved 2023-11-18T23:43:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_dir_type 2023-11-18T23:43:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dio-invalidate-cache 2023-11-18T23:43:36.254 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] stat_test 2023-11-18T23:43:36.523 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_encrypted_d_revalidate 2023-11-18T23:43:36.667 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] attr_replace_test 2023-11-18T23:43:36.811 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] swapon 2023-11-18T23:43:36.956 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] mkswap 2023-11-18T23:43:37.090 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_attr_corruption 2023-11-18T23:43:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_open_tmpfiles 2023-11-18T23:43:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fscrypt-crypt-util 2023-11-18T23:43:38.000 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] bulkstat_null_ocount 2023-11-18T23:43:38.139 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] splice-test 2023-11-18T23:43:38.301 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] chprojid_fail 2023-11-18T23:43:38.443 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] detached_mounts_propagation 2023-11-18T23:43:38.606 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] ext4_resize 2023-11-18T23:43:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_readdir_3 2023-11-18T23:43:38.911 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] splice2pipe 2023-11-18T23:43:39.053 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] uuid_ioctl 2023-11-18T23:43:39.190 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fiemap-tester 2023-11-18T23:43:39.431 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_stripealign 2023-11-18T23:43:39.566 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] open_by_handle 2023-11-18T23:43:39.792 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] dbtest 2023-11-18T23:43:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] t_mmap_dio 2023-11-18T23:43:40.156 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] xfsfind 2023-11-18T23:43:40.330 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] fssum 2023-11-18T23:43:40.743 INFO:teuthology.orchestra.run.smithi008.stdout:Building log-writes 2023-11-18T23:43:40.748 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] replay-log 2023-11-18T23:43:41.040 INFO:teuthology.orchestra.run.smithi008.stdout:Building perf 2023-11-18T23:43:41.044 INFO:teuthology.orchestra.run.smithi008.stdout:Building aio-dio-regress 2023-11-18T23:43:41.050 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aiocp 2023-11-18T23:43:41.256 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-18T23:43:41.407 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-append-write-read-race 2023-11-18T23:43:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-cow-race 2023-11-18T23:43:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-cycle-write 2023-11-18T23:43:41.859 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-eof-race 2023-11-18T23:43:42.022 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-extend-stat 2023-11-18T23:43:42.167 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-fcntl-race 2023-11-18T23:43:42.311 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-hole-filling-race 2023-11-18T23:43:42.441 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-invalidate-failure 2023-11-18T23:43:42.581 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-invalidate-readahead 2023-11-18T23:43:42.729 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aiodio_sparse2 2023-11-18T23:43:42.926 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-subblock-eof-read 2023-11-18T23:43:43.051 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-dio-write-verify 2023-11-18T23:43:43.085 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:43:43.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:43:43.224 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-18T23:43:43.342 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-18T23:43:43.455 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] aio-last-ref-held-by-io 2023-11-18T23:43:43.609 INFO:teuthology.orchestra.run.smithi008.stdout:Building vfs 2023-11-18T23:43:43.614 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] vfstest 2023-11-18T23:43:47.060 INFO:teuthology.orchestra.run.smithi008.stdout: [CC] mount-idmapped 2023-11-18T23:43:47.417 INFO:teuthology.orchestra.run.smithi008.stdout:Building m4 2023-11-18T23:43:47.420 INFO:teuthology.orchestra.run.smithi008.stdout:Building common 2023-11-18T23:43:47.424 INFO:teuthology.orchestra.run.smithi008.stdout:Building tests 2023-11-18T23:43:47.429 INFO:teuthology.orchestra.run.smithi008.stdout:Building btrfs 2023-11-18T23:43:47.434 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/btrfs/group.list 2023-11-18T23:43:47.495 INFO:teuthology.orchestra.run.smithi008.stdout:Building ceph 2023-11-18T23:43:47.500 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ceph/group.list 2023-11-18T23:43:47.514 INFO:teuthology.orchestra.run.smithi008.stdout:Building cifs 2023-11-18T23:43:47.519 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/cifs/group.list 2023-11-18T23:43:47.531 INFO:teuthology.orchestra.run.smithi008.stdout:Building ext4 2023-11-18T23:43:47.537 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ext4/group.list 2023-11-18T23:43:47.575 INFO:teuthology.orchestra.run.smithi008.stdout:Building f2fs 2023-11-18T23:43:47.580 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/f2fs/group.list 2023-11-18T23:43:47.597 INFO:teuthology.orchestra.run.smithi008.stdout:Building generic 2023-11-18T23:43:47.604 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/generic/group.list 2023-11-18T23:43:47.702 INFO:teuthology.orchestra.run.smithi008.stdout:Building nfs 2023-11-18T23:43:47.707 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/nfs/group.list 2023-11-18T23:43:47.722 INFO:teuthology.orchestra.run.smithi008.stdout:Building ocfs2 2023-11-18T23:43:47.727 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ocfs2/group.list 2023-11-18T23:43:47.740 INFO:teuthology.orchestra.run.smithi008.stdout:Building overlay 2023-11-18T23:43:47.745 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/overlay/group.list 2023-11-18T23:43:47.786 INFO:teuthology.orchestra.run.smithi008.stdout:Building perf 2023-11-18T23:43:47.791 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/perf/group.list 2023-11-18T23:43:47.803 INFO:teuthology.orchestra.run.smithi008.stdout:Building selftest 2023-11-18T23:43:47.808 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/selftest/group.list 2023-11-18T23:43:47.820 INFO:teuthology.orchestra.run.smithi008.stdout:Building shared 2023-11-18T23:43:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/shared/group.list 2023-11-18T23:43:47.842 INFO:teuthology.orchestra.run.smithi008.stdout:Building tmpfs 2023-11-18T23:43:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/tmpfs/group.list 2023-11-18T23:43:47.861 INFO:teuthology.orchestra.run.smithi008.stdout:Building udf 2023-11-18T23:43:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/udf/group.list 2023-11-18T23:43:47.877 INFO:teuthology.orchestra.run.smithi008.stdout:Building xfs 2023-11-18T23:43:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/xfs/group.list 2023-11-18T23:43:47.984 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo make install) 2023-11-18T23:43:48.025 INFO:teuthology.orchestra.run.smithi008.stdout:Building include 2023-11-18T23:43:48.029 INFO:teuthology.orchestra.run.smithi008.stdout:Building lib 2023-11-18T23:43:48.033 INFO:teuthology.orchestra.run.smithi008.stdout:Building ltp 2023-11-18T23:43:48.037 INFO:teuthology.orchestra.run.smithi008.stdout:Building src 2023-11-18T23:43:48.071 INFO:teuthology.orchestra.run.smithi008.stdout:Building log-writes 2023-11-18T23:43:48.074 INFO:teuthology.orchestra.run.smithi008.stdout:Building perf 2023-11-18T23:43:48.078 INFO:teuthology.orchestra.run.smithi008.stdout:Building aio-dio-regress 2023-11-18T23:43:48.082 INFO:teuthology.orchestra.run.smithi008.stdout:Building vfs 2023-11-18T23:43:48.086 INFO:teuthology.orchestra.run.smithi008.stdout:Building m4 2023-11-18T23:43:48.089 INFO:teuthology.orchestra.run.smithi008.stdout:Building common 2023-11-18T23:43:48.092 INFO:teuthology.orchestra.run.smithi008.stdout:Building tests 2023-11-18T23:43:48.098 INFO:teuthology.orchestra.run.smithi008.stdout:Building btrfs 2023-11-18T23:43:48.103 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/btrfs/group.list 2023-11-18T23:43:48.163 INFO:teuthology.orchestra.run.smithi008.stdout:Building ceph 2023-11-18T23:43:48.168 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ceph/group.list 2023-11-18T23:43:48.182 INFO:teuthology.orchestra.run.smithi008.stdout:Building cifs 2023-11-18T23:43:48.187 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/cifs/group.list 2023-11-18T23:43:48.199 INFO:teuthology.orchestra.run.smithi008.stdout:Building ext4 2023-11-18T23:43:48.205 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ext4/group.list 2023-11-18T23:43:48.243 INFO:teuthology.orchestra.run.smithi008.stdout:Building f2fs 2023-11-18T23:43:48.248 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/f2fs/group.list 2023-11-18T23:43:48.265 INFO:teuthology.orchestra.run.smithi008.stdout:Building generic 2023-11-18T23:43:48.271 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/generic/group.list 2023-11-18T23:43:48.369 INFO:teuthology.orchestra.run.smithi008.stdout:Building nfs 2023-11-18T23:43:48.373 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/nfs/group.list 2023-11-18T23:43:48.388 INFO:teuthology.orchestra.run.smithi008.stdout:Building ocfs2 2023-11-18T23:43:48.393 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ocfs2/group.list 2023-11-18T23:43:48.406 INFO:teuthology.orchestra.run.smithi008.stdout:Building overlay 2023-11-18T23:43:48.412 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/overlay/group.list 2023-11-18T23:43:48.453 INFO:teuthology.orchestra.run.smithi008.stdout:Building perf 2023-11-18T23:43:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/perf/group.list 2023-11-18T23:43:48.470 INFO:teuthology.orchestra.run.smithi008.stdout:Building selftest 2023-11-18T23:43:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/selftest/group.list 2023-11-18T23:43:48.487 INFO:teuthology.orchestra.run.smithi008.stdout:Building shared 2023-11-18T23:43:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/shared/group.list 2023-11-18T23:43:48.509 INFO:teuthology.orchestra.run.smithi008.stdout:Building tmpfs 2023-11-18T23:43:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/tmpfs/group.list 2023-11-18T23:43:48.528 INFO:teuthology.orchestra.run.smithi008.stdout:Building udf 2023-11-18T23:43:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/udf/group.list 2023-11-18T23:43:48.544 INFO:teuthology.orchestra.run.smithi008.stdout:Building xfs 2023-11-18T23:43:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: [GROUP] /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/xfs/group.list 2023-11-18T23:43:48.648 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-18T23:43:48.650 INFO:teuthology.orchestra.run.smithi008.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-18T23:43:48.650 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-18T23:43:48.652 INFO:teuthology.orchestra.run.smithi008.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-18T23:43:48.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-18T23:43:48.654 INFO:teuthology.orchestra.run.smithi008.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-18T23:43:48.663 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-18T23:43:48.732 INFO:teuthology.orchestra.run.smithi008.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-18T23:43:48.741 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-18T23:43:48.757 INFO:teuthology.orchestra.run.smithi008.stdout:Building log-writes 2023-11-18T23:43:48.761 INFO:teuthology.orchestra.run.smithi008.stdout:Building perf 2023-11-18T23:43:48.764 INFO:teuthology.orchestra.run.smithi008.stdout:Building aio-dio-regress 2023-11-18T23:43:48.768 INFO:teuthology.orchestra.run.smithi008.stdout:Building vfs 2023-11-18T23:43:48.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake -C log-writes install 2023-11-18T23:43:48.773 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-18T23:43:48.781 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-18T23:43:48.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake -C perf install 2023-11-18T23:43:48.791 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-18T23:43:48.800 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-18T23:43:48.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-18T23:43:48.823 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-18T23:43:48.832 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-18T23:43:48.881 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake -C vfs install 2023-11-18T23:43:48.882 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-18T23:43:48.890 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-18T23:43:48.902 INFO:teuthology.orchestra.run.smithi008.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-18T23:43:48.911 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-11-18T23:43:50.041 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-18T23:43:50.137 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-18T23:43:50.161 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-18T23:43:50.163 INFO:teuthology.orchestra.run.smithi008.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-18T23:43:50.163 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-18T23:43:50.164 INFO:teuthology.orchestra.run.smithi008.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-18T23:43:50.173 INFO:teuthology.orchestra.run.smithi008.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-18T23:43:50.297 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-18T23:43:50.298 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/btrfs/ install 2023-11-18T23:43:50.302 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-18T23:43:50.310 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 /var/lib/xfstests/tests/btrfs 2023-11-18T23:43:51.070 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-18T23:43:51.078 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out /var/lib/xfstests/tests/btrfs 2023-11-18T23:43:51.841 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ceph/ install 2023-11-18T23:43:51.842 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-18T23:43:51.851 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-18T23:43:51.869 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-18T23:43:51.878 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-18T23:43:51.896 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/cifs/ install 2023-11-18T23:43:51.898 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-18T23:43:51.907 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-18T23:43:51.915 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-18T23:43:51.924 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-18T23:43:51.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ext4/ install 2023-11-18T23:43:51.934 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-18T23:43:51.943 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-18T23:43:52.117 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-18T23:43:52.125 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-18T23:43:52.309 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/f2fs/ install 2023-11-18T23:43:52.310 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-18T23:43:52.319 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-18T23:43:52.330 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-18T23:43:52.338 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-18T23:43:52.349 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/generic/ install 2023-11-18T23:43:52.355 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-18T23:43:52.363 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-18T23:43:54.206 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-18T23:43:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-18T23:43:56.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/nfs/ install 2023-11-18T23:43:56.084 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-18T23:43:56.093 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-18T23:43:56.101 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-18T23:43:56.110 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-18T23:43:56.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/ocfs2/ install 2023-11-18T23:43:56.120 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-18T23:43:56.129 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-18T23:43:56.137 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-18T23:43:56.146 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-18T23:43:56.154 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/overlay/ install 2023-11-18T23:43:56.156 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-18T23:43:56.165 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-18T23:43:56.421 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-18T23:43:56.429 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-18T23:43:56.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/perf/ install 2023-11-18T23:43:56.686 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-18T23:43:56.695 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-18T23:43:56.703 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-18T23:43:56.712 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-18T23:43:56.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/selftest/ install 2023-11-18T23:43:56.725 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-18T23:43:56.731 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-18T23:43:56.752 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-18T23:43:56.761 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-18T23:43:56.782 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/shared/ install 2023-11-18T23:43:56.783 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-18T23:43:56.792 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-18T23:43:56.806 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-18T23:43:56.814 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-18T23:43:56.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/tmpfs/ install 2023-11-18T23:43:56.830 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-18T23:43:56.838 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-18T23:43:56.846 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-18T23:43:56.855 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-18T23:43:56.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/udf/ install 2023-11-18T23:43:56.865 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-18T23:43:56.874 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-18T23:43:56.882 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-18T23:43:56.891 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-18T23:43:56.899 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.kYHL8e4YNuxfstests-dev/tests/xfs/ install 2023-11-18T23:43:56.905 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-18T23:43:56.913 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-18T23:43:58.663 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-18T23:43:58.671 INFO:teuthology.orchestra.run.smithi008.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-18T23:44:00.442 INFO:teuthology.orchestra.run.smithi008.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-18T23:44:00.453 INFO:teuthology.orchestra.run.smithi008.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-18T23:44:00.460 INFO:teuthology.orchestra.run.smithi008.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-18T23:44:00.469 INFO:teuthology.orchestra.run.smithi008.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-18T23:44:00.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T23:44:00.480 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec ls tests/generic) 2023-11-18T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:001 2023-11-18T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:001.out 2023-11-18T23:44:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:002 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:002.out 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:003 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:003.out 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:004 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:004.out 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:005 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:005.out 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:006 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:006.out 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:007 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:007.out 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:008 2023-11-18T23:44:00.541 INFO:teuthology.orchestra.run.smithi008.stdout:008.out 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:009 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:009.out 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:010 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:010.out 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:011 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:011.out 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:012 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:012.out 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:013 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:013.out 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:014 2023-11-18T23:44:00.542 INFO:teuthology.orchestra.run.smithi008.stdout:014.out 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:015 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:015.out 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:016 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:016.out 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:017 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:017.out 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:018 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:018.out 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:019 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:019.out 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:020 2023-11-18T23:44:00.543 INFO:teuthology.orchestra.run.smithi008.stdout:020.out 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:021 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:021.out 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:022 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:022.out 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:023 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:023.out 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:024 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:024.out 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:025 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:025.out 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:026 2023-11-18T23:44:00.544 INFO:teuthology.orchestra.run.smithi008.stdout:026.out 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:027 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:027.out 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:028 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:028.out 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:029 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:029.out 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:030 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:030.out 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:031 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:031.out 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:032 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:032.out 2023-11-18T23:44:00.545 INFO:teuthology.orchestra.run.smithi008.stdout:033 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:033.out 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:034 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:034.out 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:035 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:035.cfg 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:035.out.default 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:035.out.nfs 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:036 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:036.out 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:037 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:037.out 2023-11-18T23:44:00.546 INFO:teuthology.orchestra.run.smithi008.stdout:038 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:038.out 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:039 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:039.out 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:040 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:040.out 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:041 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:041.out 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:042 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:042.out 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:043 2023-11-18T23:44:00.547 INFO:teuthology.orchestra.run.smithi008.stdout:043.out 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:044 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:044.out 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:045 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:045.out 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:046 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:046.out 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:047 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:047.out 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:048 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:048.out 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:049 2023-11-18T23:44:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:049.out 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:050 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:050.cfg 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:050.out.default 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:050.out.nojournal 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:050.out.xfsquota 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:051 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:051.out 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:052 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:052.out 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:053 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:053.out 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:054 2023-11-18T23:44:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:054.out 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:055 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:055.out 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:056 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:056.out 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:057 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:057.out 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:058 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:058.out 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:059 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:059.out 2023-11-18T23:44:00.550 INFO:teuthology.orchestra.run.smithi008.stdout:060 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:060.out 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:061 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:061.out 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:062 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:062.out 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:063 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:063.out 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:064 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:064.out 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:065 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:065.out 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:066 2023-11-18T23:44:00.551 INFO:teuthology.orchestra.run.smithi008.stdout:066.out 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:067 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:067.out 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:068 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:068.out 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:069 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:069.out 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:070 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:070.out 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:071 2023-11-18T23:44:00.552 INFO:teuthology.orchestra.run.smithi008.stdout:071.out 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:072 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:072.out 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:073 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:073.out 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:074 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:074.out 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:075 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:075.out 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:076 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:076.out 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:077 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:077.out 2023-11-18T23:44:00.553 INFO:teuthology.orchestra.run.smithi008.stdout:078 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:078.out 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:079 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:079.out 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:080 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:080.out 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:081 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:081.out 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:082 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:082.out 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:083 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:083.out 2023-11-18T23:44:00.554 INFO:teuthology.orchestra.run.smithi008.stdout:084 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:084.out 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:085 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:085.out 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:086 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:086.out 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:087 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:087.out 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:088 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:088.out 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:089 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:089.out 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:090 2023-11-18T23:44:00.555 INFO:teuthology.orchestra.run.smithi008.stdout:090.out 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:091 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:091.out 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:092 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:092.out 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:093 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:093.out 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:094 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:094.out 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:095 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:095.out 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:096 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:096.out 2023-11-18T23:44:00.556 INFO:teuthology.orchestra.run.smithi008.stdout:097 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:097.out 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:098 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:098.out 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:099 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:099.out 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:100 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:100.out 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:101 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:101.out 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:102 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:102.out 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:103 2023-11-18T23:44:00.557 INFO:teuthology.orchestra.run.smithi008.stdout:103.out 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:104 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:104.out 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:105 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:105.out 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:106 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:106.out 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:107 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:107.out 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:108 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:108.out 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:109 2023-11-18T23:44:00.558 INFO:teuthology.orchestra.run.smithi008.stdout:109.out 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:110 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:110.out 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:111 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:111.out 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:112 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:112.out 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:113 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:113.out 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:114 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:114.out 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:115 2023-11-18T23:44:00.559 INFO:teuthology.orchestra.run.smithi008.stdout:115.out 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:116 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:116.out 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:117 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:117.out 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:118 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:118.out 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:119 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:119.out 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:120 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:120.out 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:121 2023-11-18T23:44:00.560 INFO:teuthology.orchestra.run.smithi008.stdout:121.out 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:122 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:122.out 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:123 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:123.out 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:124 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:124.out 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:125 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:125.out 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:126 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:126.out 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:127 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:127.out 2023-11-18T23:44:00.561 INFO:teuthology.orchestra.run.smithi008.stdout:128 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:128.out 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:129 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:129.out 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:130 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:130.out 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:131 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:131.out 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:132 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:132.out 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:133 2023-11-18T23:44:00.562 INFO:teuthology.orchestra.run.smithi008.stdout:133.out 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:134 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:134.out 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:135 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:135.out 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:136 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:136.out 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:137 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:137.out 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:138 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:138.out 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:139 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:139.out 2023-11-18T23:44:00.563 INFO:teuthology.orchestra.run.smithi008.stdout:140 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:140.out 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:141 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:141.out 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:142 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:142.out 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:143 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:143.out 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:144 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:144.out 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:145 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:145.out 2023-11-18T23:44:00.564 INFO:teuthology.orchestra.run.smithi008.stdout:146 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:146.out 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:147 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:147.out 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:148 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:148.out 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:149 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:149.out 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:150 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:150.out 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:151 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:151.out 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:152 2023-11-18T23:44:00.565 INFO:teuthology.orchestra.run.smithi008.stdout:152.out 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:153 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:153.out 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:154 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:154.out 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:155 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:155.out 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:156 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:156.out 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:157 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:157.out 2023-11-18T23:44:00.566 INFO:teuthology.orchestra.run.smithi008.stdout:158 2023-11-18T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout:158.out 2023-11-18T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout:159 2023-11-18T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout:159.out 2023-11-18T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout:160 2023-11-18T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout:160.out 2023-11-18T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout:161 2023-11-18T23:44:00.567 INFO:teuthology.orchestra.run.smithi008.stdout:161.out 2023-11-18T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:162 2023-11-18T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:162.out 2023-11-18T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:163 2023-11-18T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:163.out 2023-11-18T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:164 2023-11-18T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:164.out 2023-11-18T23:44:00.568 INFO:teuthology.orchestra.run.smithi008.stdout:165 2023-11-18T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stdout:165.out 2023-11-18T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stdout:166 2023-11-18T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stdout:166.out 2023-11-18T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stdout:167 2023-11-18T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stdout:167.out 2023-11-18T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stdout:168 2023-11-18T23:44:00.569 INFO:teuthology.orchestra.run.smithi008.stdout:168.out 2023-11-18T23:44:00.570 INFO:teuthology.orchestra.run.smithi008.stdout:169 2023-11-18T23:44:00.570 INFO:teuthology.orchestra.run.smithi008.stdout:169.out 2023-11-18T23:44:00.570 INFO:teuthology.orchestra.run.smithi008.stdout:170 2023-11-18T23:44:00.570 INFO:teuthology.orchestra.run.smithi008.stdout:170.out 2023-11-18T23:44:00.570 INFO:teuthology.orchestra.run.smithi008.stdout:171 2023-11-18T23:44:00.570 INFO:teuthology.orchestra.run.smithi008.stdout:171.out 2023-11-18T23:44:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:172 2023-11-18T23:44:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:172.out 2023-11-18T23:44:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:173 2023-11-18T23:44:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:173.out 2023-11-18T23:44:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:174 2023-11-18T23:44:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:174.out 2023-11-18T23:44:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:175 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:175.out 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:176 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:176.out 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:177 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:177.out 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:178 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:178.out 2023-11-18T23:44:00.572 INFO:teuthology.orchestra.run.smithi008.stdout:179 2023-11-18T23:44:00.573 INFO:teuthology.orchestra.run.smithi008.stdout:179.out 2023-11-18T23:44:00.573 INFO:teuthology.orchestra.run.smithi008.stdout:180 2023-11-18T23:44:00.573 INFO:teuthology.orchestra.run.smithi008.stdout:180.out 2023-11-18T23:44:00.573 INFO:teuthology.orchestra.run.smithi008.stdout:181 2023-11-18T23:44:00.573 INFO:teuthology.orchestra.run.smithi008.stdout:181.out 2023-11-18T23:44:00.573 INFO:teuthology.orchestra.run.smithi008.stdout:182 2023-11-18T23:44:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:182.out 2023-11-18T23:44:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:183 2023-11-18T23:44:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:183.out 2023-11-18T23:44:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:184 2023-11-18T23:44:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:184.out 2023-11-18T23:44:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:185 2023-11-18T23:44:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:185.out 2023-11-18T23:44:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:186 2023-11-18T23:44:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:186.out 2023-11-18T23:44:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:187 2023-11-18T23:44:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:187.out 2023-11-18T23:44:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:188 2023-11-18T23:44:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:188.out 2023-11-18T23:44:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:189 2023-11-18T23:44:00.576 INFO:teuthology.orchestra.run.smithi008.stdout:189.out 2023-11-18T23:44:00.576 INFO:teuthology.orchestra.run.smithi008.stdout:190 2023-11-18T23:44:00.576 INFO:teuthology.orchestra.run.smithi008.stdout:190.out 2023-11-18T23:44:00.576 INFO:teuthology.orchestra.run.smithi008.stdout:191 2023-11-18T23:44:00.576 INFO:teuthology.orchestra.run.smithi008.stdout:191.out 2023-11-18T23:44:00.576 INFO:teuthology.orchestra.run.smithi008.stdout:192 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:192.out 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:193 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:193.out 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:194 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:194.out 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:195 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:195.out 2023-11-18T23:44:00.577 INFO:teuthology.orchestra.run.smithi008.stdout:196 2023-11-18T23:44:00.578 INFO:teuthology.orchestra.run.smithi008.stdout:196.out 2023-11-18T23:44:00.578 INFO:teuthology.orchestra.run.smithi008.stdout:197 2023-11-18T23:44:00.578 INFO:teuthology.orchestra.run.smithi008.stdout:197.out 2023-11-18T23:44:00.578 INFO:teuthology.orchestra.run.smithi008.stdout:198 2023-11-18T23:44:00.578 INFO:teuthology.orchestra.run.smithi008.stdout:198.out 2023-11-18T23:44:00.578 INFO:teuthology.orchestra.run.smithi008.stdout:199 2023-11-18T23:44:00.578 INFO:teuthology.orchestra.run.smithi008.stdout:199.out 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:200 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:200.out 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:201 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:201.out 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:202 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:202.out 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:203 2023-11-18T23:44:00.579 INFO:teuthology.orchestra.run.smithi008.stdout:203.out 2023-11-18T23:44:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:204 2023-11-18T23:44:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:204.out 2023-11-18T23:44:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:205 2023-11-18T23:44:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:205.out 2023-11-18T23:44:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:206 2023-11-18T23:44:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:206.out 2023-11-18T23:44:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:207 2023-11-18T23:44:00.581 INFO:teuthology.orchestra.run.smithi008.stdout:207.out 2023-11-18T23:44:00.581 INFO:teuthology.orchestra.run.smithi008.stdout:208 2023-11-18T23:44:00.581 INFO:teuthology.orchestra.run.smithi008.stdout:208.out 2023-11-18T23:44:00.581 INFO:teuthology.orchestra.run.smithi008.stdout:209 2023-11-18T23:44:00.581 INFO:teuthology.orchestra.run.smithi008.stdout:209.out 2023-11-18T23:44:00.581 INFO:teuthology.orchestra.run.smithi008.stdout:210 2023-11-18T23:44:00.581 INFO:teuthology.orchestra.run.smithi008.stdout:210.out 2023-11-18T23:44:00.582 INFO:teuthology.orchestra.run.smithi008.stdout:211 2023-11-18T23:44:00.582 INFO:teuthology.orchestra.run.smithi008.stdout:211.out 2023-11-18T23:44:00.582 INFO:teuthology.orchestra.run.smithi008.stdout:212 2023-11-18T23:44:00.582 INFO:teuthology.orchestra.run.smithi008.stdout:212.out 2023-11-18T23:44:00.582 INFO:teuthology.orchestra.run.smithi008.stdout:213 2023-11-18T23:44:00.582 INFO:teuthology.orchestra.run.smithi008.stdout:213.out 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:214 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:214.out 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:215 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:215.out 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:216 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:216.out 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:217 2023-11-18T23:44:00.583 INFO:teuthology.orchestra.run.smithi008.stdout:217.out 2023-11-18T23:44:00.584 INFO:teuthology.orchestra.run.smithi008.stdout:218 2023-11-18T23:44:00.584 INFO:teuthology.orchestra.run.smithi008.stdout:218.out 2023-11-18T23:44:00.584 INFO:teuthology.orchestra.run.smithi008.stdout:219 2023-11-18T23:44:00.584 INFO:teuthology.orchestra.run.smithi008.stdout:219.out 2023-11-18T23:44:00.584 INFO:teuthology.orchestra.run.smithi008.stdout:220 2023-11-18T23:44:00.584 INFO:teuthology.orchestra.run.smithi008.stdout:220.out 2023-11-18T23:44:00.584 INFO:teuthology.orchestra.run.smithi008.stdout:221 2023-11-18T23:44:00.585 INFO:teuthology.orchestra.run.smithi008.stdout:221.out 2023-11-18T23:44:00.585 INFO:teuthology.orchestra.run.smithi008.stdout:222 2023-11-18T23:44:00.585 INFO:teuthology.orchestra.run.smithi008.stdout:222.out 2023-11-18T23:44:00.585 INFO:teuthology.orchestra.run.smithi008.stdout:223 2023-11-18T23:44:00.585 INFO:teuthology.orchestra.run.smithi008.stdout:223.out 2023-11-18T23:44:00.585 INFO:teuthology.orchestra.run.smithi008.stdout:224 2023-11-18T23:44:00.585 INFO:teuthology.orchestra.run.smithi008.stdout:224.out 2023-11-18T23:44:00.586 INFO:teuthology.orchestra.run.smithi008.stdout:225 2023-11-18T23:44:00.586 INFO:teuthology.orchestra.run.smithi008.stdout:225.out 2023-11-18T23:44:00.586 INFO:teuthology.orchestra.run.smithi008.stdout:226 2023-11-18T23:44:00.586 INFO:teuthology.orchestra.run.smithi008.stdout:226.out 2023-11-18T23:44:00.586 INFO:teuthology.orchestra.run.smithi008.stdout:227 2023-11-18T23:44:00.586 INFO:teuthology.orchestra.run.smithi008.stdout:227.out 2023-11-18T23:44:00.587 INFO:teuthology.orchestra.run.smithi008.stdout:228 2023-11-18T23:44:00.587 INFO:teuthology.orchestra.run.smithi008.stdout:228.out 2023-11-18T23:44:00.587 INFO:teuthology.orchestra.run.smithi008.stdout:229 2023-11-18T23:44:00.587 INFO:teuthology.orchestra.run.smithi008.stdout:229.out 2023-11-18T23:44:00.587 INFO:teuthology.orchestra.run.smithi008.stdout:230 2023-11-18T23:44:00.587 INFO:teuthology.orchestra.run.smithi008.stdout:230.out 2023-11-18T23:44:00.588 INFO:teuthology.orchestra.run.smithi008.stdout:231 2023-11-18T23:44:00.588 INFO:teuthology.orchestra.run.smithi008.stdout:231.out 2023-11-18T23:44:00.588 INFO:teuthology.orchestra.run.smithi008.stdout:232 2023-11-18T23:44:00.588 INFO:teuthology.orchestra.run.smithi008.stdout:232.out 2023-11-18T23:44:00.588 INFO:teuthology.orchestra.run.smithi008.stdout:233 2023-11-18T23:44:00.588 INFO:teuthology.orchestra.run.smithi008.stdout:233.out 2023-11-18T23:44:00.588 INFO:teuthology.orchestra.run.smithi008.stdout:234 2023-11-18T23:44:00.589 INFO:teuthology.orchestra.run.smithi008.stdout:234.out 2023-11-18T23:44:00.589 INFO:teuthology.orchestra.run.smithi008.stdout:235 2023-11-18T23:44:00.589 INFO:teuthology.orchestra.run.smithi008.stdout:235.out 2023-11-18T23:44:00.589 INFO:teuthology.orchestra.run.smithi008.stdout:236 2023-11-18T23:44:00.589 INFO:teuthology.orchestra.run.smithi008.stdout:236.out 2023-11-18T23:44:00.590 INFO:teuthology.orchestra.run.smithi008.stdout:237 2023-11-18T23:44:00.590 INFO:teuthology.orchestra.run.smithi008.stdout:237.out 2023-11-18T23:44:00.590 INFO:teuthology.orchestra.run.smithi008.stdout:238 2023-11-18T23:44:00.590 INFO:teuthology.orchestra.run.smithi008.stdout:238.out 2023-11-18T23:44:00.590 INFO:teuthology.orchestra.run.smithi008.stdout:239 2023-11-18T23:44:00.590 INFO:teuthology.orchestra.run.smithi008.stdout:239.out 2023-11-18T23:44:00.591 INFO:teuthology.orchestra.run.smithi008.stdout:240 2023-11-18T23:44:00.591 INFO:teuthology.orchestra.run.smithi008.stdout:240.out 2023-11-18T23:44:00.591 INFO:teuthology.orchestra.run.smithi008.stdout:241 2023-11-18T23:44:00.591 INFO:teuthology.orchestra.run.smithi008.stdout:241.out 2023-11-18T23:44:00.591 INFO:teuthology.orchestra.run.smithi008.stdout:242 2023-11-18T23:44:00.591 INFO:teuthology.orchestra.run.smithi008.stdout:242.out 2023-11-18T23:44:00.592 INFO:teuthology.orchestra.run.smithi008.stdout:243 2023-11-18T23:44:00.592 INFO:teuthology.orchestra.run.smithi008.stdout:243.out 2023-11-18T23:44:00.592 INFO:teuthology.orchestra.run.smithi008.stdout:244 2023-11-18T23:44:00.592 INFO:teuthology.orchestra.run.smithi008.stdout:244.out 2023-11-18T23:44:00.592 INFO:teuthology.orchestra.run.smithi008.stdout:245 2023-11-18T23:44:00.592 INFO:teuthology.orchestra.run.smithi008.stdout:245.out 2023-11-18T23:44:00.592 INFO:teuthology.orchestra.run.smithi008.stdout:246 2023-11-18T23:44:00.593 INFO:teuthology.orchestra.run.smithi008.stdout:246.out 2023-11-18T23:44:00.593 INFO:teuthology.orchestra.run.smithi008.stdout:247 2023-11-18T23:44:00.593 INFO:teuthology.orchestra.run.smithi008.stdout:247.out 2023-11-18T23:44:00.593 INFO:teuthology.orchestra.run.smithi008.stdout:248 2023-11-18T23:44:00.593 INFO:teuthology.orchestra.run.smithi008.stdout:248.out 2023-11-18T23:44:00.593 INFO:teuthology.orchestra.run.smithi008.stdout:249 2023-11-18T23:44:00.594 INFO:teuthology.orchestra.run.smithi008.stdout:249.out 2023-11-18T23:44:00.594 INFO:teuthology.orchestra.run.smithi008.stdout:250 2023-11-18T23:44:00.594 INFO:teuthology.orchestra.run.smithi008.stdout:250.out 2023-11-18T23:44:00.594 INFO:teuthology.orchestra.run.smithi008.stdout:251 2023-11-18T23:44:00.594 INFO:teuthology.orchestra.run.smithi008.stdout:251.out 2023-11-18T23:44:00.595 INFO:teuthology.orchestra.run.smithi008.stdout:252 2023-11-18T23:44:00.595 INFO:teuthology.orchestra.run.smithi008.stdout:252.out 2023-11-18T23:44:00.595 INFO:teuthology.orchestra.run.smithi008.stdout:253 2023-11-18T23:44:00.595 INFO:teuthology.orchestra.run.smithi008.stdout:253.out 2023-11-18T23:44:00.595 INFO:teuthology.orchestra.run.smithi008.stdout:254 2023-11-18T23:44:00.595 INFO:teuthology.orchestra.run.smithi008.stdout:254.out 2023-11-18T23:44:00.596 INFO:teuthology.orchestra.run.smithi008.stdout:255 2023-11-18T23:44:00.596 INFO:teuthology.orchestra.run.smithi008.stdout:255.out 2023-11-18T23:44:00.596 INFO:teuthology.orchestra.run.smithi008.stdout:256 2023-11-18T23:44:00.596 INFO:teuthology.orchestra.run.smithi008.stdout:256.out 2023-11-18T23:44:00.596 INFO:teuthology.orchestra.run.smithi008.stdout:257 2023-11-18T23:44:00.596 INFO:teuthology.orchestra.run.smithi008.stdout:257.out 2023-11-18T23:44:00.596 INFO:teuthology.orchestra.run.smithi008.stdout:258 2023-11-18T23:44:00.597 INFO:teuthology.orchestra.run.smithi008.stdout:258.out 2023-11-18T23:44:00.597 INFO:teuthology.orchestra.run.smithi008.stdout:259 2023-11-18T23:44:00.597 INFO:teuthology.orchestra.run.smithi008.stdout:259.out 2023-11-18T23:44:00.597 INFO:teuthology.orchestra.run.smithi008.stdout:260 2023-11-18T23:44:00.597 INFO:teuthology.orchestra.run.smithi008.stdout:260.out 2023-11-18T23:44:00.597 INFO:teuthology.orchestra.run.smithi008.stdout:261 2023-11-18T23:44:00.597 INFO:teuthology.orchestra.run.smithi008.stdout:261.out 2023-11-18T23:44:00.598 INFO:teuthology.orchestra.run.smithi008.stdout:262 2023-11-18T23:44:00.598 INFO:teuthology.orchestra.run.smithi008.stdout:262.out 2023-11-18T23:44:00.598 INFO:teuthology.orchestra.run.smithi008.stdout:263 2023-11-18T23:44:00.598 INFO:teuthology.orchestra.run.smithi008.stdout:263.out 2023-11-18T23:44:00.598 INFO:teuthology.orchestra.run.smithi008.stdout:264 2023-11-18T23:44:00.598 INFO:teuthology.orchestra.run.smithi008.stdout:264.out 2023-11-18T23:44:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:265 2023-11-18T23:44:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:265.out 2023-11-18T23:44:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:266 2023-11-18T23:44:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:266.out 2023-11-18T23:44:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:267 2023-11-18T23:44:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:267.out 2023-11-18T23:44:00.599 INFO:teuthology.orchestra.run.smithi008.stdout:268 2023-11-18T23:44:00.600 INFO:teuthology.orchestra.run.smithi008.stdout:268.out 2023-11-18T23:44:00.600 INFO:teuthology.orchestra.run.smithi008.stdout:269 2023-11-18T23:44:00.600 INFO:teuthology.orchestra.run.smithi008.stdout:269.out 2023-11-18T23:44:00.600 INFO:teuthology.orchestra.run.smithi008.stdout:270 2023-11-18T23:44:00.600 INFO:teuthology.orchestra.run.smithi008.stdout:270.out 2023-11-18T23:44:00.600 INFO:teuthology.orchestra.run.smithi008.stdout:271 2023-11-18T23:44:00.600 INFO:teuthology.orchestra.run.smithi008.stdout:271.out 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:272 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:272.out 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:273 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:273.out 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:274 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:274.out 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:275 2023-11-18T23:44:00.601 INFO:teuthology.orchestra.run.smithi008.stdout:275.out 2023-11-18T23:44:00.602 INFO:teuthology.orchestra.run.smithi008.stdout:276 2023-11-18T23:44:00.602 INFO:teuthology.orchestra.run.smithi008.stdout:276.out 2023-11-18T23:44:00.602 INFO:teuthology.orchestra.run.smithi008.stdout:277 2023-11-18T23:44:00.602 INFO:teuthology.orchestra.run.smithi008.stdout:277.out 2023-11-18T23:44:00.602 INFO:teuthology.orchestra.run.smithi008.stdout:278 2023-11-18T23:44:00.602 INFO:teuthology.orchestra.run.smithi008.stdout:278.out 2023-11-18T23:44:00.603 INFO:teuthology.orchestra.run.smithi008.stdout:279 2023-11-18T23:44:00.603 INFO:teuthology.orchestra.run.smithi008.stdout:279.out 2023-11-18T23:44:00.603 INFO:teuthology.orchestra.run.smithi008.stdout:280 2023-11-18T23:44:00.603 INFO:teuthology.orchestra.run.smithi008.stdout:280.out 2023-11-18T23:44:00.603 INFO:teuthology.orchestra.run.smithi008.stdout:281 2023-11-18T23:44:00.603 INFO:teuthology.orchestra.run.smithi008.stdout:281.out 2023-11-18T23:44:00.603 INFO:teuthology.orchestra.run.smithi008.stdout:282 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:282.out 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:283 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:283.out 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:284 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:284.out 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:285 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:285.out 2023-11-18T23:44:00.604 INFO:teuthology.orchestra.run.smithi008.stdout:286 2023-11-18T23:44:00.605 INFO:teuthology.orchestra.run.smithi008.stdout:286.out 2023-11-18T23:44:00.605 INFO:teuthology.orchestra.run.smithi008.stdout:287 2023-11-18T23:44:00.605 INFO:teuthology.orchestra.run.smithi008.stdout:287.out 2023-11-18T23:44:00.605 INFO:teuthology.orchestra.run.smithi008.stdout:288 2023-11-18T23:44:00.605 INFO:teuthology.orchestra.run.smithi008.stdout:288.out 2023-11-18T23:44:00.605 INFO:teuthology.orchestra.run.smithi008.stdout:289 2023-11-18T23:44:00.605 INFO:teuthology.orchestra.run.smithi008.stdout:289.out 2023-11-18T23:44:00.606 INFO:teuthology.orchestra.run.smithi008.stdout:290 2023-11-18T23:44:00.606 INFO:teuthology.orchestra.run.smithi008.stdout:290.out 2023-11-18T23:44:00.606 INFO:teuthology.orchestra.run.smithi008.stdout:291 2023-11-18T23:44:00.606 INFO:teuthology.orchestra.run.smithi008.stdout:291.out 2023-11-18T23:44:00.606 INFO:teuthology.orchestra.run.smithi008.stdout:292 2023-11-18T23:44:00.606 INFO:teuthology.orchestra.run.smithi008.stdout:292.out 2023-11-18T23:44:00.606 INFO:teuthology.orchestra.run.smithi008.stdout:293 2023-11-18T23:44:00.607 INFO:teuthology.orchestra.run.smithi008.stdout:293.out 2023-11-18T23:44:00.607 INFO:teuthology.orchestra.run.smithi008.stdout:294 2023-11-18T23:44:00.607 INFO:teuthology.orchestra.run.smithi008.stdout:294.out 2023-11-18T23:44:00.607 INFO:teuthology.orchestra.run.smithi008.stdout:295 2023-11-18T23:44:00.607 INFO:teuthology.orchestra.run.smithi008.stdout:295.out 2023-11-18T23:44:00.607 INFO:teuthology.orchestra.run.smithi008.stdout:296 2023-11-18T23:44:00.607 INFO:teuthology.orchestra.run.smithi008.stdout:296.out 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:297 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:297.out 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:298 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:298.out 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:299 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:299.out 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:300 2023-11-18T23:44:00.608 INFO:teuthology.orchestra.run.smithi008.stdout:300.out 2023-11-18T23:44:00.609 INFO:teuthology.orchestra.run.smithi008.stdout:301 2023-11-18T23:44:00.609 INFO:teuthology.orchestra.run.smithi008.stdout:301.out 2023-11-18T23:44:00.609 INFO:teuthology.orchestra.run.smithi008.stdout:302 2023-11-18T23:44:00.609 INFO:teuthology.orchestra.run.smithi008.stdout:302.out 2023-11-18T23:44:00.609 INFO:teuthology.orchestra.run.smithi008.stdout:303 2023-11-18T23:44:00.609 INFO:teuthology.orchestra.run.smithi008.stdout:303.out 2023-11-18T23:44:00.609 INFO:teuthology.orchestra.run.smithi008.stdout:304 2023-11-18T23:44:00.610 INFO:teuthology.orchestra.run.smithi008.stdout:304.out 2023-11-18T23:44:00.610 INFO:teuthology.orchestra.run.smithi008.stdout:305 2023-11-18T23:44:00.610 INFO:teuthology.orchestra.run.smithi008.stdout:305.out 2023-11-18T23:44:00.610 INFO:teuthology.orchestra.run.smithi008.stdout:306 2023-11-18T23:44:00.610 INFO:teuthology.orchestra.run.smithi008.stdout:306.out 2023-11-18T23:44:00.610 INFO:teuthology.orchestra.run.smithi008.stdout:307 2023-11-18T23:44:00.610 INFO:teuthology.orchestra.run.smithi008.stdout:307.out 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:308 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:308.out 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:309 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:309.out 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:310 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:310.out 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:311 2023-11-18T23:44:00.611 INFO:teuthology.orchestra.run.smithi008.stdout:311.out 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:312 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:312.out 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:313 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:313.out 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:314 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:314.out 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:315 2023-11-18T23:44:00.612 INFO:teuthology.orchestra.run.smithi008.stdout:315.out 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:316 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:316.out 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:317 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:317.out 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:318 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:318.out 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:319 2023-11-18T23:44:00.613 INFO:teuthology.orchestra.run.smithi008.stdout:319.out 2023-11-18T23:44:00.614 INFO:teuthology.orchestra.run.smithi008.stdout:320 2023-11-18T23:44:00.614 INFO:teuthology.orchestra.run.smithi008.stdout:320.out 2023-11-18T23:44:00.614 INFO:teuthology.orchestra.run.smithi008.stdout:321 2023-11-18T23:44:00.614 INFO:teuthology.orchestra.run.smithi008.stdout:321.out 2023-11-18T23:44:00.614 INFO:teuthology.orchestra.run.smithi008.stdout:322 2023-11-18T23:44:00.614 INFO:teuthology.orchestra.run.smithi008.stdout:322.out 2023-11-18T23:44:00.614 INFO:teuthology.orchestra.run.smithi008.stdout:323 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:323.out 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:324 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:324.out 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:325 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:325.out 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:326 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:326.out 2023-11-18T23:44:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:327 2023-11-18T23:44:00.616 INFO:teuthology.orchestra.run.smithi008.stdout:327.out 2023-11-18T23:44:00.616 INFO:teuthology.orchestra.run.smithi008.stdout:328 2023-11-18T23:44:00.616 INFO:teuthology.orchestra.run.smithi008.stdout:328.out 2023-11-18T23:44:00.616 INFO:teuthology.orchestra.run.smithi008.stdout:329 2023-11-18T23:44:00.616 INFO:teuthology.orchestra.run.smithi008.stdout:329.out 2023-11-18T23:44:00.616 INFO:teuthology.orchestra.run.smithi008.stdout:330 2023-11-18T23:44:00.616 INFO:teuthology.orchestra.run.smithi008.stdout:330.out 2023-11-18T23:44:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:331 2023-11-18T23:44:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:331.out 2023-11-18T23:44:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:332 2023-11-18T23:44:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:332.out 2023-11-18T23:44:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:333 2023-11-18T23:44:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:333.out 2023-11-18T23:44:00.617 INFO:teuthology.orchestra.run.smithi008.stdout:334 2023-11-18T23:44:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:334.out 2023-11-18T23:44:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:335 2023-11-18T23:44:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:335.out 2023-11-18T23:44:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:336 2023-11-18T23:44:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:336.out 2023-11-18T23:44:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:337 2023-11-18T23:44:00.618 INFO:teuthology.orchestra.run.smithi008.stdout:337.out 2023-11-18T23:44:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:338 2023-11-18T23:44:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:338.out 2023-11-18T23:44:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:339 2023-11-18T23:44:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:339.out 2023-11-18T23:44:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:340 2023-11-18T23:44:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:340.out 2023-11-18T23:44:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:341 2023-11-18T23:44:00.620 INFO:teuthology.orchestra.run.smithi008.stdout:341.out 2023-11-18T23:44:00.620 INFO:teuthology.orchestra.run.smithi008.stdout:342 2023-11-18T23:44:00.620 INFO:teuthology.orchestra.run.smithi008.stdout:342.out 2023-11-18T23:44:00.620 INFO:teuthology.orchestra.run.smithi008.stdout:343 2023-11-18T23:44:00.620 INFO:teuthology.orchestra.run.smithi008.stdout:343.out 2023-11-18T23:44:00.620 INFO:teuthology.orchestra.run.smithi008.stdout:344 2023-11-18T23:44:00.620 INFO:teuthology.orchestra.run.smithi008.stdout:344.out 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:345 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:345.out 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:346 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:346.out 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:347 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:347.out 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:348 2023-11-18T23:44:00.621 INFO:teuthology.orchestra.run.smithi008.stdout:348.out 2023-11-18T23:44:00.622 INFO:teuthology.orchestra.run.smithi008.stdout:349 2023-11-18T23:44:00.622 INFO:teuthology.orchestra.run.smithi008.stdout:349.out 2023-11-18T23:44:00.622 INFO:teuthology.orchestra.run.smithi008.stdout:350 2023-11-18T23:44:00.622 INFO:teuthology.orchestra.run.smithi008.stdout:350.out 2023-11-18T23:44:00.622 INFO:teuthology.orchestra.run.smithi008.stdout:351 2023-11-18T23:44:00.622 INFO:teuthology.orchestra.run.smithi008.stdout:351.out 2023-11-18T23:44:00.622 INFO:teuthology.orchestra.run.smithi008.stdout:352 2023-11-18T23:44:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:352.out 2023-11-18T23:44:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:353 2023-11-18T23:44:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:353.out 2023-11-18T23:44:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:354 2023-11-18T23:44:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:354.out 2023-11-18T23:44:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:355 2023-11-18T23:44:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:355.out 2023-11-18T23:44:00.624 INFO:teuthology.orchestra.run.smithi008.stdout:356 2023-11-18T23:44:00.624 INFO:teuthology.orchestra.run.smithi008.stdout:356.out 2023-11-18T23:44:00.624 INFO:teuthology.orchestra.run.smithi008.stdout:357 2023-11-18T23:44:00.624 INFO:teuthology.orchestra.run.smithi008.stdout:357.out 2023-11-18T23:44:00.624 INFO:teuthology.orchestra.run.smithi008.stdout:358 2023-11-18T23:44:00.624 INFO:teuthology.orchestra.run.smithi008.stdout:358.out 2023-11-18T23:44:00.624 INFO:teuthology.orchestra.run.smithi008.stdout:359 2023-11-18T23:44:00.625 INFO:teuthology.orchestra.run.smithi008.stdout:359.out 2023-11-18T23:44:00.625 INFO:teuthology.orchestra.run.smithi008.stdout:360 2023-11-18T23:44:00.625 INFO:teuthology.orchestra.run.smithi008.stdout:360.out 2023-11-18T23:44:00.625 INFO:teuthology.orchestra.run.smithi008.stdout:361 2023-11-18T23:44:00.625 INFO:teuthology.orchestra.run.smithi008.stdout:361.out 2023-11-18T23:44:00.625 INFO:teuthology.orchestra.run.smithi008.stdout:362 2023-11-18T23:44:00.625 INFO:teuthology.orchestra.run.smithi008.stdout:362.out 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:363 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:363.out 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:364 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:364.out 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:365 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:365.out 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:366 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:366.out 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:367 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:367.out 2023-11-18T23:44:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:368 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:368.out 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:369 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:369.out 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:370 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:370.out 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:371 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:371.out 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:372 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:372.out 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:373 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:373.out 2023-11-18T23:44:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:374 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:374.out 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:375 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:375.out 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:376 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:376.out 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:377 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:377.out 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:378 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:378.out 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:379 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:379.out 2023-11-18T23:44:00.628 INFO:teuthology.orchestra.run.smithi008.stdout:380 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:380.out 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:381 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:381.out 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:382 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:382.out 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:383 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:383.out 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:384 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:384.out 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:385 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:385.out 2023-11-18T23:44:00.629 INFO:teuthology.orchestra.run.smithi008.stdout:386 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:386.out 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:387 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:387.out 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:388 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:388.out 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:389 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:389.out 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:390 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:390.out 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:391 2023-11-18T23:44:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:391.out 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:392 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:392.out 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:393 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:393.out 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:394 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:394.out 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:395 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:395.out 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:396 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:396.out 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:397 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:397.out 2023-11-18T23:44:00.631 INFO:teuthology.orchestra.run.smithi008.stdout:398 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:398.out 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:399 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:399.out 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:400 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:400.out 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:401 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:401.out 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:402 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:402.out 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:403 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:403.out 2023-11-18T23:44:00.632 INFO:teuthology.orchestra.run.smithi008.stdout:404 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:404.out 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:405 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:405.out 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:406 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:406.out 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:407 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:407.out 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:408 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:408.out 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:409 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:409.out 2023-11-18T23:44:00.633 INFO:teuthology.orchestra.run.smithi008.stdout:410 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:410.out 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:411 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:411.out 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:412 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:412.out 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:413 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:413.out 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:414 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:414.out 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:415 2023-11-18T23:44:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:415.out 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:416 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:416.out 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:417 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:417.out 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:418 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:418.out 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:419 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:419.out 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:420 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:420.out 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:421 2023-11-18T23:44:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:421.out 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:422 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:422.out 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:423 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:423.out 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:424 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:424.out 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:425 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:425.out 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:426 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:426.out 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:427 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:427.out 2023-11-18T23:44:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:428 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:428.out 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:429 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:429.out 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:430 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:430.out 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:431 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:431.out 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:432 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:432.out 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:433 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:433.out 2023-11-18T23:44:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:434 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:434.out 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:435 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:435.out 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:436 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:436.out 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:437 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:437.out 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:438 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:438.out 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:439 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:439.out 2023-11-18T23:44:00.638 INFO:teuthology.orchestra.run.smithi008.stdout:440 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:440.out 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:441 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:441.out 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:442 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:442.out 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:443 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:443.out 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:444 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:444.out 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:445 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:445.out 2023-11-18T23:44:00.639 INFO:teuthology.orchestra.run.smithi008.stdout:446 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:446.out 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:447 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:447.out 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:448 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:448.out 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:449 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:449.out 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:450 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:450.out 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:451 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:451.out 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:452 2023-11-18T23:44:00.640 INFO:teuthology.orchestra.run.smithi008.stdout:452.out 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:453 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:453.out 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:454 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:454.out 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:455 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:455.out 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:456 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:456.out 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:457 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:457.out 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:458 2023-11-18T23:44:00.641 INFO:teuthology.orchestra.run.smithi008.stdout:458.out 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:459 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:459.out 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:460 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:460.out 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:461 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:461.out 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:462 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:462.out 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:463 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:463.out 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:464 2023-11-18T23:44:00.642 INFO:teuthology.orchestra.run.smithi008.stdout:464.out 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:465 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:465.out 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:466 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:466.out 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:467 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:467.out 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:468 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:468.out 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:469 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:469.out 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:470 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:470.out 2023-11-18T23:44:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:471 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:471.out 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:472 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:472.out 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:473 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:473.out 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:474 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:474.out 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:475 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:475.out 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:476 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:476.out 2023-11-18T23:44:00.644 INFO:teuthology.orchestra.run.smithi008.stdout:477 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:477.out 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:478 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:478.out 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:479 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:479.out 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:480 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:480.out 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:481 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:481.out 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:482 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:482.out 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:483 2023-11-18T23:44:00.645 INFO:teuthology.orchestra.run.smithi008.stdout:483.out 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:484 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:484.out 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:485 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:485.out 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:486 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:486.out 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:487 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:487.out 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:488 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:488.out 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:489 2023-11-18T23:44:00.646 INFO:teuthology.orchestra.run.smithi008.stdout:489.out 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:490 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:490.out 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:491 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:491.out 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:492 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:492.out 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:493 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:493.out 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:494 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:494.out 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:495 2023-11-18T23:44:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:495.out 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:496 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:496.out 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:497 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:497.out 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:498 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:498.out 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:499 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:499.out 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:500 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:500.out 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:501 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:501.out 2023-11-18T23:44:00.648 INFO:teuthology.orchestra.run.smithi008.stdout:502 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:502.out 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:503 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:503.out 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:504 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:504.out 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:505 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:505.out 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:506 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:506.out 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:507 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:507.out 2023-11-18T23:44:00.649 INFO:teuthology.orchestra.run.smithi008.stdout:508 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:508.out 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:509 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:509.out 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:510 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:510.out 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:511 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:511.out 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:512 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:512.out 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:513 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:513.out 2023-11-18T23:44:00.650 INFO:teuthology.orchestra.run.smithi008.stdout:514 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:514.out 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:515 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:515.out 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:516 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:516.out 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:517 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:517.out 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:518 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:518.out 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:519 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:519.out 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:520 2023-11-18T23:44:00.651 INFO:teuthology.orchestra.run.smithi008.stdout:520.out 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:521 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:521.out 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:522 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:522.out 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:523 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:523.out 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:524 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:524.out 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:525 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:525.out 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:526 2023-11-18T23:44:00.652 INFO:teuthology.orchestra.run.smithi008.stdout:526.out 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:527 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:527.out 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:528 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:528.out 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:529 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:529.out 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:530 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:530.out 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:531 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:531.out 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:532 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:532.out 2023-11-18T23:44:00.653 INFO:teuthology.orchestra.run.smithi008.stdout:533 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:533.out 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:534 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:534.out 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:535 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:535.out 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:536 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:536.out 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:537 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:537.out 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:538 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:538.out 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:539 2023-11-18T23:44:00.654 INFO:teuthology.orchestra.run.smithi008.stdout:539.out 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:540 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:540.out 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:541 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:541.out 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:542 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:542.out 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:543 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:543.out 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:544 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:544.out 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:545 2023-11-18T23:44:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:545.out 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:546 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:546.out 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:547 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:547.out 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:548 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:548.out 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:549 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:549.out 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:550 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:550.out 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:551 2023-11-18T23:44:00.656 INFO:teuthology.orchestra.run.smithi008.stdout:551.out 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:552 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:552.out 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:553 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:553.out 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:554 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:554.out 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:555 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:555.out 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:556 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:556.out 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:557 2023-11-18T23:44:00.657 INFO:teuthology.orchestra.run.smithi008.stdout:557.out 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:558 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:558.out 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:559 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:559.out 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:560 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:560.out 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:561 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:561.out 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:562 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:562.out 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:563 2023-11-18T23:44:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:563.out 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:564 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:564.out 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:565 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:565.out 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:566 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:566.out 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:567 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:567.out 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:568 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:568.out 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:569 2023-11-18T23:44:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:569.out 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:570 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:570.out 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:571 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:571.out 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:572 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:572.out 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:573 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:573.out 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:574 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:574.out 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:575 2023-11-18T23:44:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:575.out 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:576 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:576.out 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:577 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:577.out 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:578 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:578.out 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:579 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:579.out 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:580 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:580.out 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:581 2023-11-18T23:44:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:581.out 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:582 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:582.out 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:583 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:583.out 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:584 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:584.out 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:585 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:585.out 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:586 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:586.out 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:587 2023-11-18T23:44:00.662 INFO:teuthology.orchestra.run.smithi008.stdout:587.out 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:588 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:588.out 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:589 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:589.out 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:590 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:590.out 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:591 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:591.out 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:592 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:592.out 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:593 2023-11-18T23:44:00.663 INFO:teuthology.orchestra.run.smithi008.stdout:593.out 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:594 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:594.out 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:595 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:595.out 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:596 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:596.out 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:597 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:597.out 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:598 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:598.out 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:599 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:599.out 2023-11-18T23:44:00.664 INFO:teuthology.orchestra.run.smithi008.stdout:600 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:600.out 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:601 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:601.out 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:602 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:602.out 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:603 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:603.out 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:604 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:604.out 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:605 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:605.out 2023-11-18T23:44:00.665 INFO:teuthology.orchestra.run.smithi008.stdout:606 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:606.out 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:607 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:607.out 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:608 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:608.out 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:609 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:609.out 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:610 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:610.out 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:611 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:611.out 2023-11-18T23:44:00.666 INFO:teuthology.orchestra.run.smithi008.stdout:612 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:612.out 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:613 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:613.out 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:614 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:614.out 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:615 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:615.out 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:616 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:616.out 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:617 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:617.out 2023-11-18T23:44:00.667 INFO:teuthology.orchestra.run.smithi008.stdout:618 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:618.out 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:619 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:619.out 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:620 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:620.out 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:621 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:621.out 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:622 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:622.out 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:623 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:623.out 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:624 2023-11-18T23:44:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:624.out 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:625 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:625.out 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:626 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:626.out 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:627 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:627.out 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:628 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:628.out 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:629 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:629.out 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:630 2023-11-18T23:44:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:630.out 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:631 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:631.out 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:632 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:632.out 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:633 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:633.out 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:634 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:634.out 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:635 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:635.out 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:636 2023-11-18T23:44:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:636.out 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:637 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:637.out 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:638 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:638.out 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:639 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:639.out 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:640 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:640.out 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:641 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:641.out 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:642 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:642.out 2023-11-18T23:44:00.671 INFO:teuthology.orchestra.run.smithi008.stdout:643 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:643.out 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:644 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:644.out 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:645 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:645.out 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:646 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:646.out 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:647 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:647.out 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:648 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:648.out 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:649 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:649.out 2023-11-18T23:44:00.672 INFO:teuthology.orchestra.run.smithi008.stdout:650 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:650.out 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:651 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:651.out 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:652 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:652.out 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:653 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:653.out 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:654 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:654.out 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:655 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:655.out 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:656 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:656.out 2023-11-18T23:44:00.673 INFO:teuthology.orchestra.run.smithi008.stdout:657 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:657.out 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:658 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:658.out 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:659 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:659.out 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:660 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:660.out 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:661 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:661.out 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:662 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:662.out 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:663 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:663.out 2023-11-18T23:44:00.674 INFO:teuthology.orchestra.run.smithi008.stdout:664 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:664.out 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:665 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:665.out 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:666 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:666.out 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:667 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:667.out 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:668 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:668.out 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:669 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:669.out 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:670 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:670.out 2023-11-18T23:44:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:671 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:671.out 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:672 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:672.out 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:673 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:673.out 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:674 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:674.out 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:675 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:675.out 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:676 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:676.out 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:677 2023-11-18T23:44:00.676 INFO:teuthology.orchestra.run.smithi008.stdout:677.out 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:678 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:678.out 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:679 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:679.out 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:680 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:680.out 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:681 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:681.out 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:682 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:682.out 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:683 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:683.out 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:684 2023-11-18T23:44:00.677 INFO:teuthology.orchestra.run.smithi008.stdout:684.out 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:685 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:685.out 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:686 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:686.out 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:687 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:687.out 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:688 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:688.out 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:689 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:689.out 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:690 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:690.out 2023-11-18T23:44:00.678 INFO:teuthology.orchestra.run.smithi008.stdout:691 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:691.out 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:692 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:692.out 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:693 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:693.out 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:694 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:694.out 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:695 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:695.out 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:696 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:696.out 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:697 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:697.out 2023-11-18T23:44:00.679 INFO:teuthology.orchestra.run.smithi008.stdout:698 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:698.out 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:699 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:699.out 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:700 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:700.out 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:701 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:701.out 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:702 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:702.out 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:703 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:703.out 2023-11-18T23:44:00.680 INFO:teuthology.orchestra.run.smithi008.stdout:704 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:704.out 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:705 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:705.out 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:706 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:706.out 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:707 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:707.out 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:708 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:708.out 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:709 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:709.out 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:710 2023-11-18T23:44:00.681 INFO:teuthology.orchestra.run.smithi008.stdout:710.out 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:711 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:711.out 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:712 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:712.out 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:713 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:713.out 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:714 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:714.out 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:715 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:715.out 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:716 2023-11-18T23:44:00.682 INFO:teuthology.orchestra.run.smithi008.stdout:716.out 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:717 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:717.out 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:718 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:718.out 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:719 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:719.out 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:720 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:720.out 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:721 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:721.out 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:722 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:722.out 2023-11-18T23:44:00.683 INFO:teuthology.orchestra.run.smithi008.stdout:723 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:723.out 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:724 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:724.out 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:725 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:725.out 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:726 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:726.out 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:727 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:727.out 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:728 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:728.out 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:729 2023-11-18T23:44:00.684 INFO:teuthology.orchestra.run.smithi008.stdout:729.out 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:730 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:730.out 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:731 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:731.out 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:732 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:732.out 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:group.list 2023-11-18T23:44:00.685 INFO:teuthology.orchestra.run.smithi008.stdout:Makefile 2023-11-18T23:44:00.686 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-11-18T23:44:00.837 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:44:00.841 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:44:00.841 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:02.792 INFO:teuthology.orchestra.run.smithi008.stdout:generic/001 2s 2023-11-18T23:44:02.796 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/001 2023-11-18T23:44:02.797 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:44:02.799 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:02.800 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[101198]: fuse finished with error 0 and tester_r 0 2023-11-18T23:44:02.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:44:02.809 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-11-18T23:44:02.979 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:44:02.983 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:44:02.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:03.375 INFO:teuthology.orchestra.run.smithi008.stdout:generic/002 1s 2023-11-18T23:44:03.380 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/002 2023-11-18T23:44:03.380 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:44:03.382 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:03.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:44:03.392 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-11-18T23:44:03.583 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:44:03.587 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:44:03.587 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:03.696 INFO:teuthology.orchestra.run.smithi008.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:44:03.700 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/003 2023-11-18T23:44:03.700 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/003 2023-11-18T23:44:03.700 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:44:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:03.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:44:03.711 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-11-18T23:44:03.880 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:44:03.884 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:44:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:04.000 INFO:teuthology.orchestra.run.smithi008.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-18T23:44:04.003 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/004 2023-11-18T23:44:04.003 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/004 2023-11-18T23:44:04.003 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:44:04.006 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:04.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:44:04.015 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-11-18T23:44:04.186 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:44:04.191 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:44:04.191 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:04.677 INFO:teuthology.orchestra.run.smithi008.stdout:generic/005 0s 2023-11-18T23:44:04.682 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/005 2023-11-18T23:44:04.683 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:44:04.685 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:04.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:44:04.695 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-11-18T23:44:04.891 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:44:04.895 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:44:04.895 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:13.222 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:44:13.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:44:36.268 INFO:teuthology.orchestra.run.smithi008.stdout:generic/006 32s 2023-11-18T23:44:36.350 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/006 2023-11-18T23:44:36.350 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:44:36.352 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:36.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:44:36.410 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-11-18T23:44:36.770 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:44:36.773 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:44:36.774 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:44:43.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:44:43.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:45:13.817 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:45:13.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:45:41.646 INFO:teuthology.orchestra.run.smithi008.stdout:generic/007 65s 2023-11-18T23:45:41.736 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/007 2023-11-18T23:45:41.736 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:45:41.738 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:45:41.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:45:41.749 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-11-18T23:45:41.952 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:45:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:45:41.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:45:42.867 INFO:teuthology.orchestra.run.smithi008.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-18T23:45:42.870 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/008 2023-11-18T23:45:42.871 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/008 2023-11-18T23:45:42.871 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:45:42.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:45:42.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:45:42.882 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-11-18T23:45:43.052 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:45:43.056 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:45:43.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:45:43.843 INFO:teuthology.orchestra.run.smithi008.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-18T23:45:43.846 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/009 2023-11-18T23:45:43.847 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/009 2023-11-18T23:45:43.847 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:45:43.849 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:45:43.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:45:43.858 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-11-18T23:45:44.025 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:45:44.029 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:45:44.029 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:45:44.125 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:45:44.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:45:44.646 INFO:teuthology.orchestra.run.smithi008.stdout:generic/010 0s 2023-11-18T23:45:44.808 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/010 2023-11-18T23:45:44.808 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:45:44.811 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:45:44.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:45:44.823 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-11-18T23:45:45.021 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:45:45.025 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:45:45.026 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:46:14.432 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:46:14.435 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:46:20.251 INFO:teuthology.orchestra.run.smithi008.stdout:generic/011 35s 2023-11-18T23:46:20.327 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/011 2023-11-18T23:46:20.327 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:46:20.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:46:20.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:46:20.345 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-11-18T23:46:20.566 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:46:20.570 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:46:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:46:21.470 INFO:teuthology.orchestra.run.smithi008.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:46:21.473 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/012 2023-11-18T23:46:21.473 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/012 2023-11-18T23:46:21.473 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:46:21.476 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:46:21.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:46:21.494 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-11-18T23:46:21.682 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:46:21.686 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:46:21.687 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:46:44.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:46:44.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:47:14.960 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:47:14.964 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:47:45.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:47:45.658 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:47:56.115 INFO:teuthology.orchestra.run.smithi008.stdout:generic/013 95s 2023-11-18T23:47:56.123 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/013 2023-11-18T23:47:56.123 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:47:56.126 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:47:56.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:47:56.137 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-11-18T23:47:56.403 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:47:56.409 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:47:56.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:48:15.732 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:48:15.737 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:48:15.820 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-18T23:48:15.819+0000 7fd4c2c2b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 164717) UID: 0 2023-11-18T23:48:15.820 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-18T23:48:15.819+0000 7f15bce65640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 164717) UID: 0 2023-11-18T23:51:31.509 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:51:31.513 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:52:01.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:52:01.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:52:31.755 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:52:31.758 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:52:47.333 INFO:teuthology.orchestra.run.smithi008.stdout:generic/014 291s 2023-11-18T23:52:47.495 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/014 2023-11-18T23:52:47.495 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:52:47.498 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:47.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:52:47.513 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-11-18T23:52:47.766 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:52:47.776 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:52:47.776 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:47.933 INFO:teuthology.orchestra.run.smithi008.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:52:47.938 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/015 2023-11-18T23:52:47.938 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/015 2023-11-18T23:52:47.938 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:52:47.941 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:47.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:52:47.953 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-11-18T23:52:48.206 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:52:48.212 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:52:48.213 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:49.610 INFO:teuthology.orchestra.run.smithi008.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:52:49.614 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/016 2023-11-18T23:52:49.614 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/016 2023-11-18T23:52:49.615 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:52:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:49.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:52:49.628 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-11-18T23:52:50.049 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:52:50.057 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:52:50.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:50.221 INFO:teuthology.orchestra.run.smithi008.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:52:50.226 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/017 2023-11-18T23:52:50.226 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/017 2023-11-18T23:52:50.226 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:52:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:50.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:52:50.240 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-11-18T23:52:50.478 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:52:50.483 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:52:50.483 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:50.651 INFO:teuthology.orchestra.run.smithi008.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:52:50.656 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/018 2023-11-18T23:52:50.656 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/018 2023-11-18T23:52:50.656 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:52:50.660 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:50.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:52:50.673 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-11-18T23:52:50.938 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:52:50.943 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:52:50.943 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:51.104 INFO:teuthology.orchestra.run.smithi008.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:52:51.108 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/019 2023-11-18T23:52:51.108 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/019 2023-11-18T23:52:51.108 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:52:51.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:52:51.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:52:51.122 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-11-18T23:52:51.378 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:52:51.383 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:52:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:00.869 INFO:teuthology.orchestra.run.smithi008.stdout:generic/020 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/020.out.bad) 2023-11-18T23:53:00.873 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/020.out 2023-11-18 23:42:21.552425581 +0000 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/020.out.bad 2023-11-18 23:53:00.867816217 +0000 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -47,9 +47,13 @@ 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: user.snrub="fish2\012" 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: *** really long value 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: -0000000 00 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: -* 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: -ATTRSIZE 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: +attr_set: No space left on device 2023-11-18T23:53:00.874 INFO:teuthology.orchestra.run.smithi008.stdout: +Could not set "long_attr" for 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: +attr_get: No data available 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: +Could not get "long_attr" for 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: +0000000 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: +attr_remove: No data available 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: +Could not remove "long_attr" for 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: *** set/get/remove really long names (expect failure) 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: attr_set: Invalid argument 2023-11-18T23:53:00.875 INFO:teuthology.orchestra.run.smithi008.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-11-18T23:53:00.877 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/020 2023-11-18T23:53:00.877 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/020 2023-11-18T23:53:00.878 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-18T23:53:00.880 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:00.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T23:53:00.897 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-18T23:53:00.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-18T23:53:00.898 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-11-18T23:53:01.353 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:01.359 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:01.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:53:01.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:53:02.856 INFO:teuthology.orchestra.run.smithi008.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:53:02.860 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/021 2023-11-18T23:53:02.860 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/021 2023-11-18T23:53:02.860 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:02.863 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:02.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:02.877 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-11-18T23:53:03.332 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:03.338 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:03.338 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:04.722 INFO:teuthology.orchestra.run.smithi008.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:53:04.726 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/022 2023-11-18T23:53:04.726 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/022 2023-11-18T23:53:04.726 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:04.729 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:04.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:04.744 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-11-18T23:53:05.208 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:05.214 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:05.214 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:06.988 INFO:teuthology.orchestra.run.smithi008.stdout:generic/023 1s 2023-11-18T23:53:06.997 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/023 2023-11-18T23:53:06.997 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:07.001 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:07.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:07.012 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-11-18T23:53:07.490 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:07.495 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:07.495 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:07.700 INFO:teuthology.orchestra.run.smithi008.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-18T23:53:07.705 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/024 2023-11-18T23:53:07.705 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/024 2023-11-18T23:53:07.705 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:07.708 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:07.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:07.720 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-11-18T23:53:08.167 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:08.172 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:08.373 INFO:teuthology.orchestra.run.smithi008.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-18T23:53:08.378 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/025 2023-11-18T23:53:08.378 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/025 2023-11-18T23:53:08.378 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:08.381 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:08.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:08.394 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-11-18T23:53:08.844 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:08.850 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:08.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:09.060 INFO:teuthology.orchestra.run.smithi008.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-18T23:53:09.065 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/026 2023-11-18T23:53:09.065 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/026 2023-11-18T23:53:09.065 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:09.068 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:09.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:09.081 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-11-18T23:53:09.342 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:09.347 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:09.347 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:09.503 INFO:teuthology.orchestra.run.smithi008.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:09.507 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/027 2023-11-18T23:53:09.507 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/027 2023-11-18T23:53:09.507 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:09.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:09.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:09.521 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-11-18T23:53:09.774 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:09.780 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:09.780 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:14.964 INFO:teuthology.orchestra.run.smithi008.stdout:generic/028 5s 2023-11-18T23:53:14.992 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/028 2023-11-18T23:53:14.992 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:14.996 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:15.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:15.008 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-11-18T23:53:15.263 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:15.270 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:15.270 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:15.426 INFO:teuthology.orchestra.run.smithi008.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:15.431 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/029 2023-11-18T23:53:15.432 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/029 2023-11-18T23:53:15.432 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:15.435 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:15.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:15.448 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-11-18T23:53:15.704 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:15.709 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:15.710 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:15.869 INFO:teuthology.orchestra.run.smithi008.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:15.874 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/030 2023-11-18T23:53:15.874 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/030 2023-11-18T23:53:15.874 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:15.878 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:15.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:15.889 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-11-18T23:53:16.147 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:16.153 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:16.153 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/031 2023-11-18T23:53:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/031 2023-11-18T23:53:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:16.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:16.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:16.331 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-11-18T23:53:16.583 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:16.592 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:16.592 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:16.756 INFO:teuthology.orchestra.run.smithi008.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:16.761 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/032 2023-11-18T23:53:16.761 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/032 2023-11-18T23:53:16.761 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:16.764 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:16.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:16.777 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-11-18T23:53:17.025 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:17.030 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:17.030 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:17.210 INFO:teuthology.orchestra.run.smithi008.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:17.215 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/033 2023-11-18T23:53:17.215 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/033 2023-11-18T23:53:17.215 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:17.219 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:17.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:17.231 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-11-18T23:53:17.469 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:17.477 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:17.477 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:17.651 INFO:teuthology.orchestra.run.smithi008.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:17.656 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/034 2023-11-18T23:53:17.656 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/034 2023-11-18T23:53:17.656 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:17.661 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:17.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:17.674 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-11-18T23:53:17.924 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:17.929 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:17.929 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:18.186 INFO:teuthology.orchestra.run.smithi008.stdout:generic/035 1s 2023-11-18T23:53:18.193 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/035 2023-11-18T23:53:18.194 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:18.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:18.218 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-11-18T23:53:18.622 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:18.627 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:28.906 INFO:teuthology.orchestra.run.smithi008.stdout:generic/036 10s 2023-11-18T23:53:28.913 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/036 2023-11-18T23:53:28.913 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:28.915 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:28.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:28.933 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-11-18T23:53:29.356 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:29.362 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:29.362 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:29.526 INFO:teuthology.orchestra.run.smithi008.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:29.531 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/037 2023-11-18T23:53:29.531 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/037 2023-11-18T23:53:29.532 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:29.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:29.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:29.547 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-11-18T23:53:29.789 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:29.795 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:29.796 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:29.953 INFO:teuthology.orchestra.run.smithi008.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:29.957 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/038 2023-11-18T23:53:29.958 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/038 2023-11-18T23:53:29.958 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:29.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:29.975 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-11-18T23:53:30.212 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:30.219 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:30.219 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:30.390 INFO:teuthology.orchestra.run.smithi008.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:30.395 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/039 2023-11-18T23:53:30.396 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/039 2023-11-18T23:53:30.396 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:30.399 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:30.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:30.411 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-11-18T23:53:30.650 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:30.656 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:30.656 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:30.827 INFO:teuthology.orchestra.run.smithi008.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:30.832 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/040 2023-11-18T23:53:30.832 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/040 2023-11-18T23:53:30.832 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:30.835 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:30.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:30.849 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-11-18T23:53:31.092 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:31.097 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:31.098 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:31.289 INFO:teuthology.orchestra.run.smithi008.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:31.293 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/041 2023-11-18T23:53:31.294 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/041 2023-11-18T23:53:31.294 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:31.296 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:31.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:31.309 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-11-18T23:53:31.573 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:31.580 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:31.580 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:31.750 INFO:teuthology.orchestra.run.smithi008.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:31.754 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/042 2023-11-18T23:53:31.754 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/042 2023-11-18T23:53:31.754 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:31.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:31.769 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-11-18T23:53:32.012 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:32.017 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:32.017 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:32.053 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:53:32.056 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:53:32.179 INFO:teuthology.orchestra.run.smithi008.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:32.184 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/043 2023-11-18T23:53:32.184 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/043 2023-11-18T23:53:32.184 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:32.187 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:32.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:32.202 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-11-18T23:53:32.461 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:32.466 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:32.466 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:32.614 INFO:teuthology.orchestra.run.smithi008.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/044 2023-11-18T23:53:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/044 2023-11-18T23:53:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:32.623 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:32.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:32.634 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-11-18T23:53:32.900 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:32.907 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:33.062 INFO:teuthology.orchestra.run.smithi008.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:33.066 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/045 2023-11-18T23:53:33.066 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/045 2023-11-18T23:53:33.066 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:33.069 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:33.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:33.080 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-11-18T23:53:33.376 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:33.385 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:33.385 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:33.552 INFO:teuthology.orchestra.run.smithi008.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:33.555 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/046 2023-11-18T23:53:33.555 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/046 2023-11-18T23:53:33.555 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:33.558 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:33.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:33.566 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-11-18T23:53:33.735 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:33.740 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:33.740 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:33.847 INFO:teuthology.orchestra.run.smithi008.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:33.851 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/047 2023-11-18T23:53:33.851 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/047 2023-11-18T23:53:33.851 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:33.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:33.862 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-11-18T23:53:34.032 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:34.036 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:34.036 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:34.143 INFO:teuthology.orchestra.run.smithi008.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:34.147 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/048 2023-11-18T23:53:34.147 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/048 2023-11-18T23:53:34.147 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:34.149 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:34.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:34.158 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-11-18T23:53:34.327 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:34.331 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:34.332 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/049 2023-11-18T23:53:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/049 2023-11-18T23:53:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:34.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:34.455 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-11-18T23:53:34.623 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:34.627 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:34.628 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:34.741 INFO:teuthology.orchestra.run.smithi008.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:34.745 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/050 2023-11-18T23:53:34.745 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/050 2023-11-18T23:53:34.745 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:34.747 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:34.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:34.756 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-11-18T23:53:34.925 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:34.929 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:34.929 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.039 INFO:teuthology.orchestra.run.smithi008.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:35.042 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/051 2023-11-18T23:53:35.042 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/051 2023-11-18T23:53:35.043 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:35.045 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:35.053 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-11-18T23:53:35.223 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:35.227 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:35.227 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.344 INFO:teuthology.orchestra.run.smithi008.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:35.348 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/052 2023-11-18T23:53:35.348 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/052 2023-11-18T23:53:35.348 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:35.359 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-11-18T23:53:35.528 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:35.532 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:35.532 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/053 2023-11-18T23:53:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/053 2023-11-18T23:53:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:35.647 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:35.670 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-11-18T23:53:35.841 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:35.845 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:35.845 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.960 INFO:teuthology.orchestra.run.smithi008.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:35.963 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/054 2023-11-18T23:53:35.964 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/054 2023-11-18T23:53:35.964 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:35.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:35.975 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-11-18T23:53:36.144 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:36.148 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:36.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:36.259 INFO:teuthology.orchestra.run.smithi008.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:36.263 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/055 2023-11-18T23:53:36.263 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/055 2023-11-18T23:53:36.263 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:36.265 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:36.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:36.274 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-11-18T23:53:36.442 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:36.446 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:36.447 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:36.569 INFO:teuthology.orchestra.run.smithi008.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:36.574 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/056 2023-11-18T23:53:36.574 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/056 2023-11-18T23:53:36.575 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:36.575 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:36.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:36.584 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-11-18T23:53:36.753 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:36.757 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:36.876 INFO:teuthology.orchestra.run.smithi008.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:36.879 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/057 2023-11-18T23:53:36.879 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/057 2023-11-18T23:53:36.879 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:36.881 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:36.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:36.890 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-11-18T23:53:37.061 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:37.065 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:37.065 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:37.935 INFO:teuthology.orchestra.run.smithi008.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:53:37.939 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/058 2023-11-18T23:53:37.939 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/058 2023-11-18T23:53:37.939 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:37.941 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:37.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:37.990 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-11-18T23:53:38.355 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:38.359 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:38.481 INFO:teuthology.orchestra.run.smithi008.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:38.484 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/059 2023-11-18T23:53:38.484 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/059 2023-11-18T23:53:38.484 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:38.487 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:38.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:38.496 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-11-18T23:53:38.664 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:38.668 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:39.527 INFO:teuthology.orchestra.run.smithi008.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:53:39.530 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/060 2023-11-18T23:53:39.530 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/060 2023-11-18T23:53:39.530 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:39.532 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:39.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:39.542 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-11-18T23:53:39.928 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:39.933 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:40.782 INFO:teuthology.orchestra.run.smithi008.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:53:40.786 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/061 2023-11-18T23:53:40.786 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/061 2023-11-18T23:53:40.786 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:40.788 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:40.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:40.834 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-11-18T23:53:41.203 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:41.207 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:41.207 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:41.319 INFO:teuthology.orchestra.run.smithi008.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:41.322 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/062 2023-11-18T23:53:41.323 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/062 2023-11-18T23:53:41.323 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:41.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:41.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:41.349 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-11-18T23:53:41.521 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:41.525 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:42.396 INFO:teuthology.orchestra.run.smithi008.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-18T23:53:42.400 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/063 2023-11-18T23:53:42.400 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/063 2023-11-18T23:53:42.400 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:42.402 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:42.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:42.449 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-11-18T23:53:42.820 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:42.824 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:42.933 INFO:teuthology.orchestra.run.smithi008.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:42.936 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/064 2023-11-18T23:53:42.936 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/064 2023-11-18T23:53:42.936 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:42.939 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:42.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:42.948 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-11-18T23:53:43.117 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:43.121 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:43.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:43.239 INFO:teuthology.orchestra.run.smithi008.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:43.243 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/065 2023-11-18T23:53:43.243 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/065 2023-11-18T23:53:43.243 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:43.246 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:43.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:43.255 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-11-18T23:53:43.425 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:43.429 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:43.429 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:43.550 INFO:teuthology.orchestra.run.smithi008.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:43.554 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/066 2023-11-18T23:53:43.554 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/066 2023-11-18T23:53:43.554 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:43.556 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:43.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:43.564 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-11-18T23:53:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:43.738 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:43.867 INFO:teuthology.orchestra.run.smithi008.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:43.870 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/067 2023-11-18T23:53:43.870 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/067 2023-11-18T23:53:43.871 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:43.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:43.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:43.890 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-11-18T23:53:44.061 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:44.065 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:44.065 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:44.188 INFO:teuthology.orchestra.run.smithi008.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:44.191 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/068 2023-11-18T23:53:44.191 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/068 2023-11-18T23:53:44.191 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:44.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:44.203 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-11-18T23:53:44.374 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:44.377 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:44.378 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:44.486 INFO:teuthology.orchestra.run.smithi008.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:53:44.489 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/069 2023-11-18T23:53:44.489 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/069 2023-11-18T23:53:44.490 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:53:44.492 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:53:44.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:53:44.500 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-11-18T23:53:44.669 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:53:44.673 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:53:44.673 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:02.131 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:54:02.135 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:54:32.330 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:54:32.333 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout:generic/070 57s 2023-11-18T23:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/070 2023-11-18T23:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:41.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:54:41.552 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-11-18T23:54:42.008 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:54:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:54:42.015 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:42.172 INFO:teuthology.orchestra.run.smithi008.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:54:42.177 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/071 2023-11-18T23:54:42.177 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/071 2023-11-18T23:54:42.177 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:54:42.181 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:42.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:54:42.193 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-11-18T23:54:42.522 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:54:42.528 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:54:42.528 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:43.863 INFO:teuthology.orchestra.run.smithi008.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-18T23:54:43.867 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/072 2023-11-18T23:54:43.867 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/072 2023-11-18T23:54:43.867 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:54:43.871 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:43.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:54:43.884 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-11-18T23:54:44.142 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:54:44.152 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:54:44.152 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:44.323 INFO:teuthology.orchestra.run.smithi008.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-11-18T23:54:44.328 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/073 2023-11-18T23:54:44.328 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/073 2023-11-18T23:54:44.328 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-18T23:54:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:54:44.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-18T23:54:44.347 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-11-18T23:54:44.610 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-18T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-18T23:54:44.616 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-18T23:55:02.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:55:02.399 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:55:32.676 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:55:32.679 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:56:03.092 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:56:03.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:56:33.153 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:56:33.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:57:03.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:57:03.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:57:33.552 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:57:33.555 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:58:03.749 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:58:03.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:58:33.847 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:58:33.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:59:03.938 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:59:03.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:59:34.258 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T23:59:34.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:00:04.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:00:04.583 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:00:34.666 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:00:34.670 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:01:04.827 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:01:04.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:01:34.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:01:34.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:02:05.234 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:02:05.238 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:02:35.307 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:02:35.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:03:05.542 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:03:05.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:03:35.887 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:03:35.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:04:05.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:04:05.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:04:36.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:04:36.039 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:05:06.110 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:05:06.113 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:05:36.246 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:05:36.249 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:06:06.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:06:06.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:06:36.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:06:36.760 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:07:07.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:07:07.124 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:07:37.200 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:07:37.204 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:08:07.524 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:08:07.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:08:37.602 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:08:37.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:09:07.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:09:07.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:09:37.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:09:37.827 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:10:07.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:10:07.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:10:38.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:10:38.154 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:11:08.471 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:11:08.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:11:38.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:11:38.573 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:12:08.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:12:08.758 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:12:38.833 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:12:38.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:13:08.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:13:08.926 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:13:39.030 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:13:39.033 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:14:09.161 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:14:09.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:14:39.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:14:39.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:15:09.748 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:15:09.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:15:39.845 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:15:39.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:16:10.191 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:16:10.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:16:40.265 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:16:40.269 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:17:10.321 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:17:10.324 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:17:40.468 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:17:40.471 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:17:40.558 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T00:17:40.558+0000 7fbb189dc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96117) UID: 0 2023-11-19T00:17:40.559 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T00:17:40.558+0000 7f2ef6b14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96117) UID: 0 2023-11-19T00:17:40.559 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T00:17:40.558+0000 7f3d1e6f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96117) UID: 0 2023-11-19T00:17:40.564 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T00:17:40.558+0000 7ffb9bc76640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96117) UID: 0 2023-11-19T00:20:30.391 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:20:30.394 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:20:30.449 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T00:20:30.448+0000 7f6271cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 196574) UID: 0 2023-11-19T00:20:30.449 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T00:20:30.448+0000 7f9762870640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 196574) UID: 0 2023-11-19T00:20:30.449 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T00:20:30.448+0000 7feb11d51640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 196574) UID: 0 2023-11-19T00:20:30.454 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T00:20:30.448+0000 7f9dbd7e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 196574) UID: 0 2023-11-19T00:20:58.774 INFO:teuthology.orchestra.run.smithi008.stdout:generic/074 1574s 2023-11-19T00:20:58.884 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/074 2023-11-19T00:20:58.885 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:20:58.887 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:20:58.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:20:58.937 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-11-19T00:20:59.934 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:20:59.938 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:20:59.938 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:37.321 INFO:teuthology.orchestra.run.smithi008.stdout:generic/075 38s 2023-11-19T00:21:37.326 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/075 2023-11-19T00:21:37.326 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:37.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:37.338 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-11-19T00:21:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:37.826 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:37.827 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:37.975 INFO:teuthology.orchestra.run.smithi008.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:21:37.978 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/076 2023-11-19T00:21:37.978 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/076 2023-11-19T00:21:37.978 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:37.980 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:37.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:37.989 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-11-19T00:21:38.164 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:38.168 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:38.168 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:41.006 INFO:teuthology.orchestra.run.smithi008.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:21:41.010 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/077 2023-11-19T00:21:41.010 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/077 2023-11-19T00:21:41.010 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:41.012 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:41.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:41.022 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-11-19T00:21:41.196 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:41.200 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:41.200 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:41.452 INFO:teuthology.orchestra.run.smithi008.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-19T00:21:41.455 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/078 2023-11-19T00:21:41.455 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/078 2023-11-19T00:21:41.456 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:41.458 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:41.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:41.467 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-11-19T00:21:41.934 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:41.940 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:41.940 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:42.148 INFO:teuthology.orchestra.run.smithi008.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-19T00:21:42.152 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/079 2023-11-19T00:21:42.152 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/079 2023-11-19T00:21:42.152 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:42.155 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:42.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:42.164 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-11-19T00:21:42.336 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:42.340 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:42.340 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:44.517 INFO:teuthology.orchestra.run.smithi008.stdout:generic/080 2s 2023-11-19T00:21:44.523 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/080 2023-11-19T00:21:44.523 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:44.525 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:44.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:44.535 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-11-19T00:21:44.710 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:44.715 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:44.715 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:44.831 INFO:teuthology.orchestra.run.smithi008.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:21:44.835 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/081 2023-11-19T00:21:44.835 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/081 2023-11-19T00:21:44.835 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:44.838 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:44.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:44.847 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-11-19T00:21:45.020 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:45.024 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:45.025 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:45.142 INFO:teuthology.orchestra.run.smithi008.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:21:45.146 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/082 2023-11-19T00:21:45.146 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/082 2023-11-19T00:21:45.147 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:45.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:45.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:45.157 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-11-19T00:21:45.332 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:45.336 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:45.336 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:45.447 INFO:teuthology.orchestra.run.smithi008.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:21:45.451 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/083 2023-11-19T00:21:45.451 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/083 2023-11-19T00:21:45.451 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:45.454 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:45.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:45.462 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-11-19T00:21:45.656 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:45.660 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:45.781 INFO:teuthology.orchestra.run.smithi008.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:21:45.784 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/084 2023-11-19T00:21:45.785 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/084 2023-11-19T00:21:45.785 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:45.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:45.797 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-11-19T00:21:45.973 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:45.977 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:46.137 INFO:teuthology.orchestra.run.smithi008.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:21:46.140 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/085 2023-11-19T00:21:46.140 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/085 2023-11-19T00:21:46.141 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:46.143 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:46.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:46.152 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-11-19T00:21:46.324 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:46.329 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:46.329 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:52.175 INFO:teuthology.orchestra.run.smithi008.stdout:generic/086 5s 2023-11-19T00:21:52.358 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/086 2023-11-19T00:21:52.358 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:52.360 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:52.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:52.685 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-11-19T00:21:54.932 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:54.936 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:55.446 INFO:teuthology.orchestra.run.smithi008.stdout:generic/087 1s 2023-11-19T00:21:55.451 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/087 2023-11-19T00:21:55.451 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:55.454 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:55.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:55.463 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-11-19T00:21:55.924 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:55.929 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:55.929 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:56.116 INFO:teuthology.orchestra.run.smithi008.stdout:generic/088 1s 2023-11-19T00:21:56.122 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/088 2023-11-19T00:21:56.122 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:21:56.124 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:21:56.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:21:56.133 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-11-19T00:21:56.622 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:21:56.628 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:21:56.628 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:24:20.417 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:24:20.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:24:50.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:24:50.566 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:24:50.614 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T00:24:50.613+0000 7f15bce65640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 203187) UID: 0 2023-11-19T00:24:50.614 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T00:24:50.613+0000 7fd4c2c2b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 203187) UID: 0 2023-11-19T00:28:22.143 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:28:22.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:28:52.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:28:52.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:28:52.350 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T00:28:52.350+0000 7f15bce65640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 203440) UID: 0 2023-11-19T00:28:52.351 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T00:28:52.350+0000 7fd4c2c2b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 203440) UID: 0 2023-11-19T00:31:53.379 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:31:53.383 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:32:23.626 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:32:23.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:32:53.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:32:53.827 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:32:53.865 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T00:32:53.864+0000 7f15bce65640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205523) UID: 0 2023-11-19T00:32:53.865 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T00:32:53.864+0000 7fd4c2c2b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205523) UID: 0 2023-11-19T00:35:43.400 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:35:43.403 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:36:13.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:36:13.827 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:36:40.917 INFO:teuthology.orchestra.run.smithi008.stdout:generic/089 884s 2023-11-19T00:36:40.980 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/089 2023-11-19T00:36:40.981 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:36:40.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:36:41.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:36:41.003 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-11-19T00:36:41.517 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:36:41.521 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:36:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:36:41.710 INFO:teuthology.orchestra.run.smithi008.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:36:41.713 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/090 2023-11-19T00:36:41.713 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/090 2023-11-19T00:36:41.713 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:36:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:36:41.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:36:41.724 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-11-19T00:36:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:36:41.963 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:36:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:36:43.893 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:36:43.895 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:37:14.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:37:14.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:37:44.471 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:37:44.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:38:14.811 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:38:14.813 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:38:33.912 INFO:teuthology.orchestra.run.smithi008.stdout:generic/091 112s 2023-11-19T00:38:33.917 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/091 2023-11-19T00:38:33.917 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:33.919 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:33.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:33.928 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-11-19T00:38:34.357 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:34.362 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:34.529 INFO:teuthology.orchestra.run.smithi008.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-19T00:38:34.532 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/092 2023-11-19T00:38:34.532 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/092 2023-11-19T00:38:34.532 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:34.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:34.551 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-11-19T00:38:34.969 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:34.973 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:34.973 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:generic/093 1s 2023-11-19T00:38:35.812 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/093 2023-11-19T00:38:35.812 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:35.814 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:35.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:35.828 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-11-19T00:38:36.251 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:36.256 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:36.256 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:36.373 INFO:teuthology.orchestra.run.smithi008.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:38:36.377 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/094 2023-11-19T00:38:36.377 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/094 2023-11-19T00:38:36.377 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:36.379 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:36.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:36.388 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-11-19T00:38:36.561 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:36.565 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:36.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:36.676 INFO:teuthology.orchestra.run.smithi008.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:38:36.680 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/095 2023-11-19T00:38:36.680 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/095 2023-11-19T00:38:36.680 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:36.682 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:36.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:36.691 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-11-19T00:38:36.864 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:36.868 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:36.868 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:36.977 INFO:teuthology.orchestra.run.smithi008.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:38:36.980 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/096 2023-11-19T00:38:36.980 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/096 2023-11-19T00:38:36.980 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:36.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:36.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:36.992 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-11-19T00:38:37.163 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:37.167 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:37.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:37.757 INFO:teuthology.orchestra.run.smithi008.stdout:generic/097 0s 2023-11-19T00:38:37.764 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/097 2023-11-19T00:38:37.764 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:37.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:37.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:37.777 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-11-19T00:38:37.950 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:37.954 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:37.954 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:38.062 INFO:teuthology.orchestra.run.smithi008.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:38:38.066 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/098 2023-11-19T00:38:38.066 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/098 2023-11-19T00:38:38.066 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:38.068 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:38.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:38.077 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-11-19T00:38:38.249 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:38.253 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:38.253 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:38.404 INFO:teuthology.orchestra.run.smithi008.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-19T00:38:38.407 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/099 2023-11-19T00:38:38.407 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/099 2023-11-19T00:38:38.407 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:38:38.410 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:38.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:38:38.418 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-11-19T00:38:38.592 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:38:38.596 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:38:38.596 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:38:44.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:38:44.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:39:06.385 INFO:teuthology.orchestra.run.smithi008.stdout:generic/100 28s 2023-11-19T00:39:06.388 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/100 2023-11-19T00:39:06.388 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:06.391 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:06.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:06.407 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-11-19T00:39:06.603 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:06.608 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:06.608 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:06.923 INFO:teuthology.orchestra.run.smithi008.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:06.930 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/101 2023-11-19T00:39:06.930 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/101 2023-11-19T00:39:06.930 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:06.937 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:06.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:06.955 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-11-19T00:39:07.168 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:07.241 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:07.241 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:07.280 INFO:teuthology.orchestra.run.smithi008.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:07.284 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/102 2023-11-19T00:39:07.284 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/102 2023-11-19T00:39:07.284 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:07.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:07.295 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-11-19T00:39:07.478 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:07.482 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:07.482 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:07.595 INFO:teuthology.orchestra.run.smithi008.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:07.598 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/103 2023-11-19T00:39:07.598 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/103 2023-11-19T00:39:07.598 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:07.601 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:07.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:07.609 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-11-19T00:39:07.781 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:07.785 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:07.785 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:07.908 INFO:teuthology.orchestra.run.smithi008.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/104 2023-11-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/104 2023-11-19T00:39:07.912 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:07.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:07.923 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-11-19T00:39:08.093 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:08.097 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:08.098 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:08.207 INFO:teuthology.orchestra.run.smithi008.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:08.211 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/105 2023-11-19T00:39:08.211 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/105 2023-11-19T00:39:08.211 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:08.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:08.222 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-11-19T00:39:08.398 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:08.402 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:08.402 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:08.525 INFO:teuthology.orchestra.run.smithi008.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:08.529 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/106 2023-11-19T00:39:08.529 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/106 2023-11-19T00:39:08.529 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:08.531 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:08.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:08.541 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:08.717 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:08.718 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:08.840 INFO:teuthology.orchestra.run.smithi008.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:08.844 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/107 2023-11-19T00:39:08.844 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/107 2023-11-19T00:39:08.844 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:08.846 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:08.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:08.855 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-11-19T00:39:09.026 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:09.030 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:09.030 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:09.294 INFO:teuthology.orchestra.run.smithi008.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:09.297 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/108 2023-11-19T00:39:09.297 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/108 2023-11-19T00:39:09.297 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:09.300 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:09.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:09.308 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-11-19T00:39:09.480 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:09.484 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:09.484 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi008.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/109 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/109 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:09.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:09.607 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-11-19T00:39:09.779 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:09.783 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:09.783 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:09.934 INFO:teuthology.orchestra.run.smithi008.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:39:09.938 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/110 2023-11-19T00:39:09.938 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/110 2023-11-19T00:39:09.938 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:09.941 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:09.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:09.950 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-11-19T00:39:10.377 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:10.382 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:10.382 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:10.543 INFO:teuthology.orchestra.run.smithi008.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:39:10.546 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/111 2023-11-19T00:39:10.546 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/111 2023-11-19T00:39:10.547 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:10.549 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:10.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:10.558 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-11-19T00:39:11.000 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:11.004 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:11.005 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:15.014 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:39:15.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:39:45.228 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:39:45.232 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:39:45.269 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T00:39:45.268+0000 7f15bce65640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 229714) UID: 0 2023-11-19T00:39:45.270 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T00:39:45.268+0000 7fd4c2c2b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 229714) UID: 0 2023-11-19T00:39:51.603 INFO:teuthology.orchestra.run.smithi008.stdout:generic/112 40s 2023-11-19T00:39:51.608 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/112 2023-11-19T00:39:51.608 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:39:51.610 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:39:51.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:39:51.620 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-11-19T00:39:52.109 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:39:52.113 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:39:52.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:37.264 INFO:teuthology.orchestra.run.smithi008.stdout:generic/113 45s 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/113 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:37.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:37.960 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:38.319 INFO:teuthology.orchestra.run.smithi008.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-19T00:40:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/114 2023-11-19T00:40:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/114 2023-11-19T00:40:38.323 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:38.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:38.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:38.334 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:38.514 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:38.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:38.668 INFO:teuthology.orchestra.run.smithi008.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/115 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/115 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:38.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:38.684 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:39.371 INFO:teuthology.orchestra.run.smithi008.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:40:39.374 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/116 2023-11-19T00:40:39.375 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/116 2023-11-19T00:40:39.375 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:39.377 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:39.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:39.387 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-11-19T00:40:39.917 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:39.921 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:40.031 INFO:teuthology.orchestra.run.smithi008.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:40:40.034 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/117 2023-11-19T00:40:40.035 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/117 2023-11-19T00:40:40.035 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:40.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:40.046 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-11-19T00:40:40.218 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:40.222 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:40.222 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:40.382 INFO:teuthology.orchestra.run.smithi008.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:40:40.386 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/118 2023-11-19T00:40:40.386 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/118 2023-11-19T00:40:40.386 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:40.388 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:40.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:40.398 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-11-19T00:40:40.918 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:40.922 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:40.923 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:41.074 INFO:teuthology.orchestra.run.smithi008.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:40:41.078 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/119 2023-11-19T00:40:41.078 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/119 2023-11-19T00:40:41.078 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:41.080 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:41.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:41.090 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-11-19T00:40:41.586 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:41.591 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:41.706 INFO:teuthology.orchestra.run.smithi008.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:40:41.709 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/120 2023-11-19T00:40:41.709 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/120 2023-11-19T00:40:41.709 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:41.712 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:41.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:41.721 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-11-19T00:40:41.898 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:41.902 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:41.902 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:42.061 INFO:teuthology.orchestra.run.smithi008.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T00:40:42.064 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/121 2023-11-19T00:40:42.065 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/121 2023-11-19T00:40:42.065 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:42.067 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:42.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:42.076 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-11-19T00:40:42.590 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:42.594 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:42.594 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:42.768 INFO:teuthology.orchestra.run.smithi008.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T00:40:42.772 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/122 2023-11-19T00:40:42.772 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/122 2023-11-19T00:40:42.772 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:42.774 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:42.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:42.783 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-11-19T00:40:43.301 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:43.305 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:43.305 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:generic/123 0s 2023-11-19T00:40:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/123 2023-11-19T00:40:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:43.758 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:43.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:43.768 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-11-19T00:40:44.282 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:44.286 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:44.403 INFO:teuthology.orchestra.run.smithi008.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:40:44.406 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/124 2023-11-19T00:40:44.406 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/124 2023-11-19T00:40:44.406 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:40:44.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:40:44.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:40:44.418 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-11-19T00:40:44.593 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:40:44.597 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:40:44.597 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:41:45.914 INFO:teuthology.orchestra.run.smithi008.stdout:generic/125 61s 2023-11-19T00:41:45.919 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/125 2023-11-19T00:41:45.919 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:41:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:41:45.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:41:45.939 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-11-19T00:41:46.438 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:41:46.442 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:41:46.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:41:46.974 INFO:teuthology.orchestra.run.smithi008.stdout:generic/126 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/126.out.bad) 2023-11-19T00:41:46.976 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/126.out 2023-11-18 23:42:21.559425508 +0000 2023-11-19T00:41:46.976 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/126.out.bad 2023-11-19 00:41:46.971662454 +0000 2023-11-19T00:41:46.976 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,7 +1,7 @@ 2023-11-19T00:41:46.976 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 126 2023-11-19T00:41:46.976 INFO:teuthology.orchestra.run.smithi008.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-11-19T00:41:46.977 INFO:teuthology.orchestra.run.smithi008.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-11-19T00:41:46.978 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/126 2023-11-19T00:41:46.978 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/126 2023-11-19T00:41:46.978 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T00:41:46.981 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:41:46.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:41:46.991 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T00:41:46.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T00:41:46.991 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-11-19T00:41:47.594 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:41:47.600 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:41:47.600 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:41:52.347 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T00:41:52.345+0000 7f6271cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 236879) UID: 0 2023-11-19T00:41:52.347 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T00:41:52.346+0000 7f9762870640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 236879) UID: 0 2023-11-19T00:41:52.348 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T00:41:52.346+0000 7feb11d51640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 236879) UID: 0 2023-11-19T00:41:52.348 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T00:41:52.346+0000 7f9dbd7e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 236879) UID: 0 2023-11-19T00:44:33.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:44:33.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:44:33.939 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T00:44:33.938+0000 7fbb189dc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96482) UID: 0 2023-11-19T00:44:33.939 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T00:44:33.938+0000 7f3d1e6f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96482) UID: 0 2023-11-19T00:44:33.940 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T00:44:33.938+0000 7f2ef6b14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96482) UID: 0 2023-11-19T00:44:33.940 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T00:44:33.938+0000 7ffb9bc76640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96482) UID: 0 2023-11-19T00:46:58.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:46:58.518 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:47:28.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:47:28.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:47:58.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:47:58.870 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:48:28.974 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:48:28.978 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:48:59.055 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:48:59.058 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:49:29.153 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:49:29.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:49:59.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:49:59.213 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:50:29.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:50:29.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:50:59.394 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:50:59.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:51:29.459 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:51:29.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:51:59.539 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:51:59.543 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:52:29.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:52:29.640 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:52:59.701 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:52:59.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:53:29.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:53:29.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:53:59.937 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:53:59.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:54:30.002 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:54:30.005 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:54:39.589 INFO:teuthology.orchestra.run.smithi008.stdout:generic/127 772s 2023-11-19T00:54:39.594 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/127 2023-11-19T00:54:39.595 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:54:39.597 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:39.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:54:39.606 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-11-19T00:54:40.056 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:54:40.060 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:54:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:40.228 INFO:teuthology.orchestra.run.smithi008.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:54:40.231 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/128 2023-11-19T00:54:40.232 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/128 2023-11-19T00:54:40.232 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:54:40.234 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:40.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:54:40.243 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-11-19T00:54:40.416 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:54:40.420 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:54:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:40.529 INFO:teuthology.orchestra.run.smithi008.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:54:40.532 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/129 2023-11-19T00:54:40.532 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/129 2023-11-19T00:54:40.533 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:54:40.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:40.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:54:40.544 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-11-19T00:54:40.717 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:54:40.721 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:54:40.721 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:40.837 INFO:teuthology.orchestra.run.smithi008.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:54:40.841 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/130 2023-11-19T00:54:40.841 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/130 2023-11-19T00:54:40.841 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:54:40.843 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:40.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:54:40.852 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-11-19T00:54:41.025 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:54:41.029 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:54:41.029 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:42.346 INFO:teuthology.orchestra.run.smithi008.stdout:generic/131 1s 2023-11-19T00:54:42.352 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/131 2023-11-19T00:54:42.352 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:54:42.354 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:42.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:54:42.364 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-11-19T00:54:42.824 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:54:42.828 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:54:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:42.938 INFO:teuthology.orchestra.run.smithi008.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:54:42.941 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/132 2023-11-19T00:54:42.942 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/132 2023-11-19T00:54:42.942 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:54:42.944 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:54:42.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:54:42.953 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-11-19T00:54:43.126 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:54:43.130 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:54:43.130 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:55:00.091 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:55:00.094 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:55:30.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:55:30.199 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:56:00.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:56:00.266 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:56:30.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:56:30.387 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:57:00.452 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:57:00.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:57:30.553 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:57:30.555 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:58:00.766 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:58:00.769 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:58:17.379 INFO:teuthology.orchestra.run.smithi008.stdout:generic/133 214s 2023-11-19T00:58:17.384 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/133 2023-11-19T00:58:17.384 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:17.387 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:17.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:17.396 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-11-19T00:58:17.857 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:17.861 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:17.862 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:18.020 INFO:teuthology.orchestra.run.smithi008.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:18.024 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/134 2023-11-19T00:58:18.024 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/134 2023-11-19T00:58:18.024 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:18.026 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:18.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:18.036 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-11-19T00:58:18.524 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:18.530 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:18.721 INFO:teuthology.orchestra.run.smithi008.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:18.725 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/135 2023-11-19T00:58:18.725 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/135 2023-11-19T00:58:18.725 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:18.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:18.737 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-11-19T00:58:18.913 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:18.917 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:19.072 INFO:teuthology.orchestra.run.smithi008.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:19.075 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/136 2023-11-19T00:58:19.075 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/136 2023-11-19T00:58:19.076 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:19.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:19.087 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-11-19T00:58:19.539 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:19.544 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:19.544 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:19.698 INFO:teuthology.orchestra.run.smithi008.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:19.702 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/137 2023-11-19T00:58:19.702 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/137 2023-11-19T00:58:19.702 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:19.704 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:19.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:19.714 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-11-19T00:58:20.167 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:20.172 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:20.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:20.329 INFO:teuthology.orchestra.run.smithi008.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:20.333 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/138 2023-11-19T00:58:20.333 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/138 2023-11-19T00:58:20.333 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:20.335 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:20.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:20.344 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-11-19T00:58:20.806 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:20.810 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:20.810 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:20.963 INFO:teuthology.orchestra.run.smithi008.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:20.967 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/139 2023-11-19T00:58:20.967 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/139 2023-11-19T00:58:20.967 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:20.969 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:20.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:20.978 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-11-19T00:58:21.416 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:21.422 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:21.422 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/140 2023-11-19T00:58:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/140 2023-11-19T00:58:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:21.594 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:21.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:21.600 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-11-19T00:58:22.060 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:22.064 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:22.064 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:22.173 INFO:teuthology.orchestra.run.smithi008.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/141 2023-11-19T00:58:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/141 2023-11-19T00:58:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:22.179 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:22.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:22.188 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-11-19T00:58:22.363 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:22.367 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:22.367 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:22.518 INFO:teuthology.orchestra.run.smithi008.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:22.522 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/142 2023-11-19T00:58:22.522 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/142 2023-11-19T00:58:22.522 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:22.524 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:22.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:22.533 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-11-19T00:58:22.992 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:22.996 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:23.149 INFO:teuthology.orchestra.run.smithi008.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:23.152 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/143 2023-11-19T00:58:23.152 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/143 2023-11-19T00:58:23.153 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:23.155 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:23.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:23.164 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-11-19T00:58:23.612 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:23.617 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:23.617 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:23.783 INFO:teuthology.orchestra.run.smithi008.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:23.787 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/144 2023-11-19T00:58:23.787 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/144 2023-11-19T00:58:23.787 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:23.790 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:23.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:23.827 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-11-19T00:58:24.249 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:24.254 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:24.254 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:24.433 INFO:teuthology.orchestra.run.smithi008.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:24.436 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/145 2023-11-19T00:58:24.436 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/145 2023-11-19T00:58:24.436 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:24.439 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:24.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:24.491 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-11-19T00:58:24.890 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:24.894 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:24.894 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:25.045 INFO:teuthology.orchestra.run.smithi008.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:25.048 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/146 2023-11-19T00:58:25.049 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/146 2023-11-19T00:58:25.049 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:25.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:25.060 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-11-19T00:58:25.508 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:25.514 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:25.673 INFO:teuthology.orchestra.run.smithi008.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:25.676 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/147 2023-11-19T00:58:25.677 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/147 2023-11-19T00:58:25.677 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:25.679 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:25.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:25.688 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-11-19T00:58:26.127 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:26.132 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:26.132 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:26.288 INFO:teuthology.orchestra.run.smithi008.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:26.291 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/148 2023-11-19T00:58:26.291 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/148 2023-11-19T00:58:26.291 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:26.294 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:26.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:26.303 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-11-19T00:58:26.750 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:26.754 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:26.909 INFO:teuthology.orchestra.run.smithi008.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:26.913 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/149 2023-11-19T00:58:26.913 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/149 2023-11-19T00:58:26.913 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:26.915 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:26.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:26.941 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-11-19T00:58:27.388 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:27.392 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:27.542 INFO:teuthology.orchestra.run.smithi008.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:27.545 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/150 2023-11-19T00:58:27.545 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/150 2023-11-19T00:58:27.546 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:27.548 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:27.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:27.557 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-11-19T00:58:28.001 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:28.006 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:28.006 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:28.160 INFO:teuthology.orchestra.run.smithi008.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:28.165 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/151 2023-11-19T00:58:28.166 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/151 2023-11-19T00:58:28.166 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:28.166 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:28.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:28.176 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-11-19T00:58:28.629 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:28.634 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:28.634 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:28.787 INFO:teuthology.orchestra.run.smithi008.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:28.792 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/152 2023-11-19T00:58:28.792 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/152 2023-11-19T00:58:28.792 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:28.793 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:28.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:28.802 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-11-19T00:58:29.246 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:29.251 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:29.251 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:29.403 INFO:teuthology.orchestra.run.smithi008.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:29.407 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/153 2023-11-19T00:58:29.407 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/153 2023-11-19T00:58:29.407 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:29.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:29.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:29.440 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-11-19T00:58:29.873 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:29.877 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:30.031 INFO:teuthology.orchestra.run.smithi008.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:30.035 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/154 2023-11-19T00:58:30.035 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/154 2023-11-19T00:58:30.035 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:30.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:30.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:30.047 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-11-19T00:58:30.496 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:30.500 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:30.500 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:30.657 INFO:teuthology.orchestra.run.smithi008.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:30.660 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/155 2023-11-19T00:58:30.660 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/155 2023-11-19T00:58:30.660 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:30.663 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:30.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:30.671 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-11-19T00:58:30.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:58:30.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T00:58:30.897 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T00:58:30.896+0000 7f3d1e6f3640 -1 Fail to open '/proc/96926/cmdline' error = (2) No such file or directory 2023-11-19T00:58:30.897 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T00:58:30.896+0000 7f3d1e6f3640 -1 received signal: Hangup from (PID: 96926) UID: 0 2023-11-19T00:58:30.897 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T00:58:30.896+0000 7ffb9bc76640 -1 Fail to open '/proc/96926/cmdline' error = (2) No such file or directory 2023-11-19T00:58:30.898 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T00:58:30.896+0000 7ffb9bc76640 -1 received signal: Hangup from (PID: 96926) UID: 0 2023-11-19T00:58:30.900 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T00:58:30.898+0000 7fbb189dc640 -1 Fail to open '/proc/96926/cmdline' error = (2) No such file or directory 2023-11-19T00:58:30.900 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T00:58:30.898+0000 7fbb189dc640 -1 received signal: Hangup from (PID: 96926) UID: 0 2023-11-19T00:58:30.905 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T00:58:30.902+0000 7f2ef6b14640 -1 Fail to open '/proc/96926/cmdline' error = (2) No such file or directory 2023-11-19T00:58:30.905 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T00:58:30.902+0000 7f2ef6b14640 -1 received signal: Hangup from (PID: 96926) UID: 0 2023-11-19T00:58:31.130 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:31.134 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:31.293 INFO:teuthology.orchestra.run.smithi008.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:31.297 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/156 2023-11-19T00:58:31.297 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/156 2023-11-19T00:58:31.297 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:31.299 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:31.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:31.308 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-11-19T00:58:31.752 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:31.756 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:31.912 INFO:teuthology.orchestra.run.smithi008.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:31.915 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/157 2023-11-19T00:58:31.915 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/157 2023-11-19T00:58:31.916 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:31.918 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:31.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:31.927 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-11-19T00:58:32.378 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:32.382 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:32.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:32.537 INFO:teuthology.orchestra.run.smithi008.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:32.540 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/158 2023-11-19T00:58:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/158 2023-11-19T00:58:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:32.543 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:32.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:32.552 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-11-19T00:58:32.975 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:32.979 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:33.169 INFO:teuthology.orchestra.run.smithi008.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-19T00:58:33.173 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/159 2023-11-19T00:58:33.173 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/159 2023-11-19T00:58:33.173 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:33.175 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:33.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:33.185 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-11-19T00:58:33.359 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:33.363 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:33.363 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:33.510 INFO:teuthology.orchestra.run.smithi008.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-19T00:58:33.513 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/160 2023-11-19T00:58:33.514 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/160 2023-11-19T00:58:33.514 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:33.516 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:33.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:33.537 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-11-19T00:58:33.709 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:33.713 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:33.713 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:33.822 INFO:teuthology.orchestra.run.smithi008.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:33.825 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/161 2023-11-19T00:58:33.825 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/161 2023-11-19T00:58:33.825 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:33.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:33.836 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-11-19T00:58:34.010 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:34.014 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:34.014 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:34.123 INFO:teuthology.orchestra.run.smithi008.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:34.126 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/162 2023-11-19T00:58:34.126 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/162 2023-11-19T00:58:34.126 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:34.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:34.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:34.138 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-11-19T00:58:34.309 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:34.313 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:34.313 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/163 2023-11-19T00:58:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/163 2023-11-19T00:58:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:34.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:34.437 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-11-19T00:58:34.609 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:34.613 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:34.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:34.724 INFO:teuthology.orchestra.run.smithi008.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:34.727 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/164 2023-11-19T00:58:34.727 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/164 2023-11-19T00:58:34.727 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:34.730 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:34.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:34.738 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-11-19T00:58:34.911 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:34.915 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:34.916 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/165 2023-11-19T00:58:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/165 2023-11-19T00:58:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:35.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:35.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:35.054 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-11-19T00:58:35.226 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:35.230 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:35.231 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:35.512 INFO:teuthology.orchestra.run.smithi008.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:35.516 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/166 2023-11-19T00:58:35.516 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/166 2023-11-19T00:58:35.516 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:35.518 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:35.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:35.527 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-11-19T00:58:35.700 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:35.704 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:35.704 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:35.813 INFO:teuthology.orchestra.run.smithi008.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:35.817 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/167 2023-11-19T00:58:35.817 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/167 2023-11-19T00:58:35.817 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:35.819 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:35.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:35.828 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-11-19T00:58:36.002 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:36.006 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:36.114 INFO:teuthology.orchestra.run.smithi008.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:36.118 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/168 2023-11-19T00:58:36.118 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/168 2023-11-19T00:58:36.118 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:36.120 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:36.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:36.129 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-11-19T00:58:36.302 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:36.306 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:36.306 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:36.414 INFO:teuthology.orchestra.run.smithi008.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:36.417 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/169 2023-11-19T00:58:36.417 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/169 2023-11-19T00:58:36.417 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:36.420 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:36.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:36.428 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-11-19T00:58:36.600 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:36.604 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:36.604 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:36.717 INFO:teuthology.orchestra.run.smithi008.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:36.721 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/170 2023-11-19T00:58:36.721 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/170 2023-11-19T00:58:36.721 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:36.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:36.732 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-11-19T00:58:36.905 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:36.909 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:36.909 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:37.035 INFO:teuthology.orchestra.run.smithi008.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:37.038 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/171 2023-11-19T00:58:37.038 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/171 2023-11-19T00:58:37.039 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:37.041 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:37.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:37.050 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-11-19T00:58:37.221 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:37.225 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:37.347 INFO:teuthology.orchestra.run.smithi008.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:37.350 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/172 2023-11-19T00:58:37.350 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/172 2023-11-19T00:58:37.350 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:37.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:37.362 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-11-19T00:58:37.534 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:37.538 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:37.538 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:37.663 INFO:teuthology.orchestra.run.smithi008.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:37.667 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/173 2023-11-19T00:58:37.667 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/173 2023-11-19T00:58:37.667 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:37.669 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:37.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:37.697 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-11-19T00:58:37.873 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:37.877 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:37.877 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:37.990 INFO:teuthology.orchestra.run.smithi008.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:37.994 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/174 2023-11-19T00:58:37.994 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/174 2023-11-19T00:58:37.995 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:37.996 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:38.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:38.007 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-11-19T00:58:38.181 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:38.185 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:38.185 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:38.294 INFO:teuthology.orchestra.run.smithi008.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:38.298 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/175 2023-11-19T00:58:38.298 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/175 2023-11-19T00:58:38.298 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:38.300 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:38.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:38.309 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-11-19T00:58:38.480 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:38.484 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:38.484 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:38.610 INFO:teuthology.orchestra.run.smithi008.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:38.613 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/176 2023-11-19T00:58:38.613 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/176 2023-11-19T00:58:38.613 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:38.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:38.638 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-11-19T00:58:38.811 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:38.815 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:38.967 INFO:teuthology.orchestra.run.smithi008.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:38.971 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/177 2023-11-19T00:58:38.971 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/177 2023-11-19T00:58:38.971 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:38.973 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:38.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:38.982 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-11-19T00:58:39.154 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:39.158 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:39.158 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:39.313 INFO:teuthology.orchestra.run.smithi008.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:39.317 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/178 2023-11-19T00:58:39.317 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/178 2023-11-19T00:58:39.317 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:39.319 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:39.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:39.328 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-11-19T00:58:39.767 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:39.771 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:39.771 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:39.932 INFO:teuthology.orchestra.run.smithi008.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:39.936 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/179 2023-11-19T00:58:39.936 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/179 2023-11-19T00:58:39.936 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:39.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:39.948 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-11-19T00:58:40.390 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:40.395 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:40.395 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:40.546 INFO:teuthology.orchestra.run.smithi008.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:40.550 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/180 2023-11-19T00:58:40.550 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/180 2023-11-19T00:58:40.550 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:40.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:40.561 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-11-19T00:58:41.009 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:41.014 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:41.014 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:41.164 INFO:teuthology.orchestra.run.smithi008.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:41.168 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/181 2023-11-19T00:58:41.168 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/181 2023-11-19T00:58:41.168 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:41.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:41.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:41.179 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-11-19T00:58:41.640 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:41.645 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:41.812 INFO:teuthology.orchestra.run.smithi008.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T00:58:41.816 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/182 2023-11-19T00:58:41.816 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/182 2023-11-19T00:58:41.816 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:41.818 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:41.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:41.868 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-11-19T00:58:42.291 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:42.295 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:42.295 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:42.403 INFO:teuthology.orchestra.run.smithi008.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:42.406 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/183 2023-11-19T00:58:42.406 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/183 2023-11-19T00:58:42.407 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:42.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:42.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:42.417 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-11-19T00:58:42.591 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:42.595 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:42.595 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:42.760 INFO:teuthology.orchestra.run.smithi008.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/184.out.bad) 2023-11-19T00:58:42.762 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/184.out 2023-11-18 23:42:21.563425466 +0000 2023-11-19T00:58:42.762 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/184.out.bad 2023-11-19 00:58:42.759276461 +0000 2023-11-19T00:58:42.763 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1 +1,2 @@ 2023-11-19T00:58:42.763 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 184 2023-11-19T00:58:42.763 INFO:teuthology.orchestra.run.smithi008.stdout: +/tmp/tmp.kYHL8e4YNuxfstests-dev/tests/generic/184: line 23: /tmp/tmp.hQpPz0d1gttest/null: Permission denied 2023-11-19T00:58:42.765 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/184 2023-11-19T00:58:42.765 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/184 2023-11-19T00:58:42.765 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T00:58:42.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:42.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:58:42.776 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T00:58:42.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T00:58:42.776 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-11-19T00:58:42.949 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:42.953 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.062 INFO:teuthology.orchestra.run.smithi008.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:43.066 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/185 2023-11-19T00:58:43.066 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/185 2023-11-19T00:58:43.066 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:43.068 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:43.077 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-11-19T00:58:43.251 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:43.255 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:43.255 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.364 INFO:teuthology.orchestra.run.smithi008.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:43.367 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/186 2023-11-19T00:58:43.367 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/186 2023-11-19T00:58:43.368 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:43.370 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:43.379 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-11-19T00:58:43.551 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:43.555 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:43.555 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.665 INFO:teuthology.orchestra.run.smithi008.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:43.668 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/187 2023-11-19T00:58:43.668 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/187 2023-11-19T00:58:43.669 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:43.671 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:43.680 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-11-19T00:58:43.853 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:43.857 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:43.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.973 INFO:teuthology.orchestra.run.smithi008.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:43.977 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/188 2023-11-19T00:58:43.977 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/188 2023-11-19T00:58:43.977 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:43.979 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:43.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:43.988 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-11-19T00:58:44.161 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:44.165 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:44.165 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:44.274 INFO:teuthology.orchestra.run.smithi008.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:44.278 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/189 2023-11-19T00:58:44.278 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/189 2023-11-19T00:58:44.278 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:44.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:44.307 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-11-19T00:58:44.480 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:44.483 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:44.484 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:44.593 INFO:teuthology.orchestra.run.smithi008.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:44.596 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/190 2023-11-19T00:58:44.596 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/190 2023-11-19T00:58:44.597 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:44.599 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:44.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:44.608 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-11-19T00:58:44.781 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:44.785 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:44.785 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:44.894 INFO:teuthology.orchestra.run.smithi008.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:44.897 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/191 2023-11-19T00:58:44.897 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/191 2023-11-19T00:58:44.897 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:44.900 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:44.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:44.908 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-11-19T00:58:45.080 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:45.084 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:45.084 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:45.200 INFO:teuthology.orchestra.run.smithi008.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-11-19T00:58:45.203 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/192 2023-11-19T00:58:45.203 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/192 2023-11-19T00:58:45.203 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:45.206 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:45.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:45.215 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-11-19T00:58:45.387 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:45.391 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:45.391 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:46.254 INFO:teuthology.orchestra.run.smithi008.stdout:generic/193 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/193.out.bad) 2023-11-19T00:58:46.256 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/193.out 2023-11-18 23:42:21.564425456 +0000 2023-11-19T00:58:46.256 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/193.out.bad 2023-11-19 00:58:46.252240842 +0000 2023-11-19T00:58:46.256 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -24,7 +24,6 @@ 2023-11-19T00:58:46.256 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:46.257 INFO:teuthology.orchestra.run.smithi008.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-11-19T00:58:46.257 INFO:teuthology.orchestra.run.smithi008.stdout: user: chmod a+r on root owned file (should fail) 2023-11-19T00:58:46.257 INFO:teuthology.orchestra.run.smithi008.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-11-19T00:58:46.257 INFO:teuthology.orchestra.run.smithi008.stdout: check that the sgid bit is cleared 2023-11-19T00:58:46.257 INFO:teuthology.orchestra.run.smithi008.stdout: -rw-rw-rw- 2023-11-19T00:58:46.257 INFO:teuthology.orchestra.run.smithi008.stdout: check that suid bit is not cleared 2023-11-19T00:58:46.258 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/193 2023-11-19T00:58:46.258 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/193 2023-11-19T00:58:46.258 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T00:58:46.261 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:46.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:58:46.270 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T00:58:46.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T00:58:46.270 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-11-19T00:58:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:46.724 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:46.724 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:46.835 INFO:teuthology.orchestra.run.smithi008.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:46.839 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/194 2023-11-19T00:58:46.839 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/194 2023-11-19T00:58:46.839 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:46.841 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:46.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:46.860 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-11-19T00:58:47.034 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:47.038 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:47.038 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:47.148 INFO:teuthology.orchestra.run.smithi008.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:47.152 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/195 2023-11-19T00:58:47.152 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/195 2023-11-19T00:58:47.152 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:47.154 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:47.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:47.164 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-11-19T00:58:47.337 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:47.341 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:47.341 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:47.455 INFO:teuthology.orchestra.run.smithi008.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:47.458 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/196 2023-11-19T00:58:47.459 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/196 2023-11-19T00:58:47.459 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:47.461 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:47.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:47.470 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-11-19T00:58:47.644 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:47.648 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:47.648 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:47.758 INFO:teuthology.orchestra.run.smithi008.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:47.761 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/197 2023-11-19T00:58:47.761 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/197 2023-11-19T00:58:47.762 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:47.764 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:47.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:47.773 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-11-19T00:58:47.945 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:47.949 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:47.949 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout:generic/198 1s 2023-11-19T00:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/198 2023-11-19T00:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:48.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:48.644 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-11-19T00:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/199 2023-11-19T00:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/199 2023-11-19T00:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:49.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:49.216 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-11-19T00:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/200 2023-11-19T00:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/200 2023-11-19T00:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:49.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:49.560 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-11-19T00:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/201 2023-11-19T00:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/201 2023-11-19T00:58:49.851 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:49.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:49.861 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-11-19T00:58:50.034 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:50.038 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:50.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:50.148 INFO:teuthology.orchestra.run.smithi008.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:50.152 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/202 2023-11-19T00:58:50.152 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/202 2023-11-19T00:58:50.152 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:50.155 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:50.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:50.164 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-11-19T00:58:50.339 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:50.343 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:50.453 INFO:teuthology.orchestra.run.smithi008.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:50.456 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/203 2023-11-19T00:58:50.456 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/203 2023-11-19T00:58:50.456 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:50.458 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:50.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:50.478 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-11-19T00:58:50.650 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:50.655 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:50.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:51.910 INFO:teuthology.orchestra.run.smithi008.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:51.914 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/204 2023-11-19T00:58:51.914 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/204 2023-11-19T00:58:51.914 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:51.917 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:51.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:51.939 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-11-19T00:58:52.121 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:52.125 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:52.125 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:52.241 INFO:teuthology.orchestra.run.smithi008.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:52.245 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/205 2023-11-19T00:58:52.245 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/205 2023-11-19T00:58:52.245 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:52.247 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:52.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:52.256 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-11-19T00:58:52.428 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:52.432 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:52.550 INFO:teuthology.orchestra.run.smithi008.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T00:58:52.554 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/206 2023-11-19T00:58:52.554 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/206 2023-11-19T00:58:52.554 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:58:52.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:58:52.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:58:52.565 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-11-19T00:58:52.736 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:58:52.740 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:58:52.740 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:59:06.965 INFO:teuthology.orchestra.run.smithi008.stdout:generic/207 14s 2023-11-19T00:59:06.971 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/207 2023-11-19T00:59:06.971 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T00:59:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T00:59:06.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T00:59:06.983 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-11-19T00:59:07.435 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T00:59:07.440 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T00:59:07.440 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:00:50.199 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:00:50.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:01:20.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:01:20.267 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:01:50.411 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:01:50.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:02:20.550 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:02:20.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:02:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:generic/208 200s 2023-11-19T01:02:27.705 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/208 2023-11-19T01:02:27.705 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:27.708 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:27.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:27.719 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-11-19T01:02:28.168 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:28.172 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:28.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:35.792 INFO:teuthology.orchestra.run.smithi008.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/209.out.bad) 2023-11-19T01:02:35.801 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/209.out 2023-11-18 23:42:21.565425445 +0000 2023-11-19T01:02:35.802 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/209.out.bad 2023-11-19 01:02:35.785898382 +0000 2023-11-19T01:02:35.802 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,2 +1,2 @@ 2023-11-19T01:02:35.802 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 209 2023-11-19T01:02:35.802 INFO:teuthology.orchestra.run.smithi008.stdout: -test ran for 30 seconds without error 2023-11-19T01:02:35.802 INFO:teuthology.orchestra.run.smithi008.stdout: +reader found old byte at pos 4096 2023-11-19T01:02:35.802 INFO:teuthology.orchestra.run.smithi008.stdout: \ No newline at end of file 2023-11-19T01:02:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/209 2023-11-19T01:02:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/209 2023-11-19T01:02:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:02:35.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:35.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:02:35.821 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:02:35.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:02:35.822 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-11-19T01:02:36.225 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:36.230 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:36.230 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:36.457 INFO:teuthology.orchestra.run.smithi008.stdout:generic/210 0s 2023-11-19T01:02:36.463 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/210 2023-11-19T01:02:36.463 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:36.465 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:36.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:36.497 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-11-19T01:02:36.919 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:36.923 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:36.924 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:37.704 INFO:teuthology.orchestra.run.smithi008.stdout:generic/211 1s 2023-11-19T01:02:37.754 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/211 2023-11-19T01:02:37.755 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:37.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:37.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:37.766 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-11-19T01:02:37.941 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:37.945 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:37.945 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:38.256 INFO:teuthology.orchestra.run.smithi008.stdout:generic/212 1s 2023-11-19T01:02:38.261 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/212 2023-11-19T01:02:38.261 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:38.263 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:38.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:38.273 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-11-19T01:02:38.449 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:38.453 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:38.453 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:38.850 INFO:teuthology.orchestra.run.smithi008.stdout:generic/213 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/213.out.bad) 2023-11-19T01:02:38.852 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/213.out 2023-11-18 23:42:21.566425435 +0000 2023-11-19T01:02:38.852 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/213.out.bad 2023-11-19 01:02:38.848867101 +0000 2023-11-19T01:02:38.853 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,4 +1,3 @@ 2023-11-19T01:02:38.853 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 213 2023-11-19T01:02:38.853 INFO:teuthology.orchestra.run.smithi008.stdout: We should get: fallocate: No space left on device 2023-11-19T01:02:38.853 INFO:teuthology.orchestra.run.smithi008.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-11-19T01:02:38.853 INFO:teuthology.orchestra.run.smithi008.stdout: -fallocate: No space left on device 2023-11-19T01:02:38.855 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/213 2023-11-19T01:02:38.855 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/213 2023-11-19T01:02:38.855 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:02:38.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:38.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:02:38.866 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:02:38.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:02:38.866 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-11-19T01:02:39.318 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:39.324 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:39.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:39.779 INFO:teuthology.orchestra.run.smithi008.stdout:generic/214 0s 2023-11-19T01:02:39.787 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/214 2023-11-19T01:02:39.787 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:39.790 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:39.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:39.803 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-11-19T01:02:40.270 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:40.277 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:40.277 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:43.372 INFO:teuthology.orchestra.run.smithi008.stdout:generic/215 3s 2023-11-19T01:02:43.381 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/215 2023-11-19T01:02:43.381 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:43.384 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:43.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:43.397 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-11-19T01:02:43.660 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:43.666 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:43.666 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/216 2023-11-19T01:02:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/216 2023-11-19T01:02:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:43.826 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:43.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:43.839 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-11-19T01:02:44.106 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:44.112 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:44.112 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:44.273 INFO:teuthology.orchestra.run.smithi008.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:44.277 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/217 2023-11-19T01:02:44.277 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/217 2023-11-19T01:02:44.277 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:44.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:44.292 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-11-19T01:02:44.528 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:44.533 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:44.534 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:44.685 INFO:teuthology.orchestra.run.smithi008.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/218 2023-11-19T01:02:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/218 2023-11-19T01:02:44.692 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:44.695 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:44.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:44.708 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-11-19T01:02:44.956 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:44.962 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:44.963 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:45.113 INFO:teuthology.orchestra.run.smithi008.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:45.117 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/219 2023-11-19T01:02:45.117 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/219 2023-11-19T01:02:45.117 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:45.120 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:45.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:45.133 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-11-19T01:02:45.387 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:45.392 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:45.392 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:45.546 INFO:teuthology.orchestra.run.smithi008.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:45.551 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/220 2023-11-19T01:02:45.551 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/220 2023-11-19T01:02:45.551 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:45.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:45.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:45.566 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-11-19T01:02:45.814 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:45.820 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:47.027 INFO:teuthology.orchestra.run.smithi008.stdout:generic/221 2s 2023-11-19T01:02:47.036 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/221 2023-11-19T01:02:47.036 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:47.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:47.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:47.053 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-11-19T01:02:47.313 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:47.318 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:47.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:47.472 INFO:teuthology.orchestra.run.smithi008.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:47.476 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/222 2023-11-19T01:02:47.476 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/222 2023-11-19T01:02:47.476 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:47.479 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:47.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:47.490 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-11-19T01:02:47.748 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:47.754 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:47.754 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:47.911 INFO:teuthology.orchestra.run.smithi008.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:47.915 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/223 2023-11-19T01:02:47.916 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/223 2023-11-19T01:02:47.916 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:47.918 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:47.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:47.931 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-11-19T01:02:48.186 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:48.192 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:48.192 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:48.368 INFO:teuthology.orchestra.run.smithi008.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:48.372 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/224 2023-11-19T01:02:48.373 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/224 2023-11-19T01:02:48.373 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:48.375 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:48.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:48.388 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-11-19T01:02:48.633 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:48.639 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:48.797 INFO:teuthology.orchestra.run.smithi008.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:48.801 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/225 2023-11-19T01:02:48.801 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/225 2023-11-19T01:02:48.801 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:48.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:48.816 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-11-19T01:02:49.081 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:49.086 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:49.233 INFO:teuthology.orchestra.run.smithi008.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:49.238 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/226 2023-11-19T01:02:49.238 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/226 2023-11-19T01:02:49.238 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:49.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:49.254 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-11-19T01:02:49.528 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:49.535 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:49.685 INFO:teuthology.orchestra.run.smithi008.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:49.689 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/227 2023-11-19T01:02:49.689 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/227 2023-11-19T01:02:49.689 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:49.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:49.707 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-11-19T01:02:49.965 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:49.971 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:49.971 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:50.268 INFO:teuthology.orchestra.run.smithi008.stdout:generic/228 1s 2023-11-19T01:02:50.275 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/228 2023-11-19T01:02:50.275 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:50.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:50.291 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-11-19T01:02:50.606 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:02:50.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:02:50.772 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:50.780 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:50.937 INFO:teuthology.orchestra.run.smithi008.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:50.941 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/229 2023-11-19T01:02:50.942 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/229 2023-11-19T01:02:50.942 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:50.945 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:50.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:50.958 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-11-19T01:02:51.243 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:51.251 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:51.252 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:51.419 INFO:teuthology.orchestra.run.smithi008.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:51.424 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/230 2023-11-19T01:02:51.424 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/230 2023-11-19T01:02:51.424 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:51.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:51.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:51.439 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-11-19T01:02:51.703 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:51.708 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:51.708 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:51.865 INFO:teuthology.orchestra.run.smithi008.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:51.869 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/231 2023-11-19T01:02:51.869 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/231 2023-11-19T01:02:51.869 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:51.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:51.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:51.886 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-11-19T01:02:52.133 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:52.139 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:52.139 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:52.294 INFO:teuthology.orchestra.run.smithi008.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:52.299 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/232 2023-11-19T01:02:52.300 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/232 2023-11-19T01:02:52.300 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:52.302 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:52.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:52.314 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-11-19T01:02:52.585 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:52.590 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:52.591 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:52.741 INFO:teuthology.orchestra.run.smithi008.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:52.746 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/233 2023-11-19T01:02:52.746 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/233 2023-11-19T01:02:52.746 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:52.749 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:52.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:52.764 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-11-19T01:02:53.032 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:53.037 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:53.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:53.192 INFO:teuthology.orchestra.run.smithi008.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:53.197 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/234 2023-11-19T01:02:53.197 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/234 2023-11-19T01:02:53.197 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:53.200 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:53.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:53.214 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-11-19T01:02:53.482 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:53.489 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:53.490 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:53.644 INFO:teuthology.orchestra.run.smithi008.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:53.649 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/235 2023-11-19T01:02:53.649 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/235 2023-11-19T01:02:53.649 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:53.652 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:53.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:53.664 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-11-19T01:02:53.901 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:53.906 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:53.906 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:55.192 INFO:teuthology.orchestra.run.smithi008.stdout:generic/236 2s 2023-11-19T01:02:55.200 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/236 2023-11-19T01:02:55.200 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:55.203 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:55.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:55.218 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-11-19T01:02:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:55.711 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:55.711 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:55.947 INFO:teuthology.orchestra.run.smithi008.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-19T01:02:55.953 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/237 2023-11-19T01:02:55.953 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/237 2023-11-19T01:02:55.953 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:55.955 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:55.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:55.968 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-11-19T01:02:56.222 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:56.226 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:56.226 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:56.388 INFO:teuthology.orchestra.run.smithi008.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:02:56.392 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/238 2023-11-19T01:02:56.393 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/238 2023-11-19T01:02:56.393 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:02:56.396 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:02:56.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:02:56.413 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-11-19T01:02:56.672 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:02:56.679 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:02:56.679 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:03:20.762 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:03:20.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:03:51.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:03:51.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:04:21.157 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:04:21.161 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:04:51.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:04:51.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:05:14.693 INFO:teuthology.orchestra.run.smithi008.stdout:generic/239 138s 2023-11-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/239 2023-11-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:05:14.702 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:05:14.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:05:14.721 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-11-19T01:05:15.172 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:05:15.177 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:05:15.177 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:05:18.091 INFO:teuthology.orchestra.run.smithi008.stdout:generic/240 3s 2023-11-19T01:05:18.099 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/240 2023-11-19T01:05:18.099 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:05:18.102 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:05:18.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:05:18.117 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-11-19T01:05:18.565 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:05:18.572 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:05:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:05:21.839 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:05:21.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:05:52.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:05:52.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:06:22.523 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:06:22.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:06:31.953 INFO:teuthology.orchestra.run.smithi008.stdout:generic/241 73s 2023-11-19T01:06:31.962 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/241 2023-11-19T01:06:31.963 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:06:31.966 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:31.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:06:31.980 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-11-19T01:06:32.477 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:06:32.485 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:06:32.485 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:32.656 INFO:teuthology.orchestra.run.smithi008.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:06:32.661 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/242 2023-11-19T01:06:32.662 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/242 2023-11-19T01:06:32.662 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:06:32.664 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:32.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:06:32.678 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-11-19T01:06:32.935 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:06:32.940 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:06:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:33.094 INFO:teuthology.orchestra.run.smithi008.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:06:33.098 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/243 2023-11-19T01:06:33.098 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/243 2023-11-19T01:06:33.098 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:06:33.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:33.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:06:33.112 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-11-19T01:06:33.491 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:06:33.503 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:06:33.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:33.739 INFO:teuthology.orchestra.run.smithi008.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-19T01:06:33.749 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/244 2023-11-19T01:06:33.749 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/244 2023-11-19T01:06:33.749 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:06:33.753 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:33.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:06:33.768 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-11-19T01:06:34.157 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:06:34.162 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:06:34.162 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:34.510 INFO:teuthology.orchestra.run.smithi008.stdout:generic/245 0s 2023-11-19T01:06:34.538 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/245 2023-11-19T01:06:34.539 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:06:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:34.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:06:34.552 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-11-19T01:06:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:06:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:06:35.027 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:36.048 INFO:teuthology.orchestra.run.smithi008.stdout:generic/246 1s 2023-11-19T01:06:36.058 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/246 2023-11-19T01:06:36.058 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:06:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:36.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:06:36.073 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-11-19T01:06:36.550 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:06:36.557 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:06:36.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:06:52.765 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:06:52.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:07:21.484 INFO:teuthology.orchestra.run.smithi008.stdout:generic/247 45s 2023-11-19T01:07:21.490 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/247 2023-11-19T01:07:21.490 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:21.493 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:21.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:21.506 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-11-19T01:07:21.796 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:21.801 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:21.801 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:22.070 INFO:teuthology.orchestra.run.smithi008.stdout:generic/248 1s 2023-11-19T01:07:22.083 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/248 2023-11-19T01:07:22.083 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:22.086 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:22.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:22.098 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-11-19T01:07:22.346 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:22.351 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:22.351 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:22.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:07:22.855 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:07:24.562 INFO:teuthology.orchestra.run.smithi008.stdout:generic/249 2s 2023-11-19T01:07:24.569 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/249 2023-11-19T01:07:24.569 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:24.573 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:24.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:24.585 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-11-19T01:07:25.051 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:25.057 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:25.282 INFO:teuthology.orchestra.run.smithi008.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:25.287 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/250 2023-11-19T01:07:25.287 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/250 2023-11-19T01:07:25.287 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:25.290 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:25.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:25.302 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-11-19T01:07:25.554 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:25.558 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:25.558 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:25.718 INFO:teuthology.orchestra.run.smithi008.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:25.723 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/251 2023-11-19T01:07:25.724 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/251 2023-11-19T01:07:25.724 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:25.727 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:25.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:25.740 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-11-19T01:07:25.990 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:25.996 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:25.996 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:26.175 INFO:teuthology.orchestra.run.smithi008.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:26.180 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/252 2023-11-19T01:07:26.180 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/252 2023-11-19T01:07:26.180 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:26.185 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:26.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:26.198 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-11-19T01:07:26.447 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:26.453 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:26.453 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:26.620 INFO:teuthology.orchestra.run.smithi008.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:26.625 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/253 2023-11-19T01:07:26.625 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/253 2023-11-19T01:07:26.625 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:26.627 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:26.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:26.640 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-11-19T01:07:26.894 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:26.901 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:26.901 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:27.065 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/254 2023-11-19T01:07:27.065 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/254 2023-11-19T01:07:27.066 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:27.068 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:27.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:27.080 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-11-19T01:07:27.320 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:27.325 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:28.726 INFO:teuthology.orchestra.run.smithi008.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-19T01:07:28.732 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/255 2023-11-19T01:07:28.732 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/255 2023-11-19T01:07:28.732 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:28.735 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:28.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:28.755 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-11-19T01:07:29.238 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:29.243 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:29.243 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:30.589 INFO:teuthology.orchestra.run.smithi008.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:30.593 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/256 2023-11-19T01:07:30.593 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/256 2023-11-19T01:07:30.594 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:30.597 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:30.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:30.607 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-11-19T01:07:30.873 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:30.879 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:30.879 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:32.272 INFO:teuthology.orchestra.run.smithi008.stdout:generic/257 2s 2023-11-19T01:07:32.282 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/257 2023-11-19T01:07:32.282 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:32.285 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:32.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:32.298 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-11-19T01:07:32.755 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:32.762 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:32.762 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:32.983 INFO:teuthology.orchestra.run.smithi008.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/258.out.bad) 2023-11-19T01:07:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/258.out 2023-11-18 23:42:21.569425404 +0000 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/258.out.bad 2023-11-19 01:07:32.981869512 +0000 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,5 +1,6 @@ 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 258 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: Creating file with timestamp of Jan 1, 1960 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: Testing for negative seconds since epoch 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: -Remounting to flush cache 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: -Testing for negative seconds since epoch 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: +Timestamp wrapped: 3979351756 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: +Timestamp wrapped 2023-11-19T01:07:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: +(see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/258.full for details) 2023-11-19T01:07:32.991 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/258 2023-11-19T01:07:32.991 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/258 2023-11-19T01:07:32.991 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:07:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:33.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:07:33.006 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:07:33.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:07:33.006 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-11-19T01:07:33.250 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:33.257 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:33.257 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:33.423 INFO:teuthology.orchestra.run.smithi008.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:33.430 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/259 2023-11-19T01:07:33.430 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/259 2023-11-19T01:07:33.430 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:33.433 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:33.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:33.443 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-11-19T01:07:33.688 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:33.694 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:33.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:33.856 INFO:teuthology.orchestra.run.smithi008.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:33.861 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/260 2023-11-19T01:07:33.861 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/260 2023-11-19T01:07:33.861 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:33.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:33.875 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-11-19T01:07:34.124 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:34.129 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:34.129 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:34.281 INFO:teuthology.orchestra.run.smithi008.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:34.286 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/261 2023-11-19T01:07:34.286 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/261 2023-11-19T01:07:34.286 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:34.290 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:34.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:34.299 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-11-19T01:07:34.549 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:34.556 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:34.707 INFO:teuthology.orchestra.run.smithi008.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:07:34.711 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/262 2023-11-19T01:07:34.711 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/262 2023-11-19T01:07:34.711 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:07:34.713 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:34.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:07:34.723 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-11-19T01:07:34.979 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:07:34.983 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:07:34.983 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:07:53.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:07:53.209 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:08:23.283 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:08:23.286 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:08:30.389 INFO:teuthology.orchestra.run.smithi008.stdout:generic/263 56s 2023-11-19T01:08:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/263 2023-11-19T01:08:30.437 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:30.439 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:30.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:30.466 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-11-19T01:08:30.938 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:30.942 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:30.942 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:31.053 INFO:teuthology.orchestra.run.smithi008.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:31.057 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/264 2023-11-19T01:08:31.057 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/264 2023-11-19T01:08:31.057 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:31.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:31.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:31.068 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-11-19T01:08:31.240 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:31.244 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:31.244 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:31.406 INFO:teuthology.orchestra.run.smithi008.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:31.409 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/265 2023-11-19T01:08:31.409 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/265 2023-11-19T01:08:31.409 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:31.412 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:31.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:31.420 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-11-19T01:08:31.595 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:31.599 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:31.599 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:31.723 INFO:teuthology.orchestra.run.smithi008.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:31.727 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/266 2023-11-19T01:08:31.727 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/266 2023-11-19T01:08:31.727 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:31.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:31.738 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-11-19T01:08:31.913 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:31.915 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:31.915 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.038 INFO:teuthology.orchestra.run.smithi008.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:32.042 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/267 2023-11-19T01:08:32.042 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/267 2023-11-19T01:08:32.042 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:32.044 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:32.063 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-11-19T01:08:32.237 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:32.241 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:32.241 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.361 INFO:teuthology.orchestra.run.smithi008.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:32.364 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/268 2023-11-19T01:08:32.364 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/268 2023-11-19T01:08:32.364 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:32.376 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-11-19T01:08:32.550 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:32.554 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:32.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.662 INFO:teuthology.orchestra.run.smithi008.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:32.666 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/269 2023-11-19T01:08:32.666 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/269 2023-11-19T01:08:32.666 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:32.668 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:32.677 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-11-19T01:08:32.849 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:32.853 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.964 INFO:teuthology.orchestra.run.smithi008.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-19T01:08:32.968 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/270 2023-11-19T01:08:32.968 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/270 2023-11-19T01:08:32.968 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:32.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:32.979 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-11-19T01:08:33.152 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:33.156 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:33.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:33.279 INFO:teuthology.orchestra.run.smithi008.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:33.283 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/271 2023-11-19T01:08:33.283 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/271 2023-11-19T01:08:33.283 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:33.285 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:33.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:33.294 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-11-19T01:08:33.468 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:33.472 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:33.472 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:33.595 INFO:teuthology.orchestra.run.smithi008.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:33.599 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/272 2023-11-19T01:08:33.599 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/272 2023-11-19T01:08:33.599 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:33.601 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:33.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:33.610 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-11-19T01:08:33.783 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:33.788 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:33.788 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:33.897 INFO:teuthology.orchestra.run.smithi008.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:33.901 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/273 2023-11-19T01:08:33.901 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/273 2023-11-19T01:08:33.901 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:33.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:33.912 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-11-19T01:08:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:34.087 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:34.087 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:34.196 INFO:teuthology.orchestra.run.smithi008.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:34.200 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/274 2023-11-19T01:08:34.200 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/274 2023-11-19T01:08:34.200 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:34.203 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:34.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:34.211 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-11-19T01:08:34.384 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:34.388 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:34.497 INFO:teuthology.orchestra.run.smithi008.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:34.501 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/275 2023-11-19T01:08:34.501 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/275 2023-11-19T01:08:34.501 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:34.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:34.512 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-11-19T01:08:34.687 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:34.706 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:34.706 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:34.810 INFO:teuthology.orchestra.run.smithi008.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:34.814 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/276 2023-11-19T01:08:34.814 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/276 2023-11-19T01:08:34.814 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:34.816 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:34.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:34.825 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-11-19T01:08:34.999 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:35.003 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:35.003 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:35.127 INFO:teuthology.orchestra.run.smithi008.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:35.130 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/277 2023-11-19T01:08:35.131 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/277 2023-11-19T01:08:35.131 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:35.133 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:35.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:35.141 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-11-19T01:08:35.314 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:35.319 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:35.442 INFO:teuthology.orchestra.run.smithi008.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:35.445 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/278 2023-11-19T01:08:35.445 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/278 2023-11-19T01:08:35.445 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:35.449 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:35.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:35.457 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-11-19T01:08:35.630 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:35.634 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:35.634 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:35.755 INFO:teuthology.orchestra.run.smithi008.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:35.758 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/279 2023-11-19T01:08:35.758 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/279 2023-11-19T01:08:35.758 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:35.761 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:35.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:35.769 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-11-19T01:08:35.942 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:35.946 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:36.071 INFO:teuthology.orchestra.run.smithi008.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:36.074 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/280 2023-11-19T01:08:36.074 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/280 2023-11-19T01:08:36.075 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:36.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:36.086 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-11-19T01:08:36.259 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:36.263 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:36.263 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:36.387 INFO:teuthology.orchestra.run.smithi008.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:36.391 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/281 2023-11-19T01:08:36.391 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/281 2023-11-19T01:08:36.391 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:36.394 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:36.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:36.402 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-11-19T01:08:36.577 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:36.581 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:36.581 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:36.702 INFO:teuthology.orchestra.run.smithi008.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:36.705 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/282 2023-11-19T01:08:36.705 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/282 2023-11-19T01:08:36.705 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:36.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:36.733 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-11-19T01:08:36.905 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:36.909 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:36.909 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:37.029 INFO:teuthology.orchestra.run.smithi008.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:37.033 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/283 2023-11-19T01:08:37.033 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/283 2023-11-19T01:08:37.033 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:37.035 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:37.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:37.044 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-11-19T01:08:37.217 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:37.221 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:37.331 INFO:teuthology.orchestra.run.smithi008.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:08:37.335 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/284 2023-11-19T01:08:37.335 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/284 2023-11-19T01:08:37.335 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:37.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:37.346 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-11-19T01:08:37.522 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:37.526 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:37.526 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:39.059 INFO:teuthology.orchestra.run.smithi008.stdout:generic/285 2s 2023-11-19T01:08:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/285 2023-11-19T01:08:39.065 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:08:39.067 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:39.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:08:39.076 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-11-19T01:08:39.541 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:08:39.545 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:08:39.545 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:08:53.499 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:08:53.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:09:11.251 INFO:teuthology.orchestra.run.smithi008.stdout:generic/286 32s 2023-11-19T01:09:11.281 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/286 2023-11-19T01:09:11.281 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:11.283 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:11.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:11.293 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-11-19T01:09:11.794 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:11.799 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:12.343 INFO:teuthology.orchestra.run.smithi008.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/287 2023-11-19T01:09:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/287 2023-11-19T01:09:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:12.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:12.358 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-11-19T01:09:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:12.536 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:12.536 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:12.645 INFO:teuthology.orchestra.run.smithi008.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:12.649 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/288 2023-11-19T01:09:12.649 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/288 2023-11-19T01:09:12.649 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:12.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:12.660 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-11-19T01:09:12.832 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:12.836 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:12.964 INFO:teuthology.orchestra.run.smithi008.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:12.968 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/289 2023-11-19T01:09:12.968 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/289 2023-11-19T01:09:12.968 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:12.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:12.979 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-11-19T01:09:13.151 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:13.156 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:13.596 INFO:teuthology.orchestra.run.smithi008.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:13.599 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/290 2023-11-19T01:09:13.599 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/290 2023-11-19T01:09:13.600 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:13.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:13.611 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-11-19T01:09:13.785 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:13.789 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:13.937 INFO:teuthology.orchestra.run.smithi008.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:13.941 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/291 2023-11-19T01:09:13.941 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/291 2023-11-19T01:09:13.941 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:13.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:13.952 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-11-19T01:09:14.279 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:14.283 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:14.520 INFO:teuthology.orchestra.run.smithi008.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:14.524 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/292 2023-11-19T01:09:14.524 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/292 2023-11-19T01:09:14.524 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:14.527 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:14.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:14.536 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-11-19T01:09:14.709 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:14.713 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:14.713 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:14.823 INFO:teuthology.orchestra.run.smithi008.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:14.826 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/293 2023-11-19T01:09:14.826 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/293 2023-11-19T01:09:14.826 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:14.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:14.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:14.838 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-11-19T01:09:15.012 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:15.016 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:15.016 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:15.148 INFO:teuthology.orchestra.run.smithi008.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:15.151 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/294 2023-11-19T01:09:15.152 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/294 2023-11-19T01:09:15.152 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:15.154 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:15.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:15.163 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-11-19T01:09:15.336 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:15.340 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:15.340 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:15.457 INFO:teuthology.orchestra.run.smithi008.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:15.461 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/295 2023-11-19T01:09:15.461 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/295 2023-11-19T01:09:15.461 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:15.463 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:15.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:15.472 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-11-19T01:09:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:15.651 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:15.873 INFO:teuthology.orchestra.run.smithi008.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:15.877 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/296 2023-11-19T01:09:15.877 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/296 2023-11-19T01:09:15.877 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:15.879 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:15.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:15.888 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-11-19T01:09:16.060 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:16.064 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:16.064 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:16.512 INFO:teuthology.orchestra.run.smithi008.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:16.516 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/297 2023-11-19T01:09:16.516 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/297 2023-11-19T01:09:16.517 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:16.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:16.531 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-11-19T01:09:16.713 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:16.717 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:16.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:16.884 INFO:teuthology.orchestra.run.smithi008.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:16.887 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/298 2023-11-19T01:09:16.888 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/298 2023-11-19T01:09:16.888 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:16.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:16.899 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-11-19T01:09:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:17.076 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:17.076 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:17.200 INFO:teuthology.orchestra.run.smithi008.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:17.203 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/299 2023-11-19T01:09:17.203 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/299 2023-11-19T01:09:17.204 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:17.206 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:17.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:17.214 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-11-19T01:09:17.386 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:17.390 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:17.390 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:17.510 INFO:teuthology.orchestra.run.smithi008.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:17.512 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/300 2023-11-19T01:09:17.512 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/300 2023-11-19T01:09:17.512 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:17.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:17.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:17.523 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-11-19T01:09:17.696 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:17.700 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:17.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:17.811 INFO:teuthology.orchestra.run.smithi008.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:17.815 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/301 2023-11-19T01:09:17.815 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/301 2023-11-19T01:09:17.815 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:17.818 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:17.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:17.827 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-11-19T01:09:18.000 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:18.004 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:18.005 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:18.115 INFO:teuthology.orchestra.run.smithi008.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:18.118 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/302 2023-11-19T01:09:18.118 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/302 2023-11-19T01:09:18.119 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:18.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:18.140 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-11-19T01:09:18.312 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:18.316 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:18.482 INFO:teuthology.orchestra.run.smithi008.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T01:09:18.485 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/303 2023-11-19T01:09:18.486 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/303 2023-11-19T01:09:18.486 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:18.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:18.497 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-11-19T01:09:18.951 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:18.956 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:19.122 INFO:teuthology.orchestra.run.smithi008.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T01:09:19.126 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/304 2023-11-19T01:09:19.126 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/304 2023-11-19T01:09:19.126 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:19.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:19.151 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-11-19T01:09:19.627 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:19.631 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:19.631 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:19.758 INFO:teuthology.orchestra.run.smithi008.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:19.762 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/305 2023-11-19T01:09:19.762 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/305 2023-11-19T01:09:19.762 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:19.764 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:19.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:19.792 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-11-19T01:09:19.964 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:19.968 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:19.968 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:20.092 INFO:teuthology.orchestra.run.smithi008.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:20.095 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/306 2023-11-19T01:09:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/306 2023-11-19T01:09:20.096 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:20.098 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:20.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:20.107 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-11-19T01:09:20.279 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:20.283 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:20.284 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:20.402 INFO:teuthology.orchestra.run.smithi008.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:09:20.405 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/307 2023-11-19T01:09:20.405 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/307 2023-11-19T01:09:20.405 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:20.407 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:20.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:20.417 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-11-19T01:09:20.590 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:20.594 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:20.594 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:20.739 INFO:teuthology.orchestra.run.smithi008.stdout:generic/308 0s 2023-11-19T01:09:20.744 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/308 2023-11-19T01:09:20.744 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:20.747 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:20.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:20.756 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-11-19T01:09:20.929 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:20.934 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:20.934 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:22.124 INFO:teuthology.orchestra.run.smithi008.stdout:generic/309 2s 2023-11-19T01:09:22.130 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/309 2023-11-19T01:09:22.131 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:09:22.133 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:22.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:09:22.143 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-11-19T01:09:22.607 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:09:22.610 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:09:22.611 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:09:23.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:09:23.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:09:53.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:09:53.732 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:10:24.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:10:24.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:10:43.475 INFO:teuthology.orchestra.run.smithi008.stdout:generic/310 81s 2023-11-19T01:10:43.509 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/310 2023-11-19T01:10:43.509 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:43.511 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:43.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:43.526 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-11-19T01:10:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:43.713 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:44.817 INFO:teuthology.orchestra.run.smithi008.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:10:44.821 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/311 2023-11-19T01:10:44.821 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/311 2023-11-19T01:10:44.821 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:44.824 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:44.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:44.835 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-11-19T01:10:45.013 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:45.016 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:45.017 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:45.309 INFO:teuthology.orchestra.run.smithi008.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:10:45.312 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/312 2023-11-19T01:10:45.312 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/312 2023-11-19T01:10:45.312 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:45.315 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:45.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:45.324 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-11-19T01:10:45.497 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:45.501 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:45.501 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:50.062 INFO:teuthology.orchestra.run.smithi008.stdout:generic/313 4s 2023-11-19T01:10:50.122 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/313 2023-11-19T01:10:50.122 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:50.125 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:50.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:50.137 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-11-19T01:10:50.320 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:50.324 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:51.445 INFO:teuthology.orchestra.run.smithi008.stdout:generic/314 1s 2023-11-19T01:10:51.450 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/314 2023-11-19T01:10:51.450 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:51.453 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:51.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:51.462 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-11-19T01:10:51.638 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:51.642 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:51.643 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:54.379 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:10:54.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:10:55.044 INFO:teuthology.orchestra.run.smithi008.stdout:generic/315 4s 2023-11-19T01:10:55.051 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/315 2023-11-19T01:10:55.051 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:55.054 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:55.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:55.064 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-11-19T01:10:55.530 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:55.534 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:55.534 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:56.424 INFO:teuthology.orchestra.run.smithi008.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-19T01:10:56.428 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/316 2023-11-19T01:10:56.428 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/316 2023-11-19T01:10:56.428 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:56.430 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:56.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:56.440 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-11-19T01:10:56.904 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:56.910 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:56.910 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:57.063 INFO:teuthology.orchestra.run.smithi008.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:10:57.067 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/317 2023-11-19T01:10:57.067 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/317 2023-11-19T01:10:57.067 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:57.069 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:57.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:57.079 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-11-19T01:10:57.256 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:57.260 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:57.261 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:57.374 INFO:teuthology.orchestra.run.smithi008.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:10:57.379 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/318 2023-11-19T01:10:57.379 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/318 2023-11-19T01:10:57.379 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:57.380 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:57.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:57.390 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-11-19T01:10:57.566 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:57.571 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:57.571 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:57.716 INFO:teuthology.orchestra.run.smithi008.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-19T01:10:57.720 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/319 2023-11-19T01:10:57.720 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/319 2023-11-19T01:10:57.720 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:57.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:57.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:57.731 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-11-19T01:10:57.908 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:57.912 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:58.023 INFO:teuthology.orchestra.run.smithi008.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:10:58.026 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/320 2023-11-19T01:10:58.027 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/320 2023-11-19T01:10:58.027 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:58.029 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:58.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:58.038 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-11-19T01:10:58.211 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:58.215 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:58.215 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:58.382 INFO:teuthology.orchestra.run.smithi008.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:10:58.386 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/321 2023-11-19T01:10:58.386 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/321 2023-11-19T01:10:58.386 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:58.388 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:58.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:58.398 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-11-19T01:10:58.570 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:58.574 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:58.574 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:58.691 INFO:teuthology.orchestra.run.smithi008.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:10:58.695 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/322 2023-11-19T01:10:58.695 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/322 2023-11-19T01:10:58.695 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:10:58.697 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:10:58.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:10:58.706 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-11-19T01:10:58.880 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:10:58.884 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:10:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:11:24.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:11:24.833 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:11:54.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:11:54.925 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:12:25.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:12:25.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:12:55.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:12:55.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:12:55.574 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T01:12:55.573+0000 7f3d1e6f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97424) UID: 0 2023-11-19T01:12:55.575 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T01:12:55.573+0000 7fbb189dc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97424) UID: 0 2023-11-19T01:12:55.575 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T01:12:55.573+0000 7f2ef6b14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97424) UID: 0 2023-11-19T01:12:55.575 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T01:12:55.573+0000 7ffb9bc76640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97424) UID: 0 2023-11-19T01:12:59.699 INFO:teuthology.orchestra.run.smithi008.stdout:generic/323 121s 2023-11-19T01:12:59.705 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/323 2023-11-19T01:12:59.705 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:12:59.707 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:12:59.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:12:59.724 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-11-19T01:13:00.151 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:00.156 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:00.157 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:00.294 INFO:teuthology.orchestra.run.smithi008.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/324 2023-11-19T01:13:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/324 2023-11-19T01:13:00.297 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:00.299 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:00.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:00.308 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-11-19T01:13:00.481 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:00.485 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:00.486 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:00.643 INFO:teuthology.orchestra.run.smithi008.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/325 2023-11-19T01:13:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/325 2023-11-19T01:13:00.647 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:00.649 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:00.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:00.658 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-11-19T01:13:00.832 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:00.836 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:00.836 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:00.952 INFO:teuthology.orchestra.run.smithi008.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:00.956 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/326 2023-11-19T01:13:00.956 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/326 2023-11-19T01:13:00.956 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:00.959 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:00.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:00.968 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-11-19T01:13:01.141 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:01.145 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:01.145 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:01.256 INFO:teuthology.orchestra.run.smithi008.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:01.260 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/327 2023-11-19T01:13:01.260 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/327 2023-11-19T01:13:01.260 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:01.262 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:01.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:01.271 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-11-19T01:13:01.443 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:01.447 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:01.447 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:01.563 INFO:teuthology.orchestra.run.smithi008.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:01.566 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/328 2023-11-19T01:13:01.566 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/328 2023-11-19T01:13:01.566 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:01.569 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:01.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:01.577 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-11-19T01:13:01.750 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:01.754 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:01.754 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:01.884 INFO:teuthology.orchestra.run.smithi008.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:01.887 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/329 2023-11-19T01:13:01.888 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/329 2023-11-19T01:13:01.888 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:01.890 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:01.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:01.898 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-11-19T01:13:02.070 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:02.074 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:02.074 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:02.184 INFO:teuthology.orchestra.run.smithi008.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:02.188 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/330 2023-11-19T01:13:02.188 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/330 2023-11-19T01:13:02.188 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:02.190 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:02.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:02.199 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-11-19T01:13:02.372 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:02.376 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:02.377 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:02.501 INFO:teuthology.orchestra.run.smithi008.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:02.504 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/331 2023-11-19T01:13:02.504 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/331 2023-11-19T01:13:02.504 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:02.507 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:02.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:02.516 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-11-19T01:13:02.689 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:02.693 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:02.803 INFO:teuthology.orchestra.run.smithi008.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:02.807 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/332 2023-11-19T01:13:02.807 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/332 2023-11-19T01:13:02.807 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:02.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:02.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:02.819 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-11-19T01:13:02.990 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:02.994 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:02.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:03.104 INFO:teuthology.orchestra.run.smithi008.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:03.108 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/333 2023-11-19T01:13:03.108 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/333 2023-11-19T01:13:03.108 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:03.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:03.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:03.119 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-11-19T01:13:03.291 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:03.295 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:03.295 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:03.406 INFO:teuthology.orchestra.run.smithi008.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:03.410 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/334 2023-11-19T01:13:03.410 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/334 2023-11-19T01:13:03.410 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:03.412 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:03.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:03.421 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-11-19T01:13:03.593 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:03.597 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:03.597 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:03.716 INFO:teuthology.orchestra.run.smithi008.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:03.720 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/335 2023-11-19T01:13:03.720 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/335 2023-11-19T01:13:03.720 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:03.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:03.732 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-11-19T01:13:03.903 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:03.907 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:03.907 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.026 INFO:teuthology.orchestra.run.smithi008.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:04.029 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/336 2023-11-19T01:13:04.029 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/336 2023-11-19T01:13:04.029 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:04.032 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:04.041 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-11-19T01:13:04.213 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:04.217 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:04.217 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.343 INFO:teuthology.orchestra.run.smithi008.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:04.347 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/337 2023-11-19T01:13:04.347 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/337 2023-11-19T01:13:04.348 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:04.349 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:04.359 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-11-19T01:13:04.531 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:04.535 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:04.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.656 INFO:teuthology.orchestra.run.smithi008.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:04.660 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/338 2023-11-19T01:13:04.660 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/338 2023-11-19T01:13:04.660 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:04.662 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:04.671 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-11-19T01:13:04.843 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:04.847 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:04.847 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.956 INFO:teuthology.orchestra.run.smithi008.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:04.959 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/339 2023-11-19T01:13:04.959 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/339 2023-11-19T01:13:04.960 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:04.962 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:04.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:04.971 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-11-19T01:13:05.142 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:05.146 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:05.147 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:05.260 INFO:teuthology.orchestra.run.smithi008.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:05.263 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/340 2023-11-19T01:13:05.264 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/340 2023-11-19T01:13:05.264 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:05.266 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:05.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:05.275 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-11-19T01:13:05.447 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:05.451 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:05.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:05.570 INFO:teuthology.orchestra.run.smithi008.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:05.574 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/341 2023-11-19T01:13:05.574 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/341 2023-11-19T01:13:05.574 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:05.576 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:05.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:05.585 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-11-19T01:13:05.759 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:05.763 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:05.763 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:05.882 INFO:teuthology.orchestra.run.smithi008.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:05.886 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/342 2023-11-19T01:13:05.886 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/342 2023-11-19T01:13:05.886 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:05.888 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:05.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:05.898 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-11-19T01:13:06.070 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:06.074 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:06.074 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:06.198 INFO:teuthology.orchestra.run.smithi008.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:06.200 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/343 2023-11-19T01:13:06.200 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/343 2023-11-19T01:13:06.200 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:06.203 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:06.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:06.212 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-11-19T01:13:06.384 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:06.388 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:06.388 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:06.501 INFO:teuthology.orchestra.run.smithi008.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:06.505 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/344 2023-11-19T01:13:06.505 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/344 2023-11-19T01:13:06.505 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:06.507 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:06.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:06.516 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-11-19T01:13:06.689 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:06.693 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:06.693 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:06.801 INFO:teuthology.orchestra.run.smithi008.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:06.805 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/345 2023-11-19T01:13:06.805 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/345 2023-11-19T01:13:06.805 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:06.807 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:06.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:06.818 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-11-19T01:13:06.991 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:06.995 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:06.995 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:07.103 INFO:teuthology.orchestra.run.smithi008.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:07.107 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/346 2023-11-19T01:13:07.107 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/346 2023-11-19T01:13:07.107 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:07.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:07.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:07.118 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-11-19T01:13:07.290 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:07.294 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:07.450 INFO:teuthology.orchestra.run.smithi008.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:07.453 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/347 2023-11-19T01:13:07.453 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/347 2023-11-19T01:13:07.453 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:07.456 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:07.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:07.464 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-11-19T01:13:07.636 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:07.641 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:07.641 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:07.761 INFO:teuthology.orchestra.run.smithi008.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:07.765 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/348 2023-11-19T01:13:07.765 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/348 2023-11-19T01:13:07.765 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:07.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:07.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:07.776 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-11-19T01:13:07.948 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:07.952 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:08.842 INFO:teuthology.orchestra.run.smithi008.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-19T01:13:08.845 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/349 2023-11-19T01:13:08.845 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/349 2023-11-19T01:13:08.845 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:08.848 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:08.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:08.865 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-11-19T01:13:09.042 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:09.047 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:09.047 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:10.305 INFO:teuthology.orchestra.run.smithi008.stdout:generic/350 1s 2023-11-19T01:13:10.310 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/350 2023-11-19T01:13:10.310 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:10.313 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:10.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:10.322 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-11-19T01:13:10.495 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:10.499 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:10.499 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:11.378 INFO:teuthology.orchestra.run.smithi008.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-19T01:13:11.382 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/351 2023-11-19T01:13:11.382 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/351 2023-11-19T01:13:11.382 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:11.384 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:11.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:11.407 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-11-19T01:13:11.842 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:11.846 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:11.846 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:11.958 INFO:teuthology.orchestra.run.smithi008.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:11.962 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/352 2023-11-19T01:13:11.962 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/352 2023-11-19T01:13:11.962 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:11.964 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:11.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:11.973 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-11-19T01:13:12.146 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:12.150 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:12.151 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:12.260 INFO:teuthology.orchestra.run.smithi008.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/353 2023-11-19T01:13:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/353 2023-11-19T01:13:12.264 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:12.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:12.275 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-11-19T01:13:12.450 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:12.454 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:12.566 INFO:teuthology.orchestra.run.smithi008.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:12.569 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/354 2023-11-19T01:13:12.569 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/354 2023-11-19T01:13:12.570 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:12.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:12.581 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-11-19T01:13:12.754 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:12.758 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:13.360 INFO:teuthology.orchestra.run.smithi008.stdout:generic/355 1s 2023-11-19T01:13:13.366 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/355 2023-11-19T01:13:13.366 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:13.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:13.377 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-11-19T01:13:13.824 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:13.829 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:13.953 INFO:teuthology.orchestra.run.smithi008.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:13.957 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/356 2023-11-19T01:13:13.957 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/356 2023-11-19T01:13:13.957 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:13.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:13.970 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-11-19T01:13:14.143 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:14.147 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:14.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:14.257 INFO:teuthology.orchestra.run.smithi008.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:14.261 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/357 2023-11-19T01:13:14.261 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/357 2023-11-19T01:13:14.261 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:14.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:14.272 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-11-19T01:13:14.446 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:14.451 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:14.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:14.561 INFO:teuthology.orchestra.run.smithi008.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:14.564 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/358 2023-11-19T01:13:14.564 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/358 2023-11-19T01:13:14.565 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:14.567 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:14.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:14.577 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-11-19T01:13:14.751 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:14.754 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:14.754 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:14.870 INFO:teuthology.orchestra.run.smithi008.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:14.874 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/359 2023-11-19T01:13:14.874 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/359 2023-11-19T01:13:14.874 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:14.876 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:14.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:14.885 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-11-19T01:13:15.061 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:15.065 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:15.065 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:15.230 INFO:teuthology.orchestra.run.smithi008.stdout:generic/360 0s 2023-11-19T01:13:15.236 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/360 2023-11-19T01:13:15.236 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:15.238 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:15.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:15.247 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-11-19T01:13:15.421 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:15.425 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:15.425 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/361 2023-11-19T01:13:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/361 2023-11-19T01:13:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:15.566 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:15.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:15.575 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-11-19T01:13:15.748 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:15.751 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:15.751 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi008.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:15.862 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/362 2023-11-19T01:13:15.863 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/362 2023-11-19T01:13:15.863 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:15.865 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:15.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:15.875 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-11-19T01:13:16.049 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:16.053 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:16.053 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:16.162 INFO:teuthology.orchestra.run.smithi008.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:16.165 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/363 2023-11-19T01:13:16.165 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/363 2023-11-19T01:13:16.165 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:16.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:16.177 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-11-19T01:13:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:16.352 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:16.460 INFO:teuthology.orchestra.run.smithi008.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:16.464 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/364 2023-11-19T01:13:16.464 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/364 2023-11-19T01:13:16.464 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:16.467 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:16.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:16.476 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-11-19T01:13:16.650 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:16.654 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:16.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:16.761 INFO:teuthology.orchestra.run.smithi008.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:16.765 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/365 2023-11-19T01:13:16.765 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/365 2023-11-19T01:13:16.765 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:16.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:16.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:16.776 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-11-19T01:13:16.949 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:16.952 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.065 INFO:teuthology.orchestra.run.smithi008.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:17.068 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/366 2023-11-19T01:13:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/366 2023-11-19T01:13:17.069 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:17.071 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:17.080 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-11-19T01:13:17.252 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:17.256 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.366 INFO:teuthology.orchestra.run.smithi008.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:17.373 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/367 2023-11-19T01:13:17.374 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/367 2023-11-19T01:13:17.375 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:17.376 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:17.386 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-11-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:17.568 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:17.568 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.676 INFO:teuthology.orchestra.run.smithi008.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:17.679 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/368 2023-11-19T01:13:17.679 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/368 2023-11-19T01:13:17.680 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:17.682 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:17.691 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-11-19T01:13:17.862 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:17.866 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:17.866 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.973 INFO:teuthology.orchestra.run.smithi008.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:17.977 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/369 2023-11-19T01:13:17.977 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/369 2023-11-19T01:13:17.977 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:17.979 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:17.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:17.988 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-11-19T01:13:18.161 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:18.165 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:18.281 INFO:teuthology.orchestra.run.smithi008.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:18.283 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/370 2023-11-19T01:13:18.283 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/370 2023-11-19T01:13:18.283 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:18.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:18.297 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-11-19T01:13:18.471 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:18.475 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:18.585 INFO:teuthology.orchestra.run.smithi008.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:18.588 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/371 2023-11-19T01:13:18.588 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/371 2023-11-19T01:13:18.588 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:18.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:18.601 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-11-19T01:13:18.773 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:18.777 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:18.887 INFO:teuthology.orchestra.run.smithi008.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:18.890 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/372 2023-11-19T01:13:18.891 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/372 2023-11-19T01:13:18.891 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:18.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:18.902 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-11-19T01:13:19.076 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:19.080 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:19.189 INFO:teuthology.orchestra.run.smithi008.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:19.193 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/373 2023-11-19T01:13:19.193 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/373 2023-11-19T01:13:19.193 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:19.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:19.204 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-11-19T01:13:19.378 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:19.382 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:19.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:19.530 INFO:teuthology.orchestra.run.smithi008.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:19.534 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/374 2023-11-19T01:13:19.534 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/374 2023-11-19T01:13:19.534 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:19.536 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:19.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:19.545 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-11-19T01:13:19.718 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:19.722 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:19.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:20.138 INFO:teuthology.orchestra.run.smithi008.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-19T01:13:20.142 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/375 2023-11-19T01:13:20.142 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/375 2023-11-19T01:13:20.142 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:20.145 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:20.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:20.170 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-11-19T01:13:20.351 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:20.355 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:20.355 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:20.881 INFO:teuthology.orchestra.run.smithi008.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:20.885 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/376 2023-11-19T01:13:20.885 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/376 2023-11-19T01:13:20.885 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:20.888 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:20.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:20.907 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-11-19T01:13:21.088 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:21.093 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:21.206 INFO:teuthology.orchestra.run.smithi008.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:21.208 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/377 2023-11-19T01:13:21.208 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/377 2023-11-19T01:13:21.208 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:21.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:21.220 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-11-19T01:13:21.392 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:21.396 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:21.396 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:generic/378 0s 2023-11-19T01:13:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/378 2023-11-19T01:13:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:21.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:21.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:21.623 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-11-19T01:13:22.077 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:22.081 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:22.081 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:22.198 INFO:teuthology.orchestra.run.smithi008.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:22.201 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/379 2023-11-19T01:13:22.202 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/379 2023-11-19T01:13:22.202 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:22.204 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:22.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:22.213 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-11-19T01:13:22.385 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:22.389 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:22.389 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:22.499 INFO:teuthology.orchestra.run.smithi008.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:22.503 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/380 2023-11-19T01:13:22.503 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/380 2023-11-19T01:13:22.503 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:22.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:22.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:22.515 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-11-19T01:13:22.689 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:22.693 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:22.693 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:22.804 INFO:teuthology.orchestra.run.smithi008.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:22.807 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/381 2023-11-19T01:13:22.807 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/381 2023-11-19T01:13:22.807 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:22.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:22.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:22.819 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-11-19T01:13:22.992 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:22.996 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:23.106 INFO:teuthology.orchestra.run.smithi008.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:23.109 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/382 2023-11-19T01:13:23.109 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/382 2023-11-19T01:13:23.110 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:23.112 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:23.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:23.121 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-11-19T01:13:23.294 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:23.298 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:23.298 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:23.409 INFO:teuthology.orchestra.run.smithi008.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:23.412 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/383 2023-11-19T01:13:23.412 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/383 2023-11-19T01:13:23.413 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:23.415 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:23.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:23.431 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-11-19T01:13:23.603 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:23.607 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:23.607 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:23.721 INFO:teuthology.orchestra.run.smithi008.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-19T01:13:23.725 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/384 2023-11-19T01:13:23.725 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/384 2023-11-19T01:13:23.725 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:23.727 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:23.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:23.737 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-11-19T01:13:23.909 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:23.913 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:23.913 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.025 INFO:teuthology.orchestra.run.smithi008.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:24.029 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/385 2023-11-19T01:13:24.030 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/385 2023-11-19T01:13:24.030 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:24.031 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:24.039 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-11-19T01:13:24.211 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:24.215 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.325 INFO:teuthology.orchestra.run.smithi008.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-19T01:13:24.328 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/386 2023-11-19T01:13:24.328 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/386 2023-11-19T01:13:24.329 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:24.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:24.339 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-11-19T01:13:24.512 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:24.516 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:24.516 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.625 INFO:teuthology.orchestra.run.smithi008.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:24.629 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/387 2023-11-19T01:13:24.629 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/387 2023-11-19T01:13:24.629 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:24.631 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:24.640 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-11-19T01:13:24.812 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:24.816 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.932 INFO:teuthology.orchestra.run.smithi008.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:24.935 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/388 2023-11-19T01:13:24.935 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/388 2023-11-19T01:13:24.935 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:24.938 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:24.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:24.957 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-11-19T01:13:25.132 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:25.136 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:25.136 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:25.253 INFO:teuthology.orchestra.run.smithi008.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-19T01:13:25.256 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/389 2023-11-19T01:13:25.256 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/389 2023-11-19T01:13:25.256 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:25.258 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:25.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:25.267 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-11-19T01:13:25.446 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:25.575 INFO:teuthology.orchestra.run.smithi008.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:25.579 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/390 2023-11-19T01:13:25.579 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/390 2023-11-19T01:13:25.579 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:25.581 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:25.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:25.591 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-11-19T01:13:25.769 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:25.773 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:25.773 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:46.419 INFO:teuthology.orchestra.run.smithi008.stdout:generic/391 21s 2023-11-19T01:13:46.469 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/391 2023-11-19T01:13:46.469 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:46.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:46.669 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-11-19T01:13:47.678 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:47.682 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:47.851 INFO:teuthology.orchestra.run.smithi008.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:47.858 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/392 2023-11-19T01:13:47.858 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/392 2023-11-19T01:13:47.858 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:47.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:47.877 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-11-19T01:13:48.123 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:48.128 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:48.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:48.288 INFO:teuthology.orchestra.run.smithi008.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:48.293 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/393 2023-11-19T01:13:48.293 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/393 2023-11-19T01:13:48.293 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:48.295 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:48.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:48.305 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-11-19T01:13:48.547 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:48.555 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:48.774 INFO:teuthology.orchestra.run.smithi008.stdout:generic/394 0s 2023-11-19T01:13:48.782 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/394 2023-11-19T01:13:48.783 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:48.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:48.797 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-11-19T01:13:49.269 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:49.279 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:49.461 INFO:teuthology.orchestra.run.smithi008.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:49.466 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/395 2023-11-19T01:13:49.466 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/395 2023-11-19T01:13:49.466 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:49.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:49.484 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-11-19T01:13:49.739 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:49.745 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:49.924 INFO:teuthology.orchestra.run.smithi008.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:49.929 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/396 2023-11-19T01:13:49.929 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/396 2023-11-19T01:13:49.929 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:49.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:49.944 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-11-19T01:13:50.224 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:50.229 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:50.436 INFO:teuthology.orchestra.run.smithi008.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:50.440 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/397 2023-11-19T01:13:50.440 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/397 2023-11-19T01:13:50.440 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:50.443 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:50.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:50.456 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-11-19T01:13:50.707 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:50.712 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:50.712 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:50.849 INFO:teuthology.orchestra.run.smithi008.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:50.853 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/398 2023-11-19T01:13:50.853 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/398 2023-11-19T01:13:50.853 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:50.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:50.864 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-11-19T01:13:51.038 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:51.042 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:51.042 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:51.179 INFO:teuthology.orchestra.run.smithi008.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:51.183 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/399 2023-11-19T01:13:51.183 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/399 2023-11-19T01:13:51.183 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:51.185 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:51.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:51.194 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-11-19T01:13:51.366 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:51.370 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:51.371 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:51.480 INFO:teuthology.orchestra.run.smithi008.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-19T01:13:51.484 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/400 2023-11-19T01:13:51.484 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/400 2023-11-19T01:13:51.484 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:51.486 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:51.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:51.495 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-11-19T01:13:51.668 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:51.672 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:51.672 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:51.782 INFO:teuthology.orchestra.run.smithi008.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:51.785 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/401 2023-11-19T01:13:51.786 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/401 2023-11-19T01:13:51.786 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:51.788 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:51.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:51.796 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-11-19T01:13:51.969 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:51.973 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:51.973 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:52.083 INFO:teuthology.orchestra.run.smithi008.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/402 2023-11-19T01:13:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/402 2023-11-19T01:13:52.086 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:52.089 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:52.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:52.098 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-11-19T01:13:52.270 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:52.274 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:52.274 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:52.383 INFO:teuthology.orchestra.run.smithi008.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:52.386 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/403 2023-11-19T01:13:52.386 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/403 2023-11-19T01:13:52.386 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:52.389 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:52.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:52.397 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-11-19T01:13:52.570 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:52.574 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:52.574 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:53.426 INFO:teuthology.orchestra.run.smithi008.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-19T01:13:53.430 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/404 2023-11-19T01:13:53.430 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/404 2023-11-19T01:13:53.430 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:53.432 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:53.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:53.477 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-11-19T01:13:53.905 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:53.909 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:53.909 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:54.108 INFO:teuthology.orchestra.run.smithi008.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:54.110 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/405 2023-11-19T01:13:54.110 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/405 2023-11-19T01:13:54.110 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:54.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:54.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:54.122 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-11-19T01:13:54.296 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:54.300 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:54.409 INFO:teuthology.orchestra.run.smithi008.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:54.413 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/406 2023-11-19T01:13:54.413 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/406 2023-11-19T01:13:54.413 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:54.415 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:54.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:54.424 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-11-19T01:13:54.596 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:54.600 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:54.600 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:54.759 INFO:teuthology.orchestra.run.smithi008.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T01:13:54.763 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/407 2023-11-19T01:13:54.763 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/407 2023-11-19T01:13:54.763 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:54.765 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:54.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:54.775 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-11-19T01:13:55.215 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:55.219 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:55.219 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:55.387 INFO:teuthology.orchestra.run.smithi008.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T01:13:55.390 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/408 2023-11-19T01:13:55.390 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/408 2023-11-19T01:13:55.391 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:55.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:55.402 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-11-19T01:13:55.858 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:55.862 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:55.862 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:55.980 INFO:teuthology.orchestra.run.smithi008.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:55.984 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/409 2023-11-19T01:13:55.984 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/409 2023-11-19T01:13:55.984 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:55.986 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:55.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:55.996 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-11-19T01:13:56.172 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:56.176 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:56.176 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:56.296 INFO:teuthology.orchestra.run.smithi008.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:56.299 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/410 2023-11-19T01:13:56.299 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/410 2023-11-19T01:13:56.299 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:56.302 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:56.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:56.311 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-11-19T01:13:56.484 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:56.489 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:56.489 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:56.602 INFO:teuthology.orchestra.run.smithi008.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:56.606 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/411 2023-11-19T01:13:56.606 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/411 2023-11-19T01:13:56.606 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:56.608 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:56.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:56.617 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-11-19T01:13:56.794 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:56.798 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:56.909 INFO:teuthology.orchestra.run.smithi008.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:56.913 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/412 2023-11-19T01:13:56.913 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/412 2023-11-19T01:13:56.913 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:56.915 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:56.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:56.924 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-11-19T01:13:57.099 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:57.103 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:57.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/413 2023-11-19T01:13:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/413 2023-11-19T01:13:57.223 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:57.225 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:57.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:57.242 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-11-19T01:13:57.415 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:57.419 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:57.419 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:57.534 INFO:teuthology.orchestra.run.smithi008.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:57.538 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/414 2023-11-19T01:13:57.538 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/414 2023-11-19T01:13:57.539 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:57.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:57.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:57.549 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-11-19T01:13:57.729 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:57.733 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:57.733 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:57.966 INFO:teuthology.orchestra.run.smithi008.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:57.970 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/415 2023-11-19T01:13:57.970 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/415 2023-11-19T01:13:57.970 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:57.972 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:57.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:57.981 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-11-19T01:13:58.158 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:58.162 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:58.163 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:58.269 INFO:teuthology.orchestra.run.smithi008.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:58.273 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/416 2023-11-19T01:13:58.273 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/416 2023-11-19T01:13:58.273 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:58.275 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:58.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:58.284 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-11-19T01:13:58.465 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:58.469 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:58.578 INFO:teuthology.orchestra.run.smithi008.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:58.582 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/417 2023-11-19T01:13:58.582 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/417 2023-11-19T01:13:58.582 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:58.584 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:58.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:58.593 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-11-19T01:13:58.769 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:58.773 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:58.773 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:58.925 INFO:teuthology.orchestra.run.smithi008.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-11-19T01:13:58.929 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/418 2023-11-19T01:13:58.929 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/418 2023-11-19T01:13:58.929 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:58.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:58.940 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-11-19T01:13:59.117 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:59.121 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:59.121 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:59.256 INFO:teuthology.orchestra.run.smithi008.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:13:59.259 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/419 2023-11-19T01:13:59.260 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/419 2023-11-19T01:13:59.260 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:13:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:13:59.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:13:59.283 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-11-19T01:13:59.456 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:13:59.461 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:13:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:generic/420 1s 2023-11-19T01:14:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/420 2023-11-19T01:14:00.352 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:00.354 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:00.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:00.364 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-11-19T01:14:00.813 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:00.817 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:00.817 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:00.962 INFO:teuthology.orchestra.run.smithi008.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:14:00.965 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/421 2023-11-19T01:14:00.966 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/421 2023-11-19T01:14:00.966 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:00.968 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:00.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:00.977 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-11-19T01:14:01.151 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:01.155 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:01.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:01.268 INFO:teuthology.orchestra.run.smithi008.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:14:01.271 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/422 2023-11-19T01:14:01.271 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/422 2023-11-19T01:14:01.272 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:01.274 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:01.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:01.296 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-11-19T01:14:01.470 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:01.474 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:01.475 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:01.729 INFO:teuthology.orchestra.run.smithi008.stdout:generic/423 0s 2023-11-19T01:14:01.734 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/423 2023-11-19T01:14:01.734 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:01.737 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:01.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:01.746 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-11-19T01:14:02.186 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:02.191 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:02.191 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:02.335 INFO:teuthology.orchestra.run.smithi008.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-11-19T01:14:02.339 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/424 2023-11-19T01:14:02.339 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/424 2023-11-19T01:14:02.339 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:02.341 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:02.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:02.360 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-11-19T01:14:02.536 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:02.540 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:14:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/425 2023-11-19T01:14:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/425 2023-11-19T01:14:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:02.657 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:02.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:02.666 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-11-19T01:14:02.839 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:02.843 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:33.006 INFO:teuthology.orchestra.run.smithi008.stdout:generic/426 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/426.out.bad) 2023-11-19T01:14:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/426.out 2023-11-18 23:42:21.581425279 +0000 2023-11-19T01:14:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/426.out.bad 2023-11-19 01:14:32.977629379 +0000 2023-11-19T01:14:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,5 +1,371 @@ 2023-11-19T01:14:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 426 2023-11-19T01:14:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/426-dir -d 2023-11-19T01:14:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000658) opened an unlinked file! 2023-11-19T01:14:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000659) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000660) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000661) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000662) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000663) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000664) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000665) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000666) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000667) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000668) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000669) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000670) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000671) opened an unlinked file! 2023-11-19T01:14:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000672) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000673) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000674) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000675) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000676) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000677) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000678) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000679) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000680) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000681) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000682) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000683) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000684) opened an unlinked file! 2023-11-19T01:14:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000685) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000686) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000687) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000688) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000689) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000690) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000691) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000692) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000693) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000694) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000695) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000696) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000697) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000698) opened an unlinked file! 2023-11-19T01:14:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000699) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000700) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000701) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000702) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000703) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000704) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000705) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000706) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000707) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000708) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000709) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000710) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000711) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000712) opened an unlinked file! 2023-11-19T01:14:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000713) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000714) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000715) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000716) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000717) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000718) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000719) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000720) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000721) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000722) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000723) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000724) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000725) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000726) opened an unlinked file! 2023-11-19T01:14:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000727) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000728) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000729) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000730) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000731) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000732) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000733) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000734) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000735) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000736) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000737) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000738) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000739) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000740) opened an unlinked file! 2023-11-19T01:14:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000741) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000742) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000743) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000744) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000745) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000746) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000747) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000748) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000749) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000750) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000751) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000752) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000753) opened an unlinked file! 2023-11-19T01:14:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000754) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000755) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000756) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000757) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000758) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000759) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000760) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000761) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000762) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000763) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000764) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000765) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000766) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000767) opened an unlinked file! 2023-11-19T01:14:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000768) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000769) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000770) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000771) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000772) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000773) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000774) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000775) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000776) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000777) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000778) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000779) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000780) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000781) opened an unlinked file! 2023-11-19T01:14:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000782) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000783) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000784) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000785) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000786) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000787) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000788) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000789) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000790) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000791) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000792) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000793) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000794) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000795) opened an unlinked file! 2023-11-19T01:14:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000796) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000797) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000798) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000799) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000800) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000801) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000802) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000803) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000804) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000805) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000806) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000807) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000808) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000809) opened an unlinked file! 2023-11-19T01:14:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000810) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000811) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000812) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000813) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000814) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000815) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000816) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000817) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000818) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000819) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000820) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000821) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000822) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000823) opened an unlinked file! 2023-11-19T01:14:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000824) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000825) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000826) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000827) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000828) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000829) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000830) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000831) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000832) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000833) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000834) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000835) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000836) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000837) opened an unlinked file! 2023-11-19T01:14:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000838) opened an unlinked file! 2023-11-19T01:14:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000839) opened an unlinked file! 2023-11-19T01:14:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000840) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000841) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000842) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000843) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000844) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000845) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000846) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000847) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000848) opened an unlinked file! 2023-11-19T01:14:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000849) opened an unlinked file! 2023-11-19T01:14:33.041 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000850) opened an unlinked file! 2023-11-19T01:14:33.041 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000851) opened an unlinked file! 2023-11-19T01:14:33.041 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000852) opened an unlinked file! 2023-11-19T01:14:33.041 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000853) opened an unlinked file! 2023-11-19T01:14:33.041 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000854) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000855) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000856) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000857) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000858) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000859) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000860) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000861) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000862) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000863) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000864) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000865) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000866) opened an unlinked file! 2023-11-19T01:14:33.042 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000867) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000868) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000869) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000870) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000871) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000872) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000873) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000874) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000875) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000876) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000877) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000878) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000879) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000880) opened an unlinked file! 2023-11-19T01:14:33.043 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000881) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000882) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000883) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000884) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000885) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000886) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000887) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000888) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000889) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000890) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000891) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000892) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000893) opened an unlinked file! 2023-11-19T01:14:33.044 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000894) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000895) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000896) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000897) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000898) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000899) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000900) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000901) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000902) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000903) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000904) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000905) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000906) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000907) opened an unlinked file! 2023-11-19T01:14:33.045 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000908) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000909) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000910) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000911) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000912) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000913) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000914) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000915) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000916) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000917) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000918) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000919) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000920) opened an unlinked file! 2023-11-19T01:14:33.046 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000921) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000922) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000923) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000924) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000925) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000926) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000927) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000928) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000929) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000930) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000931) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000932) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000933) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000934) opened an unlinked file! 2023-11-19T01:14:33.047 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000935) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000936) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000937) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000938) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000939) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000940) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000941) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000942) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000943) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000944) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000945) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000946) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000947) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000948) opened an unlinked file! 2023-11-19T01:14:33.048 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000949) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000950) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000951) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000952) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000953) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000954) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000955) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000956) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000957) opened an unlinked file! 2023-11-19T01:14:33.049 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000958) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000959) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000960) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000961) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000962) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000963) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000964) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000965) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000966) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000967) opened an unlinked file! 2023-11-19T01:14:33.087 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000968) opened an unlinked file! 2023-11-19T01:14:33.088 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000969) opened an unlinked file! 2023-11-19T01:14:33.089 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000970) opened an unlinked file! 2023-11-19T01:14:33.089 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000971) opened an unlinked file! 2023-11-19T01:14:33.089 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000972) opened an unlinked file! 2023-11-19T01:14:33.089 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000973) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000974) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000975) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000976) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000977) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000978) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000979) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000980) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000981) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000982) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000983) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000984) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000985) opened an unlinked file! 2023-11-19T01:14:33.090 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000986) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000987) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000988) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000989) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000990) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000991) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000992) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000993) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000994) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000995) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000996) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000997) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000998) opened an unlinked file! 2023-11-19T01:14:33.091 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file000999) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001000) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001001) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001002) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001003) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001004) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001005) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001006) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001007) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001008) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001009) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001010) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001011) opened an unlinked file! 2023-11-19T01:14:33.092 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001012) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001013) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001014) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001015) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001016) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001017) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001018) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001019) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001020) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001021) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001022) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/426-dir/file001023) opened an unlinked file! 2023-11-19T01:14:33.093 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/426-dir 2023-11-19T01:14:33.094 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/426-dir -l 2023-11-19T01:14:33.094 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/426-dir -u 2023-11-19T01:14:33.094 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/426 2023-11-19T01:14:33.095 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/426 2023-11-19T01:14:33.095 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:14:33.095 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:33.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:14:33.230 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:14:33.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:14:33.230 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-11-19T01:14:35.813 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:35.821 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:35.821 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:36.016 INFO:teuthology.orchestra.run.smithi008.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:14:36.019 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/427 2023-11-19T01:14:36.019 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/427 2023-11-19T01:14:36.019 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:36.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:36.031 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-11-19T01:14:36.201 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:36.205 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:36.206 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:36.390 INFO:teuthology.orchestra.run.smithi008.stdout:generic/428 0s 2023-11-19T01:14:36.395 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/428 2023-11-19T01:14:36.395 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:36.398 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:36.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:36.406 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-11-19T01:14:36.590 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:36.594 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:36.594 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:36.732 INFO:teuthology.orchestra.run.smithi008.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:14:36.735 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/429 2023-11-19T01:14:36.735 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/429 2023-11-19T01:14:36.735 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:36.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:36.746 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-11-19T01:14:36.918 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:36.922 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:36.922 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:37.170 INFO:teuthology.orchestra.run.smithi008.stdout:generic/430 1s 2023-11-19T01:14:37.176 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/430 2023-11-19T01:14:37.176 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:37.178 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:37.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:37.187 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-11-19T01:14:37.637 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:37.641 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:37.641 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:37.877 INFO:teuthology.orchestra.run.smithi008.stdout:generic/431 0s 2023-11-19T01:14:37.882 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/431 2023-11-19T01:14:37.882 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:37.885 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:37.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:37.895 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-11-19T01:14:38.345 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:38.349 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:38.349 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:38.588 INFO:teuthology.orchestra.run.smithi008.stdout:generic/432 0s 2023-11-19T01:14:38.593 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/432 2023-11-19T01:14:38.593 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:38.596 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:38.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:38.605 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-11-19T01:14:39.069 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:39.074 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:39.074 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:39.285 INFO:teuthology.orchestra.run.smithi008.stdout:generic/433 0s 2023-11-19T01:14:39.291 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/433 2023-11-19T01:14:39.291 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:39.293 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:39.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:39.302 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-11-19T01:14:39.738 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:39.743 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:39.743 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:39.955 INFO:teuthology.orchestra.run.smithi008.stdout:generic/434 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/434.out.bad) 2023-11-19T01:14:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/434.out 2023-11-18 23:42:21.582425268 +0000 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/434.out.bad 2023-11-19 01:14:39.953559547 +0000 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -9,6 +9,6 @@ 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: copy_range: Bad file descriptor 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: Try to copy to a device 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: -copy_range: Invalid argument 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: +/tmp/tmp.hQpPz0d1gttest/test-434/dev1: Permission denied 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: Try to copy to a fifo 2023-11-19T01:14:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: copy_range: Invalid argument 2023-11-19T01:14:39.960 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/434 2023-11-19T01:14:39.960 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/434 2023-11-19T01:14:39.960 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:14:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:39.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:14:39.972 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:14:39.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:14:39.972 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-11-19T01:14:40.414 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:40.418 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:40.561 INFO:teuthology.orchestra.run.smithi008.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:14:40.565 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/435 2023-11-19T01:14:40.565 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/435 2023-11-19T01:14:40.565 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:40.567 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:40.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:40.576 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-11-19T01:14:40.748 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:40.752 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:40.752 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:41.581 INFO:teuthology.orchestra.run.smithi008.stdout:generic/436 1s 2023-11-19T01:14:41.587 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/436 2023-11-19T01:14:41.587 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:41.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:41.598 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-11-19T01:14:42.054 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:42.058 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:42.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:42.876 INFO:teuthology.orchestra.run.smithi008.stdout:generic/437 0s 2023-11-19T01:14:42.882 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/437 2023-11-19T01:14:42.882 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:14:42.885 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:14:42.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:14:42.893 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-11-19T01:14:43.069 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:14:43.072 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:14:43.072 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:03.208 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:15:03.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:15:34.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:15:34.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:15:44.717 INFO:teuthology.orchestra.run.smithi008.stdout:generic/438 61s 2023-11-19T01:15:44.722 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/438 2023-11-19T01:15:44.723 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:44.725 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:44.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:44.734 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-11-19T01:15:44.907 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:44.911 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:44.911 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:45.036 INFO:teuthology.orchestra.run.smithi008.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:45.040 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/439 2023-11-19T01:15:45.040 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/439 2023-11-19T01:15:45.040 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:45.042 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:45.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:45.051 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-11-19T01:15:45.223 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:45.227 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:45.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:45.366 INFO:teuthology.orchestra.run.smithi008.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:45.369 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/440 2023-11-19T01:15:45.369 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/440 2023-11-19T01:15:45.369 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:45.372 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:45.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:45.380 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-11-19T01:15:45.552 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:45.556 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:45.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:45.725 INFO:teuthology.orchestra.run.smithi008.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:45.729 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/441 2023-11-19T01:15:45.729 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/441 2023-11-19T01:15:45.729 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:45.731 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:45.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:45.740 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-11-19T01:15:45.915 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:45.919 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:46.051 INFO:teuthology.orchestra.run.smithi008.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:46.054 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/442 2023-11-19T01:15:46.055 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/442 2023-11-19T01:15:46.055 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:46.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:46.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:46.066 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-11-19T01:15:46.238 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:46.241 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:46.242 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:46.390 INFO:teuthology.orchestra.run.smithi008.stdout:generic/443 0s 2023-11-19T01:15:46.396 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/443 2023-11-19T01:15:46.396 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:46.398 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:46.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:46.407 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-11-19T01:15:46.583 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:46.586 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:46.737 INFO:teuthology.orchestra.run.smithi008.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-19T01:15:46.741 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/444 2023-11-19T01:15:46.741 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/444 2023-11-19T01:15:46.741 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:46.743 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:46.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:46.752 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-11-19T01:15:46.927 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:46.931 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:46.931 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:47.850 INFO:teuthology.orchestra.run.smithi008.stdout:generic/445 1s 2023-11-19T01:15:47.855 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/445 2023-11-19T01:15:47.855 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:47.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:47.867 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-11-19T01:15:48.339 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:48.343 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:48.343 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:48.453 INFO:teuthology.orchestra.run.smithi008.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:48.457 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/446 2023-11-19T01:15:48.457 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/446 2023-11-19T01:15:48.457 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:48.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:48.468 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-11-19T01:15:48.640 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:48.644 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:48.756 INFO:teuthology.orchestra.run.smithi008.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:48.760 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/447 2023-11-19T01:15:48.760 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/447 2023-11-19T01:15:48.760 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:48.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:48.773 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-11-19T01:15:48.947 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:48.951 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:49.917 INFO:teuthology.orchestra.run.smithi008.stdout:generic/448 1s 2023-11-19T01:15:49.924 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/448 2023-11-19T01:15:49.925 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:49.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:49.936 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-11-19T01:15:50.406 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:50.410 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:50.805 INFO:teuthology.orchestra.run.smithi008.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:50.809 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/449 2023-11-19T01:15:50.809 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/449 2023-11-19T01:15:50.809 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:50.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:50.834 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-11-19T01:15:51.008 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:51.012 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:51.012 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:52.281 INFO:teuthology.orchestra.run.smithi008.stdout:generic/450 1s 2023-11-19T01:15:52.287 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/450 2023-11-19T01:15:52.287 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:52.289 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:52.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:52.299 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-11-19T01:15:52.746 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:52.751 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:52.751 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:53.065 INFO:teuthology.orchestra.run.smithi008.stdout:generic/451 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/451.out.bad) 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/451.out 2023-11-18 23:42:21.583425258 +0000 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/451.out.bad 2023-11-19 01:15:53.061828446 +0000 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,2 +1,5 @@ 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 451 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: +get stale data from buffer read 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: +000a0000 2023-11-19T01:15:53.066 INFO:teuthology.orchestra.run.smithi008.stdout: Silence is golden 2023-11-19T01:15:53.068 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/451 2023-11-19T01:15:53.068 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/451 2023-11-19T01:15:53.068 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:15:53.070 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:53.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:15:53.096 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:15:53.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:15:53.096 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-11-19T01:15:53.552 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:53.557 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:53.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:53.667 INFO:teuthology.orchestra.run.smithi008.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:53.670 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/452 2023-11-19T01:15:53.670 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/452 2023-11-19T01:15:53.670 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:53.673 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:53.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:53.682 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-11-19T01:15:53.854 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:53.858 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:53.859 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:53.974 INFO:teuthology.orchestra.run.smithi008.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:53.978 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/453 2023-11-19T01:15:53.978 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/453 2023-11-19T01:15:53.978 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:53.980 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:53.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:53.989 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-11-19T01:15:54.160 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:54.165 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:54.165 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:54.273 INFO:teuthology.orchestra.run.smithi008.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:54.277 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/454 2023-11-19T01:15:54.277 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/454 2023-11-19T01:15:54.277 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:54.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:54.290 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-11-19T01:15:54.462 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:54.466 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:54.466 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:54.652 INFO:teuthology.orchestra.run.smithi008.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:54.657 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/455 2023-11-19T01:15:54.657 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/455 2023-11-19T01:15:54.657 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:54.658 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:54.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:54.668 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-11-19T01:15:54.841 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:54.845 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:54.978 INFO:teuthology.orchestra.run.smithi008.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:54.981 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/456 2023-11-19T01:15:54.981 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/456 2023-11-19T01:15:54.981 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:54.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:54.992 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-11-19T01:15:55.165 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:55.169 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:55.169 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:55.327 INFO:teuthology.orchestra.run.smithi008.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:55.331 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/457 2023-11-19T01:15:55.331 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/457 2023-11-19T01:15:55.331 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:55.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:55.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:55.342 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-11-19T01:15:55.515 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:55.519 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:55.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:55.628 INFO:teuthology.orchestra.run.smithi008.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/458 2023-11-19T01:15:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/458 2023-11-19T01:15:55.632 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:55.634 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:55.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:55.643 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-11-19T01:15:55.815 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:55.819 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:55.819 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:56.065 INFO:teuthology.orchestra.run.smithi008.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:56.069 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/459 2023-11-19T01:15:56.069 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/459 2023-11-19T01:15:56.069 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:56.071 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:56.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:56.096 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-11-19T01:15:56.270 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:56.274 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:56.274 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:56.383 INFO:teuthology.orchestra.run.smithi008.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:56.386 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/460 2023-11-19T01:15:56.387 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/460 2023-11-19T01:15:56.387 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:56.389 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:56.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:56.397 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-11-19T01:15:56.570 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:56.574 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:56.574 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:56.684 INFO:teuthology.orchestra.run.smithi008.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:56.688 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/461 2023-11-19T01:15:56.688 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/461 2023-11-19T01:15:56.688 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:56.690 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:56.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:56.699 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-11-19T01:15:56.870 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:56.874 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:56.875 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:56.987 INFO:teuthology.orchestra.run.smithi008.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:56.990 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/462 2023-11-19T01:15:56.990 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/462 2023-11-19T01:15:56.990 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:56.992 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:57.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:57.001 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-11-19T01:15:57.173 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:57.177 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:57.177 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:57.342 INFO:teuthology.orchestra.run.smithi008.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T01:15:57.345 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/463 2023-11-19T01:15:57.345 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/463 2023-11-19T01:15:57.346 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:57.348 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:57.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:57.356 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-11-19T01:15:57.807 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:57.811 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:57.811 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:57.921 INFO:teuthology.orchestra.run.smithi008.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:15:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/464 2023-11-19T01:15:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/464 2023-11-19T01:15:57.925 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:15:57.927 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:15:57.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:15:57.936 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-11-19T01:15:58.109 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:15:58.113 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:15:58.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:04.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:16:04.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:16:11.334 INFO:teuthology.orchestra.run.smithi008.stdout:generic/465 13s 2023-11-19T01:16:11.345 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/465 2023-11-19T01:16:11.345 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:16:11.348 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:11.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:16:11.367 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-11-19T01:16:11.768 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:16:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:16:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:11.881 INFO:teuthology.orchestra.run.smithi008.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:16:11.885 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/466 2023-11-19T01:16:11.885 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/466 2023-11-19T01:16:11.885 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:16:11.887 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:11.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:16:11.896 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-11-19T01:16:12.068 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:16:12.073 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:16:12.073 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:17.877 INFO:teuthology.orchestra.run.smithi008.stdout:generic/467 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/467.out.bad) 2023-11-19T01:16:17.895 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/467.out 2023-11-18 23:42:21.584425247 +0000 2023-11-19T01:16:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/467.out.bad 2023-11-19 01:16:17.852581548 +0000 2023-11-19T01:16:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,5 +1,15 @@ 2023-11-19T01:16:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 467 2023-11-19T01:16:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-11-19T01:16:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000000) opened an unlinked file! 2023-11-19T01:16:17.896 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000001) opened an unlinked file! 2023-11-19T01:16:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000002) opened an unlinked file! 2023-11-19T01:16:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000003) opened an unlinked file! 2023-11-19T01:16:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000004) opened an unlinked file! 2023-11-19T01:16:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000005) opened an unlinked file! 2023-11-19T01:16:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000006) opened an unlinked file! 2023-11-19T01:16:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000007) opened an unlinked file! 2023-11-19T01:16:17.897 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000008) opened an unlinked file! 2023-11-19T01:16:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: +open_by_handle(/tmp/tmp.hQpPz0d1gttest/467-dir/file000009) opened an unlinked file! 2023-11-19T01:16:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-11-19T01:16:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-11-19T01:16:17.898 INFO:teuthology.orchestra.run.smithi008.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-11-19T01:16:17.905 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/467 2023-11-19T01:16:17.906 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/467 2023-11-19T01:16:17.906 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:16:17.942 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:18.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:16:18.124 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:16:18.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:16:18.125 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-11-19T01:16:19.073 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:16:19.077 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:16:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:19.227 INFO:teuthology.orchestra.run.smithi008.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:16:19.230 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/468 2023-11-19T01:16:19.230 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/468 2023-11-19T01:16:19.231 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:16:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:19.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:16:19.243 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-11-19T01:16:19.425 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:16:19.429 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:16:19.429 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:21.040 INFO:teuthology.orchestra.run.smithi008.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-19T01:16:21.043 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/469 2023-11-19T01:16:21.043 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/469 2023-11-19T01:16:21.043 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:16:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:21.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:16:21.055 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-11-19T01:16:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:16:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:16:21.549 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:16:21.708 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/470 2023-11-19T01:16:21.708 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/470 2023-11-19T01:16:21.708 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:16:21.711 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:21.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:16:21.720 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-11-19T01:16:21.898 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:16:21.902 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:16:21.902 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:16:34.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:16:34.344 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:17:04.498 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:17:04.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:17:18.905 INFO:teuthology.orchestra.run.smithi008.stdout:generic/471 57s 2023-11-19T01:17:18.911 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/471 2023-11-19T01:17:18.911 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:18.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:18.923 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-11-19T01:17:19.395 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:19.399 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:19.399 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:19.524 INFO:teuthology.orchestra.run.smithi008.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:19.527 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/472 2023-11-19T01:17:19.527 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/472 2023-11-19T01:17:19.528 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:19.530 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:19.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:19.539 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-11-19T01:17:19.823 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:19.833 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:19.833 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:20.390 INFO:teuthology.orchestra.run.smithi008.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-19T01:17:20.397 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/473 2023-11-19T01:17:20.397 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/473 2023-11-19T01:17:20.397 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:20.399 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:20.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:20.421 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-11-19T01:17:20.688 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:20.692 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:20.692 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:20.802 INFO:teuthology.orchestra.run.smithi008.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:20.805 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/474 2023-11-19T01:17:20.805 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/474 2023-11-19T01:17:20.806 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:20.808 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:20.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:20.817 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-11-19T01:17:20.991 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:20.996 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:20.996 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:21.141 INFO:teuthology.orchestra.run.smithi008.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:21.145 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/475 2023-11-19T01:17:21.145 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/475 2023-11-19T01:17:21.145 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:21.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:21.156 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-11-19T01:17:21.329 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:21.333 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:21.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:21.445 INFO:teuthology.orchestra.run.smithi008.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:21.448 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/476 2023-11-19T01:17:21.448 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/476 2023-11-19T01:17:21.448 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:21.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:21.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:21.459 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-11-19T01:17:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:21.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:33.064 INFO:teuthology.orchestra.run.smithi008.stdout:generic/477 11s 2023-11-19T01:17:33.163 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/477 2023-11-19T01:17:33.163 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:33.169 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:33.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:33.240 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-11-19T01:17:34.191 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:34.195 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:34.195 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:34.857 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:17:34.859 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:17:34.965 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T01:17:34.964+0000 7f15bce65640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 472533) UID: 0 2023-11-19T01:17:34.966 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T01:17:34.964+0000 7fd4c2c2b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 472533) UID: 0 2023-11-19T01:17:44.183 INFO:teuthology.orchestra.run.smithi008.stdout:generic/478 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/478.out.bad) 2023-11-19T01:17:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/478.out 2023-11-18 23:42:21.585425237 +0000 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/478.out.bad 2023-11-19 01:17:44.163723282 +0000 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -10,7 +10,7 @@ 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: get wrlck 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: -lock could be placed 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: +get wrlck 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -25,7 +25,7 @@ 2023-11-19T01:17:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: get wrlck 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: -lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: +get wrlck 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -37,7 +37,7 @@ 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: get rdlck 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: get rdlck 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: -lock could be placed 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: +get rdlck 2023-11-19T01:17:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: get rdlck 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: get rdlck 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -46,7 +46,7 @@ 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: get rdlck 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: get rdlck 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: -lock could be placed 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: +get rdlck 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: lock could be placed 2023-11-19T01:17:44.189 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/478 2023-11-19T01:17:44.189 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/478 2023-11-19T01:17:44.189 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:17:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:44.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:17:44.199 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:17:44.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:17:44.200 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-11-19T01:17:44.376 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:44.380 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:44.380 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:44.632 INFO:teuthology.orchestra.run.smithi008.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:44.635 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/479 2023-11-19T01:17:44.636 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/479 2023-11-19T01:17:44.636 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:44.638 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:44.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:44.657 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-11-19T01:17:44.834 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:44.838 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:44.838 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:44.959 INFO:teuthology.orchestra.run.smithi008.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:44.963 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/480 2023-11-19T01:17:44.963 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/480 2023-11-19T01:17:44.963 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:44.966 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:44.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:44.975 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-11-19T01:17:45.154 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:45.158 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:45.158 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:45.287 INFO:teuthology.orchestra.run.smithi008.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:45.290 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/481 2023-11-19T01:17:45.290 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/481 2023-11-19T01:17:45.291 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:45.293 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:45.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:45.302 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-11-19T01:17:45.477 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:45.481 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:45.481 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:45.656 INFO:teuthology.orchestra.run.smithi008.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:45.660 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/482 2023-11-19T01:17:45.660 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/482 2023-11-19T01:17:45.660 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:45.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:45.672 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-11-19T01:17:45.848 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:45.852 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:45.986 INFO:teuthology.orchestra.run.smithi008.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:45.989 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/483 2023-11-19T01:17:45.990 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/483 2023-11-19T01:17:45.990 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:46.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:46.001 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-11-19T01:17:46.177 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:46.181 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:46.181 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:46.332 INFO:teuthology.orchestra.run.smithi008.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:46.335 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/484 2023-11-19T01:17:46.335 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/484 2023-11-19T01:17:46.335 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:46.338 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:46.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:46.347 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-11-19T01:17:46.522 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:46.526 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:47.421 INFO:teuthology.orchestra.run.smithi008.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-19T01:17:47.424 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/485 2023-11-19T01:17:47.424 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/485 2023-11-19T01:17:47.425 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:47.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:47.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:47.436 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-11-19T01:17:47.968 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:47.972 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:47.973 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:48.164 INFO:teuthology.orchestra.run.smithi008.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:48.168 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/486 2023-11-19T01:17:48.168 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/486 2023-11-19T01:17:48.168 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:48.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:48.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:48.180 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-11-19T01:17:48.360 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:48.364 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:48.364 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:48.499 INFO:teuthology.orchestra.run.smithi008.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:48.503 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/487 2023-11-19T01:17:48.503 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/487 2023-11-19T01:17:48.503 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:48.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:48.514 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-11-19T01:17:48.690 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:48.694 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:48.804 INFO:teuthology.orchestra.run.smithi008.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:48.808 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/488 2023-11-19T01:17:48.808 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/488 2023-11-19T01:17:48.808 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:48.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:48.820 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-11-19T01:17:48.995 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:48.998 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:49.123 INFO:teuthology.orchestra.run.smithi008.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:49.127 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/489 2023-11-19T01:17:49.127 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/489 2023-11-19T01:17:49.127 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:49.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:49.138 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-11-19T01:17:49.314 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:49.318 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:50.403 INFO:teuthology.orchestra.run.smithi008.stdout:generic/490 1s 2023-11-19T01:17:50.408 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/490 2023-11-19T01:17:50.409 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:50.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:50.421 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-11-19T01:17:50.953 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:50.958 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:50.959 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:51.099 INFO:teuthology.orchestra.run.smithi008.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:51.103 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/491 2023-11-19T01:17:51.103 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/491 2023-11-19T01:17:51.103 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:51.105 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:51.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:51.114 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-11-19T01:17:51.290 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:51.294 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:51.294 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:51.408 INFO:teuthology.orchestra.run.smithi008.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:51.412 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/492 2023-11-19T01:17:51.412 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/492 2023-11-19T01:17:51.412 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:51.414 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:51.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:51.423 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-11-19T01:17:51.597 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:51.601 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:51.601 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:51.714 INFO:teuthology.orchestra.run.smithi008.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:51.718 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/493 2023-11-19T01:17:51.718 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/493 2023-11-19T01:17:51.718 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:51.720 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:51.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:51.737 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-11-19T01:17:51.913 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:51.917 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:51.917 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.027 INFO:teuthology.orchestra.run.smithi008.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:52.031 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/494 2023-11-19T01:17:52.031 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/494 2023-11-19T01:17:52.031 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:52.042 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-11-19T01:17:52.217 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:52.221 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:52.221 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.333 INFO:teuthology.orchestra.run.smithi008.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:52.336 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/495 2023-11-19T01:17:52.337 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/495 2023-11-19T01:17:52.337 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:52.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:52.348 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-11-19T01:17:52.525 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:52.529 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:52.529 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.661 INFO:teuthology.orchestra.run.smithi008.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:52.665 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/496 2023-11-19T01:17:52.665 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/496 2023-11-19T01:17:52.665 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:52.667 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:52.676 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-11-19T01:17:52.854 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:52.859 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:52.859 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.975 INFO:teuthology.orchestra.run.smithi008.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:52.979 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/497 2023-11-19T01:17:52.979 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/497 2023-11-19T01:17:52.979 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:52.981 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:52.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:52.991 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-11-19T01:17:53.169 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:53.173 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:53.173 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:53.302 INFO:teuthology.orchestra.run.smithi008.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:53.306 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/498 2023-11-19T01:17:53.306 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/498 2023-11-19T01:17:53.306 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:53.308 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:53.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:53.325 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-11-19T01:17:53.501 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:53.505 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:53.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:53.618 INFO:teuthology.orchestra.run.smithi008.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:53.621 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/499 2023-11-19T01:17:53.621 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/499 2023-11-19T01:17:53.621 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:53.624 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:53.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:53.633 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-11-19T01:17:53.806 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:53.810 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:53.810 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:53.955 INFO:teuthology.orchestra.run.smithi008.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:53.958 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/500 2023-11-19T01:17:53.958 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/500 2023-11-19T01:17:53.959 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:53.961 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:53.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:53.971 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-11-19T01:17:54.145 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:54.150 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:54.150 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:54.277 INFO:teuthology.orchestra.run.smithi008.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:54.281 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/501 2023-11-19T01:17:54.281 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/501 2023-11-19T01:17:54.281 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:54.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:54.299 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-11-19T01:17:54.481 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:54.485 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:54.607 INFO:teuthology.orchestra.run.smithi008.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:54.610 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/502 2023-11-19T01:17:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/502 2023-11-19T01:17:54.611 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:54.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:54.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:54.622 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-11-19T01:17:54.797 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:54.801 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:54.801 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:54.917 INFO:teuthology.orchestra.run.smithi008.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:54.920 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/503 2023-11-19T01:17:54.920 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/503 2023-11-19T01:17:54.920 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:54.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:54.932 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-11-19T01:17:55.107 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:55.111 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:55.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:55.279 INFO:teuthology.orchestra.run.smithi008.stdout:generic/504 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/504.out.bad) 2023-11-19T01:17:55.281 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/504.out 2023-11-18 23:42:21.587425216 +0000 2023-11-19T01:17:55.281 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/504.out.bad 2023-11-19 01:17:55.277613122 +0000 2023-11-19T01:17:55.282 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,2 +1,3 @@ 2023-11-19T01:17:55.282 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 504 2023-11-19T01:17:55.282 INFO:teuthology.orchestra.run.smithi008.stdout: +lock info not found 2023-11-19T01:17:55.282 INFO:teuthology.orchestra.run.smithi008.stdout: Silence is golden 2023-11-19T01:17:55.284 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/504 2023-11-19T01:17:55.284 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/504 2023-11-19T01:17:55.284 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T01:17:55.286 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:55.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T01:17:55.296 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T01:17:55.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T01:17:55.296 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-11-19T01:17:55.470 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:55.474 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:55.474 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:55.592 INFO:teuthology.orchestra.run.smithi008.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/505 2023-11-19T01:17:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/505 2023-11-19T01:17:55.596 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:55.598 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:55.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:55.607 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-11-19T01:17:55.782 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:55.786 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:55.786 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:55.902 INFO:teuthology.orchestra.run.smithi008.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:55.906 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/506 2023-11-19T01:17:55.906 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/506 2023-11-19T01:17:55.906 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:55.908 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:55.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:55.918 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-11-19T01:17:56.095 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:56.099 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:56.100 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:56.280 INFO:teuthology.orchestra.run.smithi008.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-19T01:17:56.284 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/507 2023-11-19T01:17:56.284 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/507 2023-11-19T01:17:56.284 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:56.286 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:56.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:56.306 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-11-19T01:17:56.483 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:56.487 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:56.487 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:56.604 INFO:teuthology.orchestra.run.smithi008.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-11-19T01:17:56.607 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/508 2023-11-19T01:17:56.608 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/508 2023-11-19T01:17:56.608 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:56.610 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:56.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:56.620 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-11-19T01:17:56.793 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:56.797 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:56.917 INFO:teuthology.orchestra.run.smithi008.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:56.921 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/509 2023-11-19T01:17:56.921 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/509 2023-11-19T01:17:56.921 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:56.923 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:56.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:56.932 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-11-19T01:17:57.110 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:57.113 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:57.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:57.239 INFO:teuthology.orchestra.run.smithi008.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:57.243 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/510 2023-11-19T01:17:57.243 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/510 2023-11-19T01:17:57.243 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:57.245 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:57.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:57.254 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-11-19T01:17:57.433 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:57.435 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:57.435 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:57.549 INFO:teuthology.orchestra.run.smithi008.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:57.552 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/511 2023-11-19T01:17:57.552 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/511 2023-11-19T01:17:57.552 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:57.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:57.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:57.563 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-11-19T01:17:57.740 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:57.743 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:57.744 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:57.865 INFO:teuthology.orchestra.run.smithi008.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:57.868 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/512 2023-11-19T01:17:57.868 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/512 2023-11-19T01:17:57.869 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:57.871 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:57.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:57.891 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-11-19T01:17:58.068 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:58.072 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:58.072 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:58.190 INFO:teuthology.orchestra.run.smithi008.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:58.193 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/513 2023-11-19T01:17:58.194 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/513 2023-11-19T01:17:58.194 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:58.196 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:58.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:58.206 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-11-19T01:17:58.384 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:58.388 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:58.388 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:58.506 INFO:teuthology.orchestra.run.smithi008.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:58.510 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/514 2023-11-19T01:17:58.510 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/514 2023-11-19T01:17:58.510 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:58.512 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:58.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:58.521 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-11-19T01:17:58.698 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:58.702 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:58.702 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:58.817 INFO:teuthology.orchestra.run.smithi008.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:58.820 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/515 2023-11-19T01:17:58.820 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/515 2023-11-19T01:17:58.820 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:58.822 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:58.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:58.831 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-11-19T01:17:59.004 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:59.008 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:59.009 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:59.171 INFO:teuthology.orchestra.run.smithi008.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-19T01:17:59.175 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/516 2023-11-19T01:17:59.175 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/516 2023-11-19T01:17:59.175 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:59.177 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:59.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:59.187 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-11-19T01:17:59.672 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:59.679 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:59.679 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:59.799 INFO:teuthology.orchestra.run.smithi008.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:17:59.802 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/517 2023-11-19T01:17:59.802 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/517 2023-11-19T01:17:59.803 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:17:59.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:17:59.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:17:59.814 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-11-19T01:17:59.992 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:17:59.996 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:17:59.996 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:18:00.111 INFO:teuthology.orchestra.run.smithi008.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:18:00.114 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/518 2023-11-19T01:18:00.115 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/518 2023-11-19T01:18:00.115 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:18:00.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:18:00.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:18:00.126 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-11-19T01:18:00.302 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:18:00.306 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:18:00.306 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:18:00.418 INFO:teuthology.orchestra.run.smithi008.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:18:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/519 2023-11-19T01:18:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/519 2023-11-19T01:18:00.421 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:18:00.423 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:18:00.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:18:00.440 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-11-19T01:18:00.619 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:18:00.623 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:18:00.623 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:18:00.744 INFO:teuthology.orchestra.run.smithi008.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T01:18:00.747 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/520 2023-11-19T01:18:00.747 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/520 2023-11-19T01:18:00.747 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T01:18:00.749 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:18:00.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T01:18:00.758 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-11-19T01:18:00.934 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T01:18:00.938 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T01:18:00.938 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T01:20:20.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:20:20.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:20:50.475 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:20:50.477 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:21:20.565 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:21:20.567 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:21:50.628 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:21:50.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:22:20.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:22:20.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:22:50.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:22:50.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:23:20.902 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:23:20.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:23:50.976 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:23:50.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:24:21.065 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:24:21.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:24:51.237 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:24:51.240 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:25:21.295 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:25:21.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:25:51.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:25:51.444 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:26:21.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:26:21.504 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:26:51.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:26:51.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:27:21.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:27:21.694 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:27:51.773 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:27:51.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:28:21.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:28:21.839 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:28:51.976 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:28:51.978 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:29:22.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:29:22.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:29:52.129 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:29:52.132 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:30:22.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:30:22.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:30:52.595 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:30:52.598 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:31:22.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:31:22.649 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:31:52.769 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:31:52.771 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:32:22.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:32:22.833 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:32:52.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:32:52.933 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:33:23.119 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:33:23.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:33:53.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:33:53.204 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:34:23.289 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:34:23.292 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:34:53.620 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:34:53.623 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:35:23.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:35:23.683 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:35:23.713 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T01:35:23.712+0000 7f3d1e6f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98111) UID: 0 2023-11-19T01:35:23.713 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T01:35:23.712+0000 7fbb189dc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98111) UID: 0 2023-11-19T01:35:23.714 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T01:35:23.712+0000 7f2ef6b14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98111) UID: 0 2023-11-19T01:35:23.714 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T01:35:23.712+0000 7ffb9bc76640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98111) UID: 0 2023-11-19T01:37:51.418 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:37:51.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:38:21.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:38:21.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:38:51.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:38:51.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:39:21.986 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:39:21.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:39:52.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:39:52.399 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:40:22.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:40:22.459 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:40:52.778 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:40:52.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:41:22.834 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:41:22.837 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:41:52.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:41:52.926 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:42:23.020 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:42:23.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:42:53.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:42:53.089 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:43:23.143 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:43:23.147 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:43:53.287 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:43:53.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:44:23.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:44:23.351 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:44:53.465 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:44:53.468 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:45:23.530 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:45:23.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:45:53.618 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:45:53.621 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:46:23.867 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:46:23.870 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:46:54.164 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:46:54.167 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:47:24.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:47:24.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:47:54.488 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:47:54.491 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:48:24.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:48:24.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:48:54.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:48:54.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:49:24.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:49:24.829 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:49:54.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:49:54.892 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:50:24.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:50:24.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:50:55.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:50:55.006 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:51:25.081 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:51:25.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:51:25.114 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T01:51:25.113+0000 7f3d1e6f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98631) UID: 0 2023-11-19T01:51:25.114 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T01:51:25.113+0000 7fbb189dc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98631) UID: 0 2023-11-19T01:51:25.115 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T01:51:25.113+0000 7ffb9bc76640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98631) UID: 0 2023-11-19T01:51:25.115 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T01:51:25.113+0000 7f2ef6b14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98631) UID: 0 2023-11-19T01:53:39.847 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:53:39.850 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:54:10.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:54:10.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:54:40.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:54:40.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:55:10.222 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:55:10.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:55:40.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:55:40.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:56:10.584 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:56:10.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:56:40.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:56:40.683 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:57:10.978 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:57:10.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:57:41.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:57:41.045 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:58:11.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:58:11.142 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:58:41.212 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:58:41.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:59:11.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:59:11.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:59:41.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T01:59:41.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:00:11.516 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:00:11.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:00:11.556 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T02:00:11.554+0000 7f6271cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493224) UID: 0 2023-11-19T02:00:11.556 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T02:00:11.554+0000 7f9762870640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493224) UID: 0 2023-11-19T02:00:11.557 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T02:00:11.554+0000 7feb11d51640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493224) UID: 0 2023-11-19T02:00:11.557 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T02:00:11.554+0000 7f9dbd7e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493224) UID: 0 2023-11-19T02:02:50.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:02:50.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:03:20.740 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:03:20.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:03:50.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:03:50.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:04:20.878 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:04:20.881 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:04:24.342 INFO:teuthology.orchestra.run.smithi008.stdout:generic/521 2784s 2023-11-19T02:04:24.408 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/521 2023-11-19T02:04:24.408 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:04:24.416 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:04:24.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:04:24.460 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-11-19T02:04:24.916 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:04:24.920 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:04:24.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:04:50.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:04:50.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:05:21.007 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:05:21.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:05:51.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:05:51.089 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:06:21.291 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:06:21.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:06:51.473 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:06:51.476 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:07:21.530 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:07:21.532 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:07:51.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:07:51.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:08:21.766 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:08:21.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:08:51.834 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:08:51.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:09:21.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:09:21.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:09:52.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:09:52.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:10:22.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:10:22.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:10:52.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:10:52.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:11:22.405 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:11:22.408 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:11:52.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:11:52.518 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:12:22.629 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:12:22.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:12:52.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:12:52.697 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:13:22.818 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:13:22.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:13:52.887 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:13:52.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:14:22.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:14:22.951 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:14:53.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:14:53.052 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:15:23.113 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:15:23.116 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:15:53.244 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:15:53.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:16:23.358 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:16:23.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:16:53.714 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:16:53.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:17:23.778 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:17:23.780 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:17:54.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:17:54.103 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:18:24.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:18:24.166 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:18:54.269 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:18:54.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:19:24.400 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:19:24.402 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:19:54.475 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:19:54.477 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:20:24.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:20:24.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:20:24.616 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T02:20:24.615+0000 7f15bce65640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 494371) UID: 0 2023-11-19T02:20:24.617 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T02:20:24.615+0000 7fd4c2c2b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 494371) UID: 0 2023-11-19T02:22:59.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:22:59.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:23:29.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:23:29.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:23:59.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:23:59.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:24:30.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:24:30.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:25:00.062 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:25:00.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:25:30.182 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:25:30.185 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:26:00.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:26:00.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:26:30.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:26:30.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:27:00.666 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:27:00.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:27:30.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:27:30.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:28:00.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:28:00.881 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:28:31.128 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:28:31.130 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:29:01.184 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:29:01.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:29:31.245 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:29:31.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:30:01.367 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:30:01.370 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:30:01.400 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T02:30:01.398+0000 7f3d1e6f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99845) UID: 0 2023-11-19T02:30:01.400 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T02:30:01.398+0000 7fbb189dc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99845) UID: 0 2023-11-19T02:30:01.400 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T02:30:01.398+0000 7ffb9bc76640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99845) UID: 0 2023-11-19T02:30:01.401 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T02:30:01.398+0000 7f2ef6b14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99845) UID: 0 2023-11-19T02:32:16.908 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:32:16.911 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:32:46.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:32:46.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:33:17.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:33:17.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:33:47.132 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:33:47.134 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:34:17.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:34:17.191 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:34:47.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:34:47.280 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:35:17.374 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:35:17.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:35:47.430 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:35:47.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:36:17.535 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:36:17.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:36:20.895 INFO:teuthology.orchestra.run.smithi008.stdout:generic/522 1916s 2023-11-19T02:36:20.901 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/522 2023-11-19T02:36:20.901 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:20.903 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:20.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:20.912 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-11-19T02:36:21.088 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:21.092 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:21.212 INFO:teuthology.orchestra.run.smithi008.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:21.215 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/523 2023-11-19T02:36:21.215 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/523 2023-11-19T02:36:21.216 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:21.218 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:21.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:21.227 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-11-19T02:36:21.400 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:21.404 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:21.404 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:21.513 INFO:teuthology.orchestra.run.smithi008.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:21.517 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/524 2023-11-19T02:36:21.517 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/524 2023-11-19T02:36:21.517 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:21.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:21.528 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-11-19T02:36:21.701 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:21.705 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:21.815 INFO:teuthology.orchestra.run.smithi008.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:21.818 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/525 2023-11-19T02:36:21.819 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/525 2023-11-19T02:36:21.819 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:21.821 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:21.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:21.830 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-11-19T02:36:22.005 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:22.009 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:22.009 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:22.155 INFO:teuthology.orchestra.run.smithi008.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:22.159 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/526 2023-11-19T02:36:22.159 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/526 2023-11-19T02:36:22.159 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:22.162 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:22.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:22.171 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-11-19T02:36:22.343 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:22.347 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:22.347 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:22.466 INFO:teuthology.orchestra.run.smithi008.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:22.469 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/527 2023-11-19T02:36:22.470 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/527 2023-11-19T02:36:22.470 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:22.472 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:22.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:22.481 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-11-19T02:36:22.654 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:22.658 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:22.658 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:22.796 INFO:teuthology.orchestra.run.smithi008.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-11-19T02:36:22.800 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/528 2023-11-19T02:36:22.800 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/528 2023-11-19T02:36:22.800 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:22.802 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:22.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:22.811 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-11-19T02:36:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:22.988 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:23.131 INFO:teuthology.orchestra.run.smithi008.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-19T02:36:23.135 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/529 2023-11-19T02:36:23.135 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/529 2023-11-19T02:36:23.135 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:23.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:23.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:23.146 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-11-19T02:36:23.320 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:23.324 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:23.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:23.435 INFO:teuthology.orchestra.run.smithi008.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:23.439 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/530 2023-11-19T02:36:23.439 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/530 2023-11-19T02:36:23.439 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:23.441 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:23.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:23.450 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-11-19T02:36:23.625 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:23.628 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:23.737 INFO:teuthology.orchestra.run.smithi008.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:23.741 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/531 2023-11-19T02:36:23.741 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/531 2023-11-19T02:36:23.741 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:23.743 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:23.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:23.752 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-11-19T02:36:23.927 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:23.932 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:23.932 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:24.088 INFO:teuthology.orchestra.run.smithi008.stdout:generic/532 1s 2023-11-19T02:36:24.094 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/532 2023-11-19T02:36:24.094 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:24.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:24.105 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-11-19T02:36:24.279 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:24.283 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:24.283 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout:generic/533 0s 2023-11-19T02:36:24.679 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/533 2023-11-19T02:36:24.680 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:24.681 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:24.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:24.690 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-11-19T02:36:24.863 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:24.867 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:24.867 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:24.991 INFO:teuthology.orchestra.run.smithi008.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:24.995 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/534 2023-11-19T02:36:24.995 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/534 2023-11-19T02:36:24.995 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:24.997 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:25.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:25.006 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-11-19T02:36:25.178 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:25.182 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:25.182 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:25.306 INFO:teuthology.orchestra.run.smithi008.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:25.309 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/535 2023-11-19T02:36:25.310 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/535 2023-11-19T02:36:25.310 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:25.312 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:25.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:25.321 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-11-19T02:36:25.495 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:25.499 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:25.607 INFO:teuthology.orchestra.run.smithi008.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:25.611 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/536 2023-11-19T02:36:25.611 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/536 2023-11-19T02:36:25.611 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:25.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:25.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:25.621 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-11-19T02:36:25.794 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:25.798 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:25.798 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:25.906 INFO:teuthology.orchestra.run.smithi008.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T02:36:25.910 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/537 2023-11-19T02:36:25.910 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/537 2023-11-19T02:36:25.910 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T02:36:25.912 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:25.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T02:36:25.921 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-11-19T02:36:26.094 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T02:36:26.098 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T02:36:26.098 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T02:36:47.800 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:36:47.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:37:17.872 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:37:17.875 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:37:47.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:37:47.964 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:38:18.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:38:18.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:38:48.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:38:48.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:39:18.304 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:39:18.306 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:39:48.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:39:48.395 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:40:18.497 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:40:18.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:40:48.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:40:48.624 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:41:18.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:41:18.697 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:41:48.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:41:48.818 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:42:19.071 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:42:19.074 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:42:19.112 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T02:42:19.110+0000 7f6271cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 503046) UID: 0 2023-11-19T02:42:19.113 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T02:42:19.110+0000 7f9762870640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 503046) UID: 0 2023-11-19T02:42:19.113 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T02:42:19.110+0000 7f9dbd7e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 503046) UID: 0 2023-11-19T02:42:19.113 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T02:42:19.110+0000 7feb11d51640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 503046) UID: 0 2023-11-19T02:44:52.914 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:44:52.917 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:45:23.192 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:45:23.195 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:45:53.307 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:45:53.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:46:23.415 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:46:23.418 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:46:53.470 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:46:53.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:47:23.550 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:47:23.552 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:47:53.697 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:47:53.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:48:23.780 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:48:23.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:48:53.844 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:48:53.846 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:49:23.975 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:49:23.977 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:49:54.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:49:54.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:50:24.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:50:24.280 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:50:54.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:50:54.345 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:51:24.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:51:24.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:51:54.628 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:51:54.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:52:24.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:52:24.736 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:52:54.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:52:54.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:53:24.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:53:24.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:53:55.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:53:55.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:54:25.092 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:54:25.094 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:54:55.246 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:54:55.248 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:55:25.305 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:55:25.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:55:55.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:55:55.384 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:56:25.530 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:56:25.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:56:55.618 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:56:55.621 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:57:25.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:57:25.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:57:55.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:57:55.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:58:25.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:58:25.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:58:56.032 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:58:56.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:59:26.119 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:59:26.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:59:56.193 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T02:59:56.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:00:26.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:00:26.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:00:56.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:00:56.460 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:00:56.494 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T03:00:56.492+0000 7f6271cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506683) UID: 0 2023-11-19T03:00:56.495 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T03:00:56.492+0000 7f9762870640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506683) UID: 0 2023-11-19T03:00:56.495 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T03:00:56.492+0000 7feb11d51640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506683) UID: 0 2023-11-19T03:00:56.495 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T03:00:56.492+0000 7f9dbd7e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506683) UID: 0 2023-11-19T03:03:20.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:03:20.793 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:03:50.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:03:50.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:04:20.984 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:04:20.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:04:51.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:04:51.276 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:05:21.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:05:21.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:05:51.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:05:51.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:06:21.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:06:21.602 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:06:51.654 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:06:51.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:07:22.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:07:22.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:07:52.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:07:52.060 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:08:22.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:08:22.124 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:08:52.270 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:08:52.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:09:22.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:09:22.479 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:09:52.538 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:09:52.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:10:22.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:10:22.689 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:10:52.867 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:10:52.870 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:11:22.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:11:22.933 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:11:53.062 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:11:53.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:12:23.127 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:12:23.130 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:12:53.240 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:12:53.242 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:13:23.353 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:13:23.357 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:13:53.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:13:53.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:14:20.478 INFO:teuthology.orchestra.run.smithi008.stdout:generic/538 2274s 2023-11-19T03:14:20.528 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/538 2023-11-19T03:14:20.528 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:20.544 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:20.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:20.573 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-11-19T03:14:21.075 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:21.080 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:22.863 INFO:teuthology.orchestra.run.smithi008.stdout:generic/539 1s 2023-11-19T03:14:22.868 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/539 2023-11-19T03:14:22.868 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:22.871 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:22.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:22.880 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-11-19T03:14:23.346 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:23.350 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:23.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:23.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:14:23.592 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:14:23.595 INFO:teuthology.orchestra.run.smithi008.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:23.598 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/540 2023-11-19T03:14:23.598 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/540 2023-11-19T03:14:23.598 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:23.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:23.611 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-11-19T03:14:23.860 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:23.864 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:23.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:23.974 INFO:teuthology.orchestra.run.smithi008.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:23.977 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/541 2023-11-19T03:14:23.977 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/541 2023-11-19T03:14:23.977 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:23.980 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:23.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:23.989 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-11-19T03:14:24.163 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:24.167 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:24.278 INFO:teuthology.orchestra.run.smithi008.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:24.281 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/542 2023-11-19T03:14:24.281 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/542 2023-11-19T03:14:24.281 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:24.284 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:24.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:24.292 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-11-19T03:14:24.466 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:24.470 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:24.470 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:24.580 INFO:teuthology.orchestra.run.smithi008.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:24.584 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/543 2023-11-19T03:14:24.584 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/543 2023-11-19T03:14:24.584 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:24.586 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:24.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:24.595 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-11-19T03:14:24.767 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:24.772 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:24.883 INFO:teuthology.orchestra.run.smithi008.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:24.886 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/544 2023-11-19T03:14:24.886 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/544 2023-11-19T03:14:24.886 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:24.889 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:24.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:24.898 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-11-19T03:14:25.071 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:25.075 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:25.075 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:25.259 INFO:teuthology.orchestra.run.smithi008.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-11-19T03:14:25.263 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/545 2023-11-19T03:14:25.263 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/545 2023-11-19T03:14:25.263 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:25.265 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:25.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:25.274 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-11-19T03:14:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:25.451 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:25.642 INFO:teuthology.orchestra.run.smithi008.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:25.645 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/546 2023-11-19T03:14:25.646 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/546 2023-11-19T03:14:25.646 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:25.648 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:25.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:25.657 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-11-19T03:14:25.829 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:25.833 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:25.833 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:25.973 INFO:teuthology.orchestra.run.smithi008.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:25.977 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/547 2023-11-19T03:14:25.977 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/547 2023-11-19T03:14:25.977 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:25.979 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:25.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:25.988 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-11-19T03:14:26.161 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:26.165 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:26.165 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:26.312 INFO:teuthology.orchestra.run.smithi008.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:26.315 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/548 2023-11-19T03:14:26.315 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/548 2023-11-19T03:14:26.315 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:26.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:26.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:26.327 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-11-19T03:14:26.499 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:26.503 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:26.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:26.640 INFO:teuthology.orchestra.run.smithi008.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:26.643 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/549 2023-11-19T03:14:26.644 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/549 2023-11-19T03:14:26.644 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:26.646 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:26.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:26.668 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-11-19T03:14:26.843 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:26.846 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:26.847 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:26.985 INFO:teuthology.orchestra.run.smithi008.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:26.988 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/550 2023-11-19T03:14:26.988 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/550 2023-11-19T03:14:26.988 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:26.990 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:26.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:26.999 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-11-19T03:14:27.172 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:27.176 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:27.176 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:27.290 INFO:teuthology.orchestra.run.smithi008.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:27.294 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/551 2023-11-19T03:14:27.294 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/551 2023-11-19T03:14:27.294 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:27.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:27.305 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-11-19T03:14:27.479 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:27.484 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:27.484 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:27.602 INFO:teuthology.orchestra.run.smithi008.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:27.606 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/552 2023-11-19T03:14:27.606 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/552 2023-11-19T03:14:27.606 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:27.608 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:27.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:27.617 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-11-19T03:14:27.790 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:27.794 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:27.794 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:27.969 INFO:teuthology.orchestra.run.smithi008.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-11-19T03:14:27.972 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/553 2023-11-19T03:14:27.972 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/553 2023-11-19T03:14:27.973 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:27.975 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:27.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:27.984 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-11-19T03:14:28.460 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:28.464 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:28.571 INFO:teuthology.orchestra.run.smithi008.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:28.575 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/554 2023-11-19T03:14:28.575 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/554 2023-11-19T03:14:28.575 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:28.577 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:28.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:28.587 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-11-19T03:14:28.763 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:28.767 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:28.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:28.961 INFO:teuthology.orchestra.run.smithi008.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-11-19T03:14:28.964 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/555 2023-11-19T03:14:28.964 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/555 2023-11-19T03:14:28.965 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:28.967 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:28.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:28.975 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-11-19T03:14:29.441 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:29.445 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:29.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:29.567 INFO:teuthology.orchestra.run.smithi008.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:29.571 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/556 2023-11-19T03:14:29.571 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/556 2023-11-19T03:14:29.571 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:29.573 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:29.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:29.582 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-11-19T03:14:29.756 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:29.760 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:29.760 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:29.880 INFO:teuthology.orchestra.run.smithi008.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:29.884 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/557 2023-11-19T03:14:29.884 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/557 2023-11-19T03:14:29.884 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:29.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:29.895 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-11-19T03:14:30.069 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:30.073 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:30.073 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:30.203 INFO:teuthology.orchestra.run.smithi008.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:30.207 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/558 2023-11-19T03:14:30.207 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/558 2023-11-19T03:14:30.207 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:30.209 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:30.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:30.231 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-11-19T03:14:30.405 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:30.409 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:30.410 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:30.519 INFO:teuthology.orchestra.run.smithi008.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:30.523 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/559 2023-11-19T03:14:30.523 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/559 2023-11-19T03:14:30.524 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:30.525 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:30.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:30.534 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-11-19T03:14:30.707 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:30.711 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:30.711 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:30.821 INFO:teuthology.orchestra.run.smithi008.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:30.824 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/560 2023-11-19T03:14:30.824 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/560 2023-11-19T03:14:30.825 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:30.827 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:30.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:30.836 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-11-19T03:14:31.010 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:31.014 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:31.014 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:31.124 INFO:teuthology.orchestra.run.smithi008.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:31.128 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/561 2023-11-19T03:14:31.128 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/561 2023-11-19T03:14:31.128 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:31.130 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:31.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:31.140 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-11-19T03:14:31.316 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:31.320 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:31.320 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:31.430 INFO:teuthology.orchestra.run.smithi008.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:31.434 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/562 2023-11-19T03:14:31.434 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/562 2023-11-19T03:14:31.434 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:31.436 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:31.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:31.445 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-11-19T03:14:31.617 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:31.621 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:31.621 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:31.784 INFO:teuthology.orchestra.run.smithi008.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:31.787 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/563 2023-11-19T03:14:31.787 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/563 2023-11-19T03:14:31.788 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:31.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:31.799 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-11-19T03:14:31.972 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:31.977 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:31.977 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:32.371 INFO:teuthology.orchestra.run.smithi008.stdout:generic/564 1s 2023-11-19T03:14:32.376 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/564 2023-11-19T03:14:32.377 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:32.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:32.389 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-11-19T03:14:32.854 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:32.858 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:32.992 INFO:teuthology.orchestra.run.smithi008.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:32.996 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/565 2023-11-19T03:14:32.996 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/565 2023-11-19T03:14:32.996 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:33.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:33.007 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-11-19T03:14:33.181 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:33.185 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:33.185 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:33.295 INFO:teuthology.orchestra.run.smithi008.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:33.298 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/566 2023-11-19T03:14:33.299 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/566 2023-11-19T03:14:33.299 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:33.301 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:33.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:33.322 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-11-19T03:14:33.497 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:33.501 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:33.501 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:33.615 INFO:teuthology.orchestra.run.smithi008.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:33.619 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/567 2023-11-19T03:14:33.620 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/567 2023-11-19T03:14:33.620 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:33.621 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:33.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:33.630 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-11-19T03:14:33.803 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:33.807 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:34.018 INFO:teuthology.orchestra.run.smithi008.stdout:generic/568 0s 2023-11-19T03:14:34.030 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/568 2023-11-19T03:14:34.030 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:34.034 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:34.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:34.047 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-11-19T03:14:34.458 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:34.462 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:34.608 INFO:teuthology.orchestra.run.smithi008.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:34.611 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/569 2023-11-19T03:14:34.611 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/569 2023-11-19T03:14:34.612 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:34.614 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:34.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:34.623 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-11-19T03:14:34.797 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:34.801 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:34.801 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:34.911 INFO:teuthology.orchestra.run.smithi008.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:34.914 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/570 2023-11-19T03:14:34.915 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/570 2023-11-19T03:14:34.915 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:34.917 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:34.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:34.926 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-11-19T03:14:35.099 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:35.103 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:35.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:41.354 INFO:teuthology.orchestra.run.smithi008.stdout:generic/571 6s 2023-11-19T03:14:41.360 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/571 2023-11-19T03:14:41.360 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:41.363 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:41.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:41.373 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-11-19T03:14:41.830 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:41.835 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:41.835 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:41.951 INFO:teuthology.orchestra.run.smithi008.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:41.954 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/572 2023-11-19T03:14:41.955 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/572 2023-11-19T03:14:41.955 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:41.957 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:41.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:41.966 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-11-19T03:14:42.138 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:42.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:42.251 INFO:teuthology.orchestra.run.smithi008.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:42.255 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/573 2023-11-19T03:14:42.255 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/573 2023-11-19T03:14:42.255 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:42.257 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:42.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:42.266 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-11-19T03:14:42.440 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:42.443 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:42.443 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:42.553 INFO:teuthology.orchestra.run.smithi008.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/574 2023-11-19T03:14:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/574 2023-11-19T03:14:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:42.559 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:42.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:42.568 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-11-19T03:14:42.744 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:42.748 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:42.748 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:42.857 INFO:teuthology.orchestra.run.smithi008.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:42.861 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/575 2023-11-19T03:14:42.861 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/575 2023-11-19T03:14:42.861 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:42.863 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:42.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:42.872 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-11-19T03:14:43.045 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:43.049 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:43.049 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:43.186 INFO:teuthology.orchestra.run.smithi008.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:43.190 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/576 2023-11-19T03:14:43.190 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/576 2023-11-19T03:14:43.190 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:43.192 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:43.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:43.201 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-11-19T03:14:43.375 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:43.379 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:43.379 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:43.490 INFO:teuthology.orchestra.run.smithi008.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:43.493 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/577 2023-11-19T03:14:43.494 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/577 2023-11-19T03:14:43.494 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:43.496 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:43.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:43.505 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-11-19T03:14:43.678 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:43.682 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:43.682 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:43.830 INFO:teuthology.orchestra.run.smithi008.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-19T03:14:43.833 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/578 2023-11-19T03:14:43.833 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/578 2023-11-19T03:14:43.833 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:43.837 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:43.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:43.845 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-11-19T03:14:44.018 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:44.023 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:44.023 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:44.141 INFO:teuthology.orchestra.run.smithi008.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:44.144 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/579 2023-11-19T03:14:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/579 2023-11-19T03:14:44.145 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:44.147 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:44.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:44.155 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-11-19T03:14:44.332 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:44.336 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:44.473 INFO:teuthology.orchestra.run.smithi008.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:44.477 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/580 2023-11-19T03:14:44.477 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/580 2023-11-19T03:14:44.477 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:44.479 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:44.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:44.488 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-11-19T03:14:44.663 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:44.667 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:44.667 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:45.325 INFO:teuthology.orchestra.run.smithi008.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:45.329 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/581 2023-11-19T03:14:45.329 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/581 2023-11-19T03:14:45.329 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:45.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:45.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:45.341 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-11-19T03:14:45.515 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:45.519 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:45.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:45.656 INFO:teuthology.orchestra.run.smithi008.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:45.659 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/582 2023-11-19T03:14:45.660 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/582 2023-11-19T03:14:45.660 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:45.662 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:45.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:45.672 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-11-19T03:14:45.848 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:45.852 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:45.989 INFO:teuthology.orchestra.run.smithi008.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:45.992 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/583 2023-11-19T03:14:45.993 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/583 2023-11-19T03:14:45.993 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:46.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:46.004 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-11-19T03:14:46.177 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:46.182 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:46.182 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:46.320 INFO:teuthology.orchestra.run.smithi008.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:46.324 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/584 2023-11-19T03:14:46.324 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/584 2023-11-19T03:14:46.324 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:46.326 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:46.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:46.335 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-11-19T03:14:46.509 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:46.513 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:46.638 INFO:teuthology.orchestra.run.smithi008.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:14:46.642 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/585 2023-11-19T03:14:46.642 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/585 2023-11-19T03:14:46.642 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:14:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:46.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:14:46.654 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-11-19T03:14:46.828 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:14:46.832 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:14:46.832 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:14:53.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:14:53.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:14:53.791 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T03:14:53.788+0000 7f3d1e6f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101302) UID: 0 2023-11-19T03:14:53.791 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T03:14:53.788+0000 7ffb9bc76640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101302) UID: 0 2023-11-19T03:14:53.791 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T03:14:53.788+0000 7fbb189dc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101302) UID: 0 2023-11-19T03:14:53.792 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T03:14:53.788+0000 7f2ef6b14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101302) UID: 0 2023-11-19T03:15:05.420 INFO:teuthology.orchestra.run.smithi008.stdout:generic/586 19s 2023-11-19T03:15:05.425 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/586 2023-11-19T03:15:05.425 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:05.428 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:05.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:05.437 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-11-19T03:15:05.902 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:05.906 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:05.907 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:06.153 INFO:teuthology.orchestra.run.smithi008.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-19T03:15:06.156 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/587 2023-11-19T03:15:06.156 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/587 2023-11-19T03:15:06.156 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:06.159 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:06.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:06.168 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-11-19T03:15:06.344 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:06.348 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:06.348 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:06.469 INFO:teuthology.orchestra.run.smithi008.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:06.472 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/588 2023-11-19T03:15:06.472 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/588 2023-11-19T03:15:06.472 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:06.475 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:06.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:06.484 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-11-19T03:15:06.658 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:06.662 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:06.662 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:06.781 INFO:teuthology.orchestra.run.smithi008.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:06.784 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/589 2023-11-19T03:15:06.785 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/589 2023-11-19T03:15:06.785 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:06.787 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:06.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:06.796 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-11-19T03:15:06.968 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:06.972 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:07.083 INFO:teuthology.orchestra.run.smithi008.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:07.087 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/590 2023-11-19T03:15:07.087 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/590 2023-11-19T03:15:07.087 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:07.090 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:07.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:07.098 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-11-19T03:15:07.272 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:07.276 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:07.537 INFO:teuthology.orchestra.run.smithi008.stdout:generic/591 0s 2023-11-19T03:15:07.543 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/591 2023-11-19T03:15:07.543 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:07.545 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:07.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:07.555 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-11-19T03:15:08.055 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:08.059 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:08.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:08.229 INFO:teuthology.orchestra.run.smithi008.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/592 2023-11-19T03:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/592 2023-11-19T03:15:08.233 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:08.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:08.245 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-11-19T03:15:08.418 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:08.422 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:08.422 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:08.559 INFO:teuthology.orchestra.run.smithi008.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:08.563 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/593 2023-11-19T03:15:08.563 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/593 2023-11-19T03:15:08.563 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:08.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:08.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:08.575 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-11-19T03:15:08.748 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:08.752 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:08.752 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:08.863 INFO:teuthology.orchestra.run.smithi008.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:08.867 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/594 2023-11-19T03:15:08.867 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/594 2023-11-19T03:15:08.867 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:08.869 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:08.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:08.879 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-11-19T03:15:09.051 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:09.055 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:09.056 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:09.192 INFO:teuthology.orchestra.run.smithi008.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:09.196 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/595 2023-11-19T03:15:09.196 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/595 2023-11-19T03:15:09.196 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:09.198 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:09.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:09.207 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-11-19T03:15:09.383 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:09.387 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:09.387 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:09.573 INFO:teuthology.orchestra.run.smithi008.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-11-19T03:15:09.577 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/596 2023-11-19T03:15:09.577 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/596 2023-11-19T03:15:09.577 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:09.579 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:09.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:09.589 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-11-19T03:15:09.762 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:09.766 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:09.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:10.290 INFO:teuthology.orchestra.run.smithi008.stdout:generic/597 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/597.out.bad) 2023-11-19T03:15:10.291 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/597.out 2023-11-18 23:42:21.594425143 +0000 2023-11-19T03:15:10.291 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/597.out.bad 2023-11-19 03:15:10.286380068 +0000 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -4,11 +4,11 @@ 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_symlinks = 0 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: successfully followed symlink 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_symlinks = 1 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: -Permission denied 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: +successfully followed symlink 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: == Test hardlink create protection when 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: == process != target owner and process cannot read target 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_hardlinks = 0 2023-11-19T03:15:10.292 INFO:teuthology.orchestra.run.smithi008.stdout: -successfully created hardlink 2023-11-19T03:15:10.293 INFO:teuthology.orchestra.run.smithi008.stdout: +Permission denied 2023-11-19T03:15:10.293 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_hardlinks = 1 2023-11-19T03:15:10.293 INFO:teuthology.orchestra.run.smithi008.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-11-19T03:15:10.293 INFO:teuthology.orchestra.run.smithi008.stdout: +Permission denied 2023-11-19T03:15:10.294 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/597 2023-11-19T03:15:10.294 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/597 2023-11-19T03:15:10.294 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T03:15:10.297 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:10.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T03:15:10.306 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T03:15:10.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T03:15:10.306 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-11-19T03:15:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:10.770 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:10.770 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:11.235 INFO:teuthology.orchestra.run.smithi008.stdout:generic/598 - output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/598.out.bad) 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/598.out 2023-11-18 23:42:21.594425143 +0000 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/598.out.bad 2023-11-19 03:15:11.232370267 +0000 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -5,13 +5,10 @@ 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: = only group writable dir 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_regular = 1 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: = group & world writable dir 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: -Permission denied 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: = only group writable dir 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_regular = 2 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: = group & world writable dir 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: -Permission denied 2023-11-19T03:15:11.237 INFO:teuthology.orchestra.run.smithi008.stdout: = only group writable dir 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: -Permission denied 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_fifos = 0 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -19,10 +16,7 @@ 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: = only group writable dir 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_fifos = 1 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: = group & world writable dir 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: -Permission denied 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: = only group writable dir 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: fs.protected_fifos = 2 2023-11-19T03:15:11.238 INFO:teuthology.orchestra.run.smithi008.stdout: = group & world writable dir 2023-11-19T03:15:11.239 INFO:teuthology.orchestra.run.smithi008.stdout: -Permission denied 2023-11-19T03:15:11.239 INFO:teuthology.orchestra.run.smithi008.stdout: = only group writable dir 2023-11-19T03:15:11.239 INFO:teuthology.orchestra.run.smithi008.stdout: -Permission denied 2023-11-19T03:15:11.239 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/598 2023-11-19T03:15:11.239 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/598 2023-11-19T03:15:11.239 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T03:15:11.242 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:11.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T03:15:11.250 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T03:15:11.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T03:15:11.251 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-11-19T03:15:11.723 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:11.728 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:11.728 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:11.943 INFO:teuthology.orchestra.run.smithi008.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:11.946 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/599 2023-11-19T03:15:11.947 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/599 2023-11-19T03:15:11.947 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:11.949 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:11.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:11.958 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-11-19T03:15:12.132 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:12.135 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:12.136 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:12.246 INFO:teuthology.orchestra.run.smithi008.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/600 2023-11-19T03:15:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/600 2023-11-19T03:15:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:12.252 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:12.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:12.272 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-11-19T03:15:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:12.449 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:12.560 INFO:teuthology.orchestra.run.smithi008.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:12.563 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/601 2023-11-19T03:15:12.563 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/601 2023-11-19T03:15:12.564 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:12.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:12.575 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-11-19T03:15:12.748 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:12.752 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:12.899 INFO:teuthology.orchestra.run.smithi008.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:12.903 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/602 2023-11-19T03:15:12.903 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/602 2023-11-19T03:15:12.903 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:12.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:12.915 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-11-19T03:15:13.089 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:13.093 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:13.205 INFO:teuthology.orchestra.run.smithi008.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:13.208 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/603 2023-11-19T03:15:13.209 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/603 2023-11-19T03:15:13.209 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:13.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:13.238 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-11-19T03:15:13.410 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:13.414 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:13.523 INFO:teuthology.orchestra.run.smithi008.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:13.526 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/604 2023-11-19T03:15:13.527 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/604 2023-11-19T03:15:13.527 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:13.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:13.538 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-11-19T03:15:13.712 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:13.716 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:13.828 INFO:teuthology.orchestra.run.smithi008.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:13.831 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/605 2023-11-19T03:15:13.831 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/605 2023-11-19T03:15:13.831 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:13.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:13.842 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-11-19T03:15:14.016 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:14.020 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:14.128 INFO:teuthology.orchestra.run.smithi008.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:14.132 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/606 2023-11-19T03:15:14.132 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/606 2023-11-19T03:15:14.132 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:14.134 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:14.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:14.143 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-11-19T03:15:14.318 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:14.322 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:14.434 INFO:teuthology.orchestra.run.smithi008.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/607 2023-11-19T03:15:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/607 2023-11-19T03:15:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:14.440 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:14.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:14.448 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-11-19T03:15:14.622 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:14.626 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:14.626 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:14.741 INFO:teuthology.orchestra.run.smithi008.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:14.744 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/608 2023-11-19T03:15:14.745 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/608 2023-11-19T03:15:14.745 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:14.747 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:14.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:14.773 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-11-19T03:15:14.948 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:14.952 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:14.953 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:15.306 INFO:teuthology.orchestra.run.smithi008.stdout:generic/609 1s 2023-11-19T03:15:15.311 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/609 2023-11-19T03:15:15.312 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:15.314 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:15.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:15.324 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-11-19T03:15:15.773 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:15.778 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:15.778 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:15.890 INFO:teuthology.orchestra.run.smithi008.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:15.894 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/610 2023-11-19T03:15:15.894 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/610 2023-11-19T03:15:15.894 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:15.897 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:15.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:15.907 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-11-19T03:15:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:16.085 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:16.085 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:16.195 INFO:teuthology.orchestra.run.smithi008.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:16.199 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/611 2023-11-19T03:15:16.199 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/611 2023-11-19T03:15:16.199 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:16.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:16.210 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-11-19T03:15:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:16.387 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:16.547 INFO:teuthology.orchestra.run.smithi008.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T03:15:16.550 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/612 2023-11-19T03:15:16.550 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/612 2023-11-19T03:15:16.550 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:16.553 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:16.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:16.562 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-11-19T03:15:17.041 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:17.045 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:17.045 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:17.196 INFO:teuthology.orchestra.run.smithi008.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:17.200 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/613 2023-11-19T03:15:17.200 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/613 2023-11-19T03:15:17.200 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:17.202 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:17.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:17.211 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-11-19T03:15:17.388 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:17.391 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:17.392 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:17.501 INFO:teuthology.orchestra.run.smithi008.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:17.504 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/614 2023-11-19T03:15:17.505 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/614 2023-11-19T03:15:17.505 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:17.507 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:17.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:17.516 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-11-19T03:15:17.689 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:17.693 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:17.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:17.802 INFO:teuthology.orchestra.run.smithi008.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:17.806 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/615 2023-11-19T03:15:17.806 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/615 2023-11-19T03:15:17.806 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:17.808 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:17.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:17.818 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-11-19T03:15:17.991 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:17.995 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:17.995 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:18.108 INFO:teuthology.orchestra.run.smithi008.stdout:generic/616 [not run] kernel does not support IO_URING 2023-11-19T03:15:18.112 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/616 2023-11-19T03:15:18.112 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/616 2023-11-19T03:15:18.112 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:18.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:18.123 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-11-19T03:15:18.296 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:18.301 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:18.453 INFO:teuthology.orchestra.run.smithi008.stdout:generic/617 [not run] kernel does not support IO_URING 2023-11-19T03:15:18.457 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/617 2023-11-19T03:15:18.457 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/617 2023-11-19T03:15:18.457 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:18.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:18.468 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-11-19T03:15:18.641 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:18.645 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:18.761 INFO:teuthology.orchestra.run.smithi008.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:18.765 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/618 2023-11-19T03:15:18.765 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/618 2023-11-19T03:15:18.765 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:18.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:18.776 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-11-19T03:15:18.949 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:18.953 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:19.062 INFO:teuthology.orchestra.run.smithi008.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:19.066 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/619 2023-11-19T03:15:19.066 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/619 2023-11-19T03:15:19.066 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:19.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:19.077 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-11-19T03:15:19.249 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:19.253 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:19.390 INFO:teuthology.orchestra.run.smithi008.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:19.394 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/620 2023-11-19T03:15:19.394 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/620 2023-11-19T03:15:19.394 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:19.396 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:19.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:19.405 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-11-19T03:15:19.578 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:19.582 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:19.582 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:19.720 INFO:teuthology.orchestra.run.smithi008.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:19.723 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/621 2023-11-19T03:15:19.724 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/621 2023-11-19T03:15:19.724 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:19.726 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:19.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:19.735 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-11-19T03:15:19.909 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:19.913 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:19.913 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.024 INFO:teuthology.orchestra.run.smithi008.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:20.028 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/622 2023-11-19T03:15:20.028 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/622 2023-11-19T03:15:20.028 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:20.030 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:20.040 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-11-19T03:15:20.215 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:20.219 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:20.219 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.328 INFO:teuthology.orchestra.run.smithi008.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:20.332 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/623 2023-11-19T03:15:20.332 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/623 2023-11-19T03:15:20.332 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:20.334 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:20.343 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-11-19T03:15:20.517 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:20.521 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.631 INFO:teuthology.orchestra.run.smithi008.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:20.635 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/624 2023-11-19T03:15:20.635 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/624 2023-11-19T03:15:20.635 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:20.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:20.645 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-11-19T03:15:20.818 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:20.822 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:20.822 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.933 INFO:teuthology.orchestra.run.smithi008.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:20.936 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/625 2023-11-19T03:15:20.936 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/625 2023-11-19T03:15:20.937 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:20.939 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:20.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:20.948 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-11-19T03:15:21.122 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:21.126 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:21.240 INFO:teuthology.orchestra.run.smithi008.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:21.244 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/626 2023-11-19T03:15:21.244 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/626 2023-11-19T03:15:21.244 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:21.246 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:21.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:21.256 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-11-19T03:15:21.430 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:21.434 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:21.434 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/627 2023-11-19T03:15:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/627 2023-11-19T03:15:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:21.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:21.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:21.563 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-11-19T03:15:21.736 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:21.740 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:21.740 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:21.880 INFO:teuthology.orchestra.run.smithi008.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:21.884 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/628 2023-11-19T03:15:21.884 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/628 2023-11-19T03:15:21.884 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:21.886 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:21.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:21.907 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-11-19T03:15:22.080 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:22.085 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:22.085 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:22.210 INFO:teuthology.orchestra.run.smithi008.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:22.213 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/629 2023-11-19T03:15:22.214 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/629 2023-11-19T03:15:22.214 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:22.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:22.225 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-11-19T03:15:22.398 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:22.402 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:22.402 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:22.516 INFO:teuthology.orchestra.run.smithi008.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:22.519 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/630 2023-11-19T03:15:22.519 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/630 2023-11-19T03:15:22.519 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:22.522 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:22.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:22.530 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-11-19T03:15:22.703 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:22.707 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:22.707 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:22.817 INFO:teuthology.orchestra.run.smithi008.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:22.820 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/631 2023-11-19T03:15:22.820 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/631 2023-11-19T03:15:22.820 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:22.823 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:22.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:22.832 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-11-19T03:15:23.006 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:23.010 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:25.698 INFO:teuthology.orchestra.run.smithi008.stdout:generic/632 2s 2023-11-19T03:15:25.704 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/632 2023-11-19T03:15:25.704 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:25.706 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:25.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:25.729 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-11-19T03:15:25.902 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:25.906 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:25.906 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:26.198 INFO:teuthology.orchestra.run.smithi008.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/633.out.bad) 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: --- tests/generic/633.out 2023-11-18 23:42:21.596425122 +0000 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: +++ /tmp/tmp.kYHL8e4YNuxfstests-dev/results//generic/633.out.bad 2023-11-19 03:15:26.195214786 +0000 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: @@ -1,2 +1,5 @@ 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: QA output created by 633 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: Silence is golden 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2023-11-19T03:15:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2023-11-19T03:15:26.232 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/633 2023-11-19T03:15:26.233 INFO:teuthology.orchestra.run.smithi008.stdout:Failures: generic/633 2023-11-19T03:15:26.233 INFO:teuthology.orchestra.run.smithi008.stdout:Failed 1 of 1 tests 2023-11-19T03:15:26.244 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:26.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T03:15:26.261 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-19T03:15:26.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-19T03:15:26.261 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-11-19T03:15:26.679 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:26.684 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:26.684 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:26.807 INFO:teuthology.orchestra.run.smithi008.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:26.811 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/634 2023-11-19T03:15:26.811 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/634 2023-11-19T03:15:26.811 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:26.813 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:26.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:26.822 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-11-19T03:15:26.995 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:27.000 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:27.000 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:27.113 INFO:teuthology.orchestra.run.smithi008.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/635 2023-11-19T03:15:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/635 2023-11-19T03:15:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:27.119 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:27.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:27.128 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-11-19T03:15:27.299 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:27.303 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/636 2023-11-19T03:15:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/636 2023-11-19T03:15:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:27.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:27.427 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-11-19T03:15:27.600 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:27.604 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:27.604 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:28.655 INFO:teuthology.orchestra.run.smithi008.stdout:generic/637 1s 2023-11-19T03:15:28.664 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/637 2023-11-19T03:15:28.664 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:28.666 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:28.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:28.677 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-11-19T03:15:29.210 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:29.214 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:29.214 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:29.368 INFO:teuthology.orchestra.run.smithi008.stdout:generic/638 0s 2023-11-19T03:15:29.373 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/638 2023-11-19T03:15:29.374 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:29.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:29.385 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-11-19T03:15:29.558 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:29.562 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:29.562 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:33.485 INFO:teuthology.orchestra.run.smithi008.stdout:generic/639 4s 2023-11-19T03:15:33.491 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/639 2023-11-19T03:15:33.492 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:33.494 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:33.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:33.504 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-11-19T03:15:33.684 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:33.688 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:33.688 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:33.811 INFO:teuthology.orchestra.run.smithi008.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:33.815 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/640 2023-11-19T03:15:33.815 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/640 2023-11-19T03:15:33.815 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:33.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:33.827 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-11-19T03:15:34.016 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:34.020 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:34.020 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:34.130 INFO:teuthology.orchestra.run.smithi008.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:34.133 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/641 2023-11-19T03:15:34.133 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/641 2023-11-19T03:15:34.133 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:34.136 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:34.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:34.144 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-11-19T03:15:34.318 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:34.322 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:34.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:34.484 INFO:teuthology.orchestra.run.smithi008.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:34.487 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/642 2023-11-19T03:15:34.487 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/642 2023-11-19T03:15:34.488 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:34.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:34.499 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-11-19T03:15:34.672 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:34.675 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:34.676 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:34.785 INFO:teuthology.orchestra.run.smithi008.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:34.789 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/643 2023-11-19T03:15:34.789 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/643 2023-11-19T03:15:34.789 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:34.791 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:34.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:34.810 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-11-19T03:15:34.984 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:34.988 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:34.988 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:35.100 INFO:teuthology.orchestra.run.smithi008.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-11-19T03:15:35.103 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/644 2023-11-19T03:15:35.103 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/644 2023-11-19T03:15:35.103 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:35.106 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:35.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:35.115 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-11-19T03:15:35.287 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:35.291 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:35.291 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:35.403 INFO:teuthology.orchestra.run.smithi008.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-11-19T03:15:35.406 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/645 2023-11-19T03:15:35.406 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/645 2023-11-19T03:15:35.406 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:35.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:35.418 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-11-19T03:15:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:35.595 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:35.595 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:35.703 INFO:teuthology.orchestra.run.smithi008.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:35.706 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/646 2023-11-19T03:15:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/646 2023-11-19T03:15:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:35.709 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:35.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:35.718 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-11-19T03:15:35.890 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:35.893 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:35.894 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:36.162 INFO:teuthology.orchestra.run.smithi008.stdout:generic/647 1s 2023-11-19T03:15:36.167 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/647 2023-11-19T03:15:36.168 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:36.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:36.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:36.179 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-11-19T03:15:36.642 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:36.646 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:36.647 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:36.784 INFO:teuthology.orchestra.run.smithi008.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-11-19T03:15:36.787 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/648 2023-11-19T03:15:36.787 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/648 2023-11-19T03:15:36.787 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:36.790 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:36.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:36.798 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-11-19T03:15:36.972 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:36.976 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:36.976 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:37.140 INFO:teuthology.orchestra.run.smithi008.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-19T03:15:37.143 INFO:teuthology.orchestra.run.smithi008.stdout:Ran: generic/649 2023-11-19T03:15:37.144 INFO:teuthology.orchestra.run.smithi008.stdout:Not run: generic/649 2023-11-19T03:15:37.144 INFO:teuthology.orchestra.run.smithi008.stdout:Passed all 1 tests 2023-11-19T03:15:37.146 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:15:37.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-19T03:15:37.155 DEBUG:teuthology.orchestra.run.smithi008:> (cd /tmp/tmp.kYHL8e4YNuxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-11-19T03:15:37.620 INFO:teuthology.orchestra.run.smithi008.stdout:FSTYP -- ceph-fuse 2023-11-19T03:15:37.624 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM -- Linux/x86_64 smithi008 5.14.0-384.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Nov 9 16:53:36 UTC 2023 2023-11-19T03:15:37.624 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-11-19T03:17:14.614 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:17:14.624 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:17:44.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:17:44.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:18:15.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:18:15.063 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:18:45.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:18:45.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:19:15.403 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:19:15.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:19:45.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:19:45.928 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:20:16.357 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:20:16.362 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:20:46.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:20:46.523 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:21:16.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:21:16.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:21:46.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:21:46.894 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:22:17.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:22:17.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:22:47.237 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:22:47.244 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:23:17.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:23:17.435 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:23:47.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:23:47.583 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:24:17.770 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:24:17.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:24:48.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:24:48.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:25:18.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:25:18.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:25:48.565 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:25:48.574 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:26:18.773 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:26:18.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:26:49.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:26:49.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:27:19.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:27:19.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:27:49.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:27:49.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:28:04.555 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T03:28:04.536+0000 7f9db3de1640 -1 bdev(0x55fd95aece00 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-5 ((5) Input/output error) 2023-11-19T03:28:04.563 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T03:28:04.548+0000 7f9dac5c9640 -1 bdev(0x55fd95aed180 /var/lib/ceph/osd/ceph-3/block) _sync_write pwritev error: (5) Input/output error 2023-11-19T03:28:04.563 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-11-19T03:28:04.553+0000 7f9db2ddf640 -1 bdev(0x55fd95aed180 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-5 ((5) Input/output error) 2023-11-19T03:28:04.582 INFO:tasks.ceph.osd.3.smithi008.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7418-gb0f45a51/rpm/el9/BUILD/ceph-18.0.0-7418-gb0f45a51/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f9db3de1640 time 2023-11-19T03:28:04.561103+0000 2023-11-19T03:28:04.582 INFO:tasks.ceph.osd.3.smithi008.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7418-gb0f45a51/rpm/el9/BUILD/ceph-18.0.0-7418-gb0f45a51/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-11-19T03:28:04.586 INFO:tasks.ceph.osd.3.smithi008.stderr: ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev) 2023-11-19T03:28:04.586 INFO:tasks.ceph.osd.3.smithi008.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55fd937bfdb1] 2023-11-19T03:28:04.586 INFO:tasks.ceph.osd.3.smithi008.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55fd9410eed6] 2023-11-19T03:28:04.586 INFO:tasks.ceph.osd.3.smithi008.stderr: 3: ceph-osd(+0xda00c1) [0x55fd940f00c1] 2023-11-19T03:28:04.586 INFO:tasks.ceph.osd.3.smithi008.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f9dc149f802] 2023-11-19T03:28:04.587 INFO:tasks.ceph.osd.3.smithi008.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f9dc143f450] 2023-11-19T03:28:04.588 INFO:tasks.ceph.osd.3.smithi008.stderr:*** Caught signal (Aborted) ** 2023-11-19T03:28:04.588 INFO:tasks.ceph.osd.3.smithi008.stderr: in thread 7f9db3de1640 thread_name:bstore_aio 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7418-gb0f45a51/rpm/el9/BUILD/ceph-18.0.0-7418-gb0f45a51/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f9db2ddf640 time 2023-11-19T03:28:04.554206+0000 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7418-gb0f45a51/rpm/el9/BUILD/ceph-18.0.0-7418-gb0f45a51/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr: ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev) 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55fd937bfdb1] 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55fd9410eed6] 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr: 3: ceph-osd(+0xda00c1) [0x55fd940f00c1] 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f9dc149f802] 2023-11-19T03:28:04.601 INFO:tasks.ceph.osd.3.smithi008.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f9dc143f450] 2023-11-19T03:28:16.593 INFO:tasks.ceph.osd.3.smithi008.stderr:daemon-helper: command crashed with signal 6 2023-11-19T03:28:19.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:28:19.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:28:22.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-19T03:28:29.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~7s 2023-11-19T03:28:35.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2023-11-19T03:28:42.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-11-19T03:28:48.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~26s 2023-11-19T03:28:49.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:28:49.839 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:28:55.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2023-11-19T03:29:02.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-11-19T03:29:08.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~46s 2023-11-19T03:29:15.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~53s 2023-11-19T03:29:20.135 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:29:20.140 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:29:22.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2023-11-19T03:29:28.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~66s 2023-11-19T03:29:35.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~73s 2023-11-19T03:29:41.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~79s 2023-11-19T03:29:48.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~86s 2023-11-19T03:29:50.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:29:50.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:29:55.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~93s 2023-11-19T03:30:01.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~99s 2023-11-19T03:30:08.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~106s 2023-11-19T03:30:14.919 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~112s 2023-11-19T03:30:20.738 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:30:20.749 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:30:21.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~119s 2023-11-19T03:30:28.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~126s 2023-11-19T03:30:34.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~132s 2023-11-19T03:30:41.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~139s 2023-11-19T03:30:47.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2023-11-19T03:30:50.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:30:50.931 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:30:54.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~152s 2023-11-19T03:31:01.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~159s 2023-11-19T03:31:07.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-11-19T03:31:14.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~172s 2023-11-19T03:31:21.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~178s 2023-11-19T03:31:21.120 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:31:21.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:31:27.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2023-11-19T03:31:34.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~192s 2023-11-19T03:31:40.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~198s 2023-11-19T03:31:47.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2023-11-19T03:31:51.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:31:51.324 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:31:54.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~212s 2023-11-19T03:32:00.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~218s 2023-11-19T03:32:07.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2023-11-19T03:32:13.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~231s 2023-11-19T03:32:20.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~238s 2023-11-19T03:32:21.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:32:21.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:32:27.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2023-11-19T03:32:33.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~251s 2023-11-19T03:32:40.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~258s 2023-11-19T03:32:46.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~264s 2023-11-19T03:32:51.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:32:51.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:32:53.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~271s 2023-11-19T03:33:00.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~278s 2023-11-19T03:33:06.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~284s 2023-11-19T03:33:13.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~291s 2023-11-19T03:33:20.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~297s 2023-11-19T03:33:21.907 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:33:21.914 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:33:26.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~304s 2023-11-19T03:33:26.637 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-19T03:33:26.637 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-19T03:33:26.637 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-19T03:33:26.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057150,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19644 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.hQpPz0d1gttest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-11-19T03:33:26.746 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi008.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-19T03:33:26.747 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-11-19T03:33:26.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T03:33:26.747 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-19T03:33:26.826 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-11-19T03:33:26.826 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-19T03:33:26.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057150,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19644 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.hQpPz0d1gttest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-11-19T03:33:26.887 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi008.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-19T03:33:26.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-11-19T03:33:26.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T03:33:26.888 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-19T03:33:26.957 INFO:teuthology.orchestra.run.smithi008.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-19T03:33:26.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T03:33:26.958 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-19T03:33:26.958 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-19T03:33:27.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056379,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497736k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=783 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497736k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-19T03:33:27.079 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi116.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-19T03:33:27.079 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-11-19T03:33:27.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T03:33:27.079 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-19T03:33:27.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T03:33:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-19T03:33:27.158 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-11-19T03:33:27.158 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-19T03:33:27.214 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056379,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497736k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=783 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497736k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-19T03:33:27.214 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi116.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-19T03:33:27.214 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2023-11-19T03:33:27.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T03:33:27.214 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-19T03:33:27.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T03:33:27.269 INFO:teuthology.orchestra.run.smithi116.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-19T03:33:28.878 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-19T03:33:28.878 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-19T03:33:28.879 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-19T03:33:28.879 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-19T03:33:28.879 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-19T03:33:28.879 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-19T03:33:28.880 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-19T03:33:28.880 INFO:tasks.ceph.mds.a:Sent signal 15 2023-11-19T03:33:28.880 INFO:tasks.ceph.mds.c:Sent signal 15 2023-11-19T03:33:28.880 INFO:tasks.ceph.mds.b:Sent signal 15 2023-11-19T03:33:28.880 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-19T03:33:28.881 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-19T03:33:28.881 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-19T03:33:28.881 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-19T03:33:28.881 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-19T03:33:28.882 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-19T03:33:28.882 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T03:33:28.879+0000 7f9762870640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 87685) UID: 0 2023-11-19T03:33:28.882 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T03:33:28.879+0000 7f9762870640 -1 osd.1 35 *** Got signal Terminated *** 2023-11-19T03:33:28.882 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-11-19T03:33:28.879+0000 7f9762870640 -1 osd.1 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-19T03:33:28.883 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T03:33:28.879+0000 7f3d1e6f3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 87374) UID: 0 2023-11-19T03:33:28.883 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T03:33:28.879+0000 7f3d1e6f3640 -1 osd.4 35 *** Got signal Terminated *** 2023-11-19T03:33:28.883 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-11-19T03:33:28.879+0000 7f3d1e6f3640 -1 osd.4 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-19T03:33:28.883 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T03:33:28.879+0000 7ffb9bc76640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 87372) UID: 0 2023-11-19T03:33:28.883 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T03:33:28.879+0000 7ffb9bc76640 -1 osd.5 35 *** Got signal Terminated *** 2023-11-19T03:33:28.883 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-11-19T03:33:28.879+0000 7ffb9bc76640 -1 osd.5 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-19T03:33:28.884 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T03:33:28.879+0000 7fbb189dc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 87375) UID: 0 2023-11-19T03:33:28.884 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T03:33:28.879+0000 7fbb189dc640 -1 osd.6 35 *** Got signal Terminated *** 2023-11-19T03:33:28.884 INFO:tasks.ceph.osd.6.smithi116.stderr:2023-11-19T03:33:28.879+0000 7fbb189dc640 -1 osd.6 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-19T03:33:28.884 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T03:33:28.879+0000 7f2ef6b14640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 87378) UID: 0 2023-11-19T03:33:28.884 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T03:33:28.879+0000 7f2ef6b14640 -1 osd.7 35 *** Got signal Terminated *** 2023-11-19T03:33:28.885 INFO:tasks.ceph.osd.7.smithi116.stderr:2023-11-19T03:33:28.879+0000 7f2ef6b14640 -1 osd.7 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-19T03:33:28.885 INFO:tasks.ceph.mds.b.smithi116.stderr:2023-11-19T03:33:28.880+0000 7fa6e082b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 94626) UID: 0 2023-11-19T03:33:28.885 INFO:tasks.ceph.mds.b.smithi116.stderr:2023-11-19T03:33:28.880+0000 7fa6e082b640 -1 mds.b *** got signal Terminated *** 2023-11-19T03:33:28.885 INFO:tasks.ceph.mds.d.smithi116.stderr:2023-11-19T03:33:28.880+0000 7f82de409640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 94625) UID: 0 2023-11-19T03:33:28.885 INFO:tasks.ceph.mds.d.smithi116.stderr:2023-11-19T03:33:28.880+0000 7f82de409640 -1 mds.d *** got signal Terminated *** 2023-11-19T03:33:28.886 INFO:tasks.ceph.mon.b.smithi116.stderr:2023-11-19T03:33:28.881+0000 7f3767c97640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 86802) UID: 0 2023-11-19T03:33:28.886 INFO:tasks.ceph.mon.b.smithi116.stderr:2023-11-19T03:33:28.881+0000 7f3767c97640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-19T03:33:28.886 INFO:tasks.ceph.mon.c.smithi116.stderr:2023-11-19T03:33:28.881+0000 7ff7ff54f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 86805) UID: 0 2023-11-19T03:33:28.886 INFO:tasks.ceph.mon.c.smithi116.stderr:2023-11-19T03:33:28.881+0000 7ff7ff54f640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-19T03:33:28.886 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T03:33:28.883+0000 7fd4c2c2b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 99619) UID: 0 2023-11-19T03:33:28.887 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-11-19T03:33:28.883+0000 7fd4c2c2b640 -1 mds.a *** got signal Terminated *** 2023-11-19T03:33:28.887 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T03:33:28.879+0000 7f6271cf3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 87682) UID: 0 2023-11-19T03:33:28.887 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T03:33:28.879+0000 7f6271cf3640 -1 osd.0 35 *** Got signal Terminated *** 2023-11-19T03:33:28.890 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-11-19T03:33:28.879+0000 7f6271cf3640 -1 osd.0 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-19T03:33:28.892 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T03:33:28.886+0000 7f15bce65640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 99620) UID: 0 2023-11-19T03:33:28.892 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-11-19T03:33:28.886+0000 7f15bce65640 -1 mds.c *** got signal Terminated *** 2023-11-19T03:33:28.893 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-11-19T03:33:28.892+0000 7ff6d02d6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 87401) UID: 0 2023-11-19T03:33:28.894 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-11-19T03:33:28.892+0000 7ff6d02d6640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-19T03:33:28.901 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T03:33:28.879+0000 7feb11d51640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 87684) UID: 0 2023-11-19T03:33:28.901 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T03:33:28.879+0000 7feb11d51640 -1 osd.2 35 *** Got signal Terminated *** 2023-11-19T03:33:28.902 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-11-19T03:33:28.879+0000 7feb11d51640 -1 osd.2 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-19T03:33:29.092 INFO:tasks.ceph.mgr.y.smithi008.stderr:daemon-helper: command crashed with signal 15 2023-11-19T03:33:52.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:33:52.108 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:34:22.230 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:34:22.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:34:52.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:34:52.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:35:22.478 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:35:22.482 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:35:52.629 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:35:52.633 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:36:22.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:36:22.917 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:36:53.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:36:53.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:37:23.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:37:23.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:37:53.427 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:37:53.431 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:38:23.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:38:23.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:38:53.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:38:53.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:39:23.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:39:23.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:39:53.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:39:53.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:40:24.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:40:24.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:40:54.217 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:40:54.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:41:24.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:41:24.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:41:54.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:41:54.493 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:42:24.611 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:42:24.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:42:54.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:42:54.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:43:24.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:43:24.973 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:43:55.098 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:43:55.102 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:44:25.237 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:44:25.241 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:44:55.361 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:44:55.365 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:45:25.484 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:45:25.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:45:55.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:45:55.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:46:25.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:46:25.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:46:55.877 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:46:55.882 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:47:25.993 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:47:25.998 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:47:56.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:47:56.120 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:48:26.239 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:48:26.243 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:48:56.387 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:48:56.391 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:49:26.683 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:49:26.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:49:56.809 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:49:56.813 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:50:26.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:50:26.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:50:57.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:50:57.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:51:27.235 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:51:27.245 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:51:57.386 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:51:57.391 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:52:27.509 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:52:27.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:52:57.688 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:52:57.692 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:53:27.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:53:27.850 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:53:57.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:53:57.975 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:54:28.086 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:54:28.091 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:54:58.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:54:58.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:55:28.399 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:55:28.405 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:55:58.603 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:55:58.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:56:28.768 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:56:28.773 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:56:58.893 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:56:58.897 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:57:29.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:57:29.021 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:57:59.148 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:57:59.152 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:58:29.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:58:29.268 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:58:59.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:58:59.399 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:59:29.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:59:29.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:59:59.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T03:59:59.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:00:29.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:00:29.805 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:00:59.947 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:00:59.952 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:01:30.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:01:30.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:02:00.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:02:00.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:02:30.362 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:02:30.366 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:03:00.481 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:03:00.485 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:03:30.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:03:30.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:04:00.728 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:04:00.732 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:04:30.852 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:04:30.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:05:01.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:05:01.005 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:05:31.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:05:31.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:06:01.268 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:06:01.273 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:06:31.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:06:31.423 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:07:01.542 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:07:01.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:07:31.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:07:31.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:08:01.953 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:08:01.958 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:08:32.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:08:32.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:09:02.212 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:09:02.216 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:09:32.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:09:32.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:10:02.509 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:10:02.513 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:10:32.649 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:10:32.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:11:02.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:11:02.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:11:33.055 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:11:33.059 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:12:03.177 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:12:03.181 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:12:33.300 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:12:33.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:13:03.428 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:13:03.432 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:13:33.555 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:13:33.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:14:03.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:14:03.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:14:33.840 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:14:33.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:15:03.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:15:03.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:15:34.091 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:15:34.096 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:16:04.223 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:16:04.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:16:34.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:16:34.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:17:04.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:17:04.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:17:34.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:17:34.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:18:04.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:18:04.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:18:34.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:18:34.884 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:19:05.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:19:05.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:19:35.145 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:19:35.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:20:05.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:20:05.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:20:35.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:20:35.402 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:21:05.530 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:21:05.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:21:35.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:21:35.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:22:05.786 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:22:05.790 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:22:35.908 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:22:35.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:23:06.031 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:23:06.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:23:36.182 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:23:36.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:24:06.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:24:06.491 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:24:36.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:24:36.614 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:25:06.738 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:25:06.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:25:36.872 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:25:36.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:26:07.013 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:26:07.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:26:37.160 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:26:37.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:27:07.294 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:27:07.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:27:37.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:27:37.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:28:07.549 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:28:07.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:28:37.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:28:37.668 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:29:07.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:29:07.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:29:37.955 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:29:37.959 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:30:08.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:30:08.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:30:38.239 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:30:38.244 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:31:08.388 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:31:08.393 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:31:38.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:31:38.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:32:08.661 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:32:08.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:32:38.817 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:32:38.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:33:08.941 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:33:08.945 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:33:39.066 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:33:39.073 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:34:09.340 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:34:09.345 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:34:39.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:34:39.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:35:09.607 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:35:09.611 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:35:39.945 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:35:39.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:36:10.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:36:10.068 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:36:40.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:36:40.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:37:10.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:37:10.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:37:40.488 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:37:40.492 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:38:10.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:38:10.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:38:40.772 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:38:40.776 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:39:10.902 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:39:10.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:39:41.126 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:39:41.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:40:11.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:40:11.246 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:40:41.373 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:40:41.378 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:41:11.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:41:11.510 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:41:41.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:41:41.642 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:42:11.784 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:42:11.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:42:41.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:42:41.939 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:43:12.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:43:12.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:43:42.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:43:42.199 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:44:12.320 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:44:12.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:44:42.461 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:44:42.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:45:12.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:45:12.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:45:42.837 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:45:42.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:46:12.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:46:12.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:46:43.105 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:46:43.109 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:47:13.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:47:13.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:47:43.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:47:43.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:48:13.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:48:13.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:48:43.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:48:43.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:49:13.778 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:49:13.783 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:49:43.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:49:43.936 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:50:14.050 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:50:14.057 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:50:44.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:50:44.246 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:51:14.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:51:14.384 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:51:44.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:51:44.510 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:52:14.648 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:52:14.653 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:52:44.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:52:44.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:53:14.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:53:14.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:53:45.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:53:45.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:54:15.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:54:15.311 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:54:45.443 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:54:45.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:55:15.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:55:15.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:55:45.837 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:55:45.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:56:15.972 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:56:15.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:56:46.097 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:56:46.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:57:16.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:57:16.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:57:46.433 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:57:46.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:58:16.577 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:58:16.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:58:46.705 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:58:46.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:59:16.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:59:16.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:59:46.985 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T04:59:46.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:00:17.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:00:17.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:00:47.393 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:00:47.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:01:17.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:01:17.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:01:47.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:01:47.685 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:02:17.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:02:17.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:02:48.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:02:48.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:03:18.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:03:18.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:03:48.271 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:03:48.275 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:04:18.534 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:04:18.540 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:04:48.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:04:48.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:05:18.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:05:18.814 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:05:48.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:05:48.937 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:06:19.189 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:06:19.195 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:06:49.323 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:06:49.328 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:07:19.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:07:19.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:07:49.586 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:07:49.592 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:08:19.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:08:19.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:08:49.833 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:08:49.839 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:09:20.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:09:20.033 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:09:50.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:09:50.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:10:20.297 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:10:20.302 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:10:50.436 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:10:50.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:11:20.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:11:20.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:11:50.715 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:11:50.719 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:12:20.850 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:12:20.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:12:50.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:12:50.974 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:13:21.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:13:21.167 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:13:51.305 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:13:51.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:14:21.452 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:14:21.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:14:51.597 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:14:51.601 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:15:21.761 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:15:21.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:15:51.887 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:15:51.891 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:16:22.012 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:16:22.016 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:16:52.126 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:16:52.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:17:22.255 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:17:22.260 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:17:52.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:17:52.389 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:18:22.571 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:18:22.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:18:52.711 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:18:52.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:19:22.865 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:19:22.869 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:19:52.991 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:19:52.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:20:23.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:20:23.120 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:20:53.287 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:20:53.292 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:21:23.442 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:21:23.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:21:53.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:21:53.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:22:23.725 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:22:23.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:22:53.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:22:53.884 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:23:24.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:23:24.025 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:23:54.147 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:23:54.151 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:24:24.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:24:24.297 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:24:54.439 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:24:54.443 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:25:24.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:25:24.589 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:25:54.715 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:25:54.719 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:26:24.852 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:26:24.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:26:54.993 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:26:54.998 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:27:25.136 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:27:25.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:27:55.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:27:55.268 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:28:25.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:28:25.399 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:28:55.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:28:55.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:29:25.650 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:29:25.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:29:55.773 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:29:55.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:30:25.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:30:25.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:30:56.012 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:30:56.016 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:31:26.135 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:31:26.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:31:56.258 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:31:56.263 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:32:26.390 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:32:26.394 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:32:56.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:32:56.518 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:33:26.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:33:26.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:33:56.769 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:33:56.774 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:34:26.901 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:34:26.905 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:34:57.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:34:57.037 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:35:27.156 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:35:27.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:35:57.287 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:35:57.291 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:36:27.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:36:27.445 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:36:57.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:36:57.574 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:37:27.699 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:37:27.703 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:37:57.839 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:37:57.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:38:27.982 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:38:27.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:38:58.129 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:38:58.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:39:28.291 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:39:28.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:39:58.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:39:58.450 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:40:28.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:40:28.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:40:58.755 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:40:58.759 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:41:28.909 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:41:28.914 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:41:59.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:41:59.043 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:42:29.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:42:29.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:42:59.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:42:59.335 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:43:29.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:43:29.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:43:59.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:43:59.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:44:29.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:44:29.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:44:59.881 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:44:59.886 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:45:30.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:45:30.024 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:46:00.158 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:46:00.162 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:46:30.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:46:30.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:47:00.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:47:00.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:47:30.571 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:47:30.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:48:00.717 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:48:00.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:48:30.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:48:30.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:49:01.101 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:49:01.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:49:31.254 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:49:31.259 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:50:01.400 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:50:01.405 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:50:31.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:50:31.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:51:01.685 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:51:01.689 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:51:31.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:51:31.822 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:52:01.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:52:01.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:52:32.098 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:52:32.103 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:53:02.219 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:53:02.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:53:32.366 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:53:32.371 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:54:02.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:54:02.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:54:32.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:54:32.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:55:02.771 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:55:02.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:55:32.909 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:55:32.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:56:03.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:56:03.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:56:33.175 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:56:33.180 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:57:03.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:57:03.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:57:33.477 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:57:33.481 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:58:03.615 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:58:03.620 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:58:33.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:58:33.757 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:59:03.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:59:03.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:59:34.025 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T05:59:34.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:00:04.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:00:04.151 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:00:34.298 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:00:34.302 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:01:04.452 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:01:04.457 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:01:34.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:01:34.603 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:02:04.740 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:02:04.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:02:34.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:02:34.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:03:05.037 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:03:05.041 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:03:35.168 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:03:35.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:04:05.304 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:04:05.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:04:35.442 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:04:35.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:05:05.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:05:05.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:05:35.834 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:05:35.838 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:06:05.981 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:06:05.985 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:06:36.107 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:06:36.111 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:07:06.248 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:07:06.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:07:36.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:07:36.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:08:06.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:08:06.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:08:36.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:08:36.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:09:06.817 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:09:06.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:09:36.940 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:09:36.946 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:10:07.094 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:10:07.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:10:37.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:10:37.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:11:07.326 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:11:07.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:11:37.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:11:37.453 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:12:07.572 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:12:07.576 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:12:37.695 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:12:37.699 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:13:07.818 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:13:07.822 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:13:37.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:13:37.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:14:08.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:14:08.068 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:14:38.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:14:38.192 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:15:08.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:15:08.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:15:38.443 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:15:38.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:16:08.566 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:16:08.570 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:16:38.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:16:38.693 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:17:08.839 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:17:08.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:17:38.986 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:17:38.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:18:09.108 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:18:09.112 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:18:39.232 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:18:39.237 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:19:09.373 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:19:09.378 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:19:39.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:19:39.552 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:20:09.669 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:20:09.673 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:20:39.809 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:20:39.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:21:09.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:21:09.970 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:21:40.096 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:21:40.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:22:10.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:22:10.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:22:40.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:22:40.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:23:10.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:23:10.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:23:40.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:23:40.602 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:24:10.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:24:10.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:24:40.888 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:24:40.893 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:25:11.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:25:11.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:25:41.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:25:41.167 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:26:11.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:26:11.314 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:26:41.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:26:41.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:27:11.594 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:27:11.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:27:41.735 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:27:41.739 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:28:11.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:28:11.891 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:28:42.016 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:28:42.020 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:29:12.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:29:12.150 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:29:42.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:29:42.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:30:12.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:30:12.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:30:42.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:30:42.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:31:12.665 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:31:12.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:31:42.789 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:31:42.793 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:32:12.911 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:32:12.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:32:43.043 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:32:43.047 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:33:13.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:33:13.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:33:43.290 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:33:43.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:34:13.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:34:13.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:34:43.545 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:34:43.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:35:13.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:35:13.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:35:43.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:35:43.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:36:13.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:36:13.936 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:36:44.063 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:36:44.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:37:14.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:37:14.199 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:37:44.326 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:37:44.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:38:14.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:38:14.453 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:38:44.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:38:44.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:39:14.720 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:39:14.725 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:39:44.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:39:44.840 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:40:14.975 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:40:14.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:40:45.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:40:45.120 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:41:15.247 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:41:15.251 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:41:45.371 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:41:45.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:42:15.519 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:42:15.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:42:45.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:42:45.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:43:15.767 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:43:15.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:43:45.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:43:45.905 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:44:16.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:44:16.033 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:44:46.160 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:44:46.165 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:45:16.292 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:45:16.296 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:45:46.417 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:45:46.421 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:46:16.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:46:16.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:46:46.669 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:46:46.674 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:47:16.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:47:16.806 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:47:46.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:47:46.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:48:17.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:48:17.068 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:48:47.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:48:47.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:49:17.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:49:17.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:49:47.451 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:49:47.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:50:17.582 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:50:17.586 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:50:47.714 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:50:47.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:51:17.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:51:17.860 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:51:47.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:51:47.974 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:52:18.101 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:52:18.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:52:48.240 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:52:48.246 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:53:18.372 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:53:18.376 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:53:48.503 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:53:48.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:54:18.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:54:18.640 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:54:48.775 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:54:48.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:55:18.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:55:18.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:55:49.074 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:55:49.078 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:56:19.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:56:19.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:56:49.360 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:56:49.371 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:57:19.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:57:19.524 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:57:49.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:57:49.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:58:19.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:58:19.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:58:49.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:58:49.959 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:59:20.088 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:59:20.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:59:50.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T06:59:50.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:00:20.404 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:00:20.408 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:00:50.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:00:50.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:01:20.704 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:01:20.709 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:01:50.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:01:50.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:02:20.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:02:21.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:02:51.115 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:02:51.120 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:03:21.264 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:03:21.268 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:03:51.386 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:03:51.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:04:21.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:04:21.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:04:51.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:04:51.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:05:21.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:05:21.827 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:05:51.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:05:51.951 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:06:22.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:06:22.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:06:52.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:06:52.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:07:22.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:07:22.345 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:07:52.463 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:07:52.468 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:08:22.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:08:22.600 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:08:52.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:08:52.734 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:09:22.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:09:22.872 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:09:52.991 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:09:52.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:10:23.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:10:23.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:10:53.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:10:53.280 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:11:23.436 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:11:23.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:11:53.581 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:11:54.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:12:25.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:12:25.121 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:12:55.248 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:12:55.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:13:25.412 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:13:25.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:13:55.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:13:55.655 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:14:25.795 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:14:25.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:14:55.941 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:14:55.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:15:26.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:15:26.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:15:56.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:15:56.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:16:26.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:16:26.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:16:56.508 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:16:56.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:17:26.628 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:17:26.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:17:56.759 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:17:56.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:18:26.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:18:26.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:18:57.042 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:18:57.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:19:27.164 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:19:27.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:19:57.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:19:57.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:20:27.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:20:27.451 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:20:57.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:20:57.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:21:27.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:21:27.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:21:57.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:21:57.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:22:28.032 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:22:28.037 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:22:58.177 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:22:58.181 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:23:28.307 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:23:28.311 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:23:58.436 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:23:58.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:24:28.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:24:28.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:24:58.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:24:58.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:25:28.867 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:25:28.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:25:58.996 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:25:59.000 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:26:29.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:26:29.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:26:59.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:26:59.286 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:27:29.443 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:27:29.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:27:59.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:27:59.585 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:28:29.721 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:28:29.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:28:59.872 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:28:59.879 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:29:30.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:29:30.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:30:00.164 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:30:00.169 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:30:30.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:30:30.317 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:31:00.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:31:00.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:31:30.611 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:31:30.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:32:00.749 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:32:00.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:32:30.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:32:30.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:33:01.007 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:33:01.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:33:31.135 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:33:31.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:34:01.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:34:01.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:34:31.428 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:34:31.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:35:01.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:35:01.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:35:31.713 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:35:31.718 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:36:01.850 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:36:01.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:36:31.972 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:36:31.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:37:02.091 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:37:02.096 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:37:32.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:37:32.240 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:38:02.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:38:02.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:38:32.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:38:32.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:39:02.645 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:39:02.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:39:32.789 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:39:32.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:40:02.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:40:02.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:40:33.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:40:33.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:41:03.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:41:03.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:41:33.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:41:33.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:42:03.494 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:42:03.499 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:42:33.640 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:42:33.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:43:03.777 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:43:03.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:43:33.907 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:43:33.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:44:04.045 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:44:04.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:44:34.215 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:44:34.219 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:45:04.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:45:04.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:45:34.494 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:45:34.499 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:46:04.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:46:04.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:46:34.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:46:34.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:47:04.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:47:04.958 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:47:35.092 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:47:35.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:48:05.222 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:48:05.226 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:48:35.368 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:48:35.372 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:49:05.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:49:05.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:49:35.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:49:35.656 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:50:05.785 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:50:05.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:50:35.944 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:50:35.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:51:06.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:51:06.078 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:51:36.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:51:36.216 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:52:06.357 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:52:06.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:52:36.486 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:52:36.490 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:53:06.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:53:06.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:53:36.761 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:53:36.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:54:06.907 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:54:06.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:54:37.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:54:37.058 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:55:07.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:55:07.180 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:55:37.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:55:37.317 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:56:07.444 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:56:07.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:56:37.575 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:56:37.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:57:07.699 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:57:07.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:57:37.813 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:57:37.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:58:07.958 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:58:07.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:58:38.075 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:58:38.080 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:59:08.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:59:08.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:59:38.339 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T07:59:38.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:00:08.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:00:08.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:00:38.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:00:38.596 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:01:08.698 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:01:08.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:01:38.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:01:38.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:02:08.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:02:08.958 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:02:39.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:02:39.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:03:09.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:03:09.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:03:39.347 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:03:39.351 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:04:09.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:04:09.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:04:39.618 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:04:39.622 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:05:09.780 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:05:09.785 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:05:39.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:05:39.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:06:10.055 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:06:10.059 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:06:40.193 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:06:40.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:07:10.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:07:10.327 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:07:40.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:07:40.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:08:10.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:08:10.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:08:40.736 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:08:40.740 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:09:10.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:09:10.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:09:41.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:09:41.006 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:10:11.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:10:11.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:10:41.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:10:41.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:11:11.407 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:11:11.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:11:41.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:11:41.576 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:12:11.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:12:11.693 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:12:41.820 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:12:41.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:13:11.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:13:11.948 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:13:42.075 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:13:42.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:14:12.190 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:14:12.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:14:42.338 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:14:42.342 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:15:12.460 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:15:12.464 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:15:42.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:15:42.604 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:16:12.715 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:16:12.720 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:16:42.838 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:16:42.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:17:12.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:17:12.957 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:17:43.075 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:17:43.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:18:13.191 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:18:13.195 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:18:43.321 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:18:43.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:19:13.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:19:13.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:19:43.584 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:19:43.589 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:20:13.699 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:20:13.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:20:43.840 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:20:43.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:21:13.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:21:13.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:21:44.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:21:44.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:22:14.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:22:14.230 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:22:44.356 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:22:44.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:23:14.463 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:23:14.469 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:23:44.595 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:23:44.599 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:24:14.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:24:14.714 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:24:44.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:24:44.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:25:14.971 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:25:14.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:25:45.111 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:25:45.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:26:15.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:26:15.268 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:26:45.400 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:26:45.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:27:15.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:27:15.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:27:45.653 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:27:45.658 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:28:15.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:28:15.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:28:45.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:28:45.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:29:16.081 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:29:16.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:29:46.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:29:46.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:30:16.368 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:30:16.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:30:46.503 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:30:46.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:31:16.640 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:31:16.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:31:46.787 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:31:46.791 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:32:16.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:32:16.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:32:47.053 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:32:47.058 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:33:17.200 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:33:17.204 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:33:47.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:33:47.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:34:17.500 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:34:17.504 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:34:47.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:34:47.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:35:17.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:35:17.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:35:48.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:35:48.058 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:36:18.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:36:18.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:36:48.364 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:36:48.369 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:37:18.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:37:18.506 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:37:48.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:37:48.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:38:18.777 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:38:18.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:38:48.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:38:48.926 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:39:19.077 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:39:19.081 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:39:49.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:39:49.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:40:19.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:40:19.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:40:49.498 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:40:49.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:41:19.653 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:41:19.658 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:41:49.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:41:49.837 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:42:19.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:42:19.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:42:50.094 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:42:50.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:43:20.228 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:43:20.233 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:43:50.366 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:43:50.371 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:44:20.521 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:44:20.526 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:44:50.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:44:50.682 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:45:20.821 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:45:20.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:45:50.976 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:45:50.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:46:21.129 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:46:21.135 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:46:51.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:46:51.313 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:47:21.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:47:21.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:47:51.571 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:47:51.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:48:21.722 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:48:21.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:48:51.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:48:51.872 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:49:22.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:49:22.019 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:49:52.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:49:52.156 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:50:22.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:50:22.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:50:52.436 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:50:52.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:51:22.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:51:22.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:51:52.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:51:52.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:52:22.864 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:52:22.869 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:52:53.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:52:53.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:53:23.156 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:53:23.161 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:53:53.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:53:53.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:54:23.474 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:54:23.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:54:53.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:54:53.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:55:23.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:55:23.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:55:53.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:55:53.933 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:56:24.075 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:56:24.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:56:54.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:56:54.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:57:24.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:57:24.346 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:57:54.479 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:57:54.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:58:24.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:58:24.612 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:58:54.771 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:58:54.776 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:59:24.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:59:24.921 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:59:55.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T08:59:55.076 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:00:25.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:00:25.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:00:55.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:00:55.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:01:25.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:01:25.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:01:55.734 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:01:55.738 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:02:25.860 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:02:25.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:02:55.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:02:56.002 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:03:26.127 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:03:26.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:03:56.292 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:03:56.296 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:04:26.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:04:26.428 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:04:56.565 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:04:56.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:05:26.703 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:05:26.708 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:05:56.841 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:05:56.846 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:06:26.987 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:06:26.991 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:06:57.133 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:06:57.137 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:07:27.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:07:27.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:07:57.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:07:57.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:08:27.713 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:08:27.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:08:57.840 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:08:57.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:09:27.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:09:27.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:09:58.094 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:09:58.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:10:28.217 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:10:28.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:10:58.370 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:10:58.374 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:11:28.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:11:28.521 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:11:58.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:11:58.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:12:28.776 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:12:28.831 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:12:58.947 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:12:58.951 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:13:29.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:13:29.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:13:59.230 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:13:59.235 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:14:29.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:14:29.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:14:59.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:14:59.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:15:29.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:15:29.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:15:59.772 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:15:59.776 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:16:29.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:16:29.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:17:00.048 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:17:00.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:17:30.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:17:30.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:18:00.318 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:18:00.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:18:30.461 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:18:30.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:19:00.606 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:19:00.611 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:19:30.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:19:30.757 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:20:00.904 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:20:00.908 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:20:31.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:20:31.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:21:01.175 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:21:01.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:21:31.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:21:31.349 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:22:01.500 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:22:01.506 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:22:31.654 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:22:31.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:23:01.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:23:01.805 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:23:31.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:23:31.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:24:02.092 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:24:02.096 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:24:32.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:24:32.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:25:02.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:25:02.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:25:32.529 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:25:32.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:26:02.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:26:02.681 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:26:32.822 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:26:32.826 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:27:02.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:27:02.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:27:33.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:27:33.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:28:03.284 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:28:03.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:28:33.432 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:28:33.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:29:03.602 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:29:03.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:29:33.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:29:33.727 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:30:03.854 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:30:03.861 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:30:34.006 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:30:34.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:31:04.127 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:31:04.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:31:34.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:31:34.280 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:32:04.397 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:32:04.402 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:32:34.521 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:32:34.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:33:04.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:33:04.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:33:34.758 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:33:34.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:34:04.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:34:04.895 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:34:35.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:34:35.125 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:35:05.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:35:05.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:35:35.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:35:35.355 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:36:05.483 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:36:05.487 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:36:35.605 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:36:35.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:37:05.728 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:37:05.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:37:35.843 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:37:35.847 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:38:05.975 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:38:05.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:38:36.106 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:38:36.111 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:39:06.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:39:06.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:39:36.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:39:36.349 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:40:06.475 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:40:06.479 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:40:36.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:40:36.602 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:41:06.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:41:06.734 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:41:36.887 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:41:36.892 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:42:07.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:42:07.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:42:37.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:42:37.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:43:07.324 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:43:07.328 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:43:37.470 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:43:37.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:44:07.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:44:07.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:44:37.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:44:37.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:45:07.883 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:45:07.887 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:45:38.020 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:45:38.025 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:46:08.158 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:46:08.162 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:46:38.287 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:46:38.291 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:47:08.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:47:08.438 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:47:38.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:47:38.600 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:48:08.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:48:08.738 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:48:38.888 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:48:38.893 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:49:09.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:49:09.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:49:39.156 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:49:39.161 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:50:09.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:50:09.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:50:39.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:50:39.451 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:51:09.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:51:09.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:51:39.739 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:51:39.743 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:52:09.893 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:52:09.897 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:52:40.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:52:40.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:53:10.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:53:10.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:53:40.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:53:40.352 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:54:10.477 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:54:10.481 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:54:40.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:54:40.614 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:55:10.752 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:55:10.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:55:40.873 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:55:40.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:56:11.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:56:11.008 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:56:41.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:56:41.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:57:11.284 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:57:11.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:57:41.432 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:57:41.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:58:11.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:58:11.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:58:41.716 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:58:41.720 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:59:11.842 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:59:11.847 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:59:41.992 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T09:59:41.996 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:00:12.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:00:12.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:00:42.289 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:00:42.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:01:12.536 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:01:12.540 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:01:42.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:01:42.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:02:12.839 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:02:12.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:02:43.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:02:43.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:03:13.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:03:13.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:03:43.268 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:03:43.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:04:13.407 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:04:13.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:04:43.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:04:43.566 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:05:13.690 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:05:13.696 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:05:43.844 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:05:43.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:06:13.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:06:13.970 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:06:44.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:06:44.116 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:07:14.245 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:07:14.249 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:07:44.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:07:44.399 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:08:14.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:08:14.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:08:44.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:08:44.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:09:14.800 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:09:14.805 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:09:44.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:09:44.950 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:10:15.101 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:10:15.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:10:45.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:10:45.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:11:15.451 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:11:15.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:11:45.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:11:45.585 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:12:15.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:12:15.725 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:12:45.847 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:12:45.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:13:15.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:13:15.983 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:13:46.147 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:13:46.151 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:14:16.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:14:16.297 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:14:46.532 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:14:46.536 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:15:16.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:15:16.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:15:46.944 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:15:46.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:16:17.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:16:17.099 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:16:47.248 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:16:47.253 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:17:17.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:17:17.387 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:17:47.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:17:47.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:18:17.653 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:18:17.658 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:18:47.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:18:47.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:19:17.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:19:17.975 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:19:48.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:19:48.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:20:18.246 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:20:18.251 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:20:48.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:20:48.379 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:21:18.529 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:21:18.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:21:48.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:21:48.679 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:22:18.793 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:22:18.797 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:22:48.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:22:48.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:23:19.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:23:19.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:23:49.235 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:23:49.241 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:24:19.389 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:24:19.393 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:24:49.527 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:24:49.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:25:19.657 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:25:19.661 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:25:49.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:25:49.807 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:26:19.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:26:19.970 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:26:50.105 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:26:50.109 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:27:20.239 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:27:20.243 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:27:50.378 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:27:50.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:28:20.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:28:20.511 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:28:50.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:28:50.682 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:29:20.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:29:20.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:29:50.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:29:50.974 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:30:21.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:30:21.120 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:30:51.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:30:51.258 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:31:21.391 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:31:21.395 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:31:51.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:31:51.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:32:21.700 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:32:21.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:32:51.821 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:32:51.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:33:21.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:33:21.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:33:52.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:33:52.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:34:22.204 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:34:22.208 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:34:52.356 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:34:52.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:35:22.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:35:22.497 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:35:52.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:35:52.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:36:22.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:36:22.757 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:36:52.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:36:52.902 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:37:23.058 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:37:23.063 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:37:53.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:37:53.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:38:23.351 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:38:23.356 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:38:53.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:38:53.511 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:39:23.653 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:39:23.657 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:39:53.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:39:53.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:40:23.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:40:23.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:40:54.085 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:40:54.089 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:41:24.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:41:24.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:41:54.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:41:54.346 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:42:24.479 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:42:24.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:42:54.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:42:54.604 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:43:24.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:43:24.734 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:43:54.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:43:54.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:44:25.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:44:25.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:44:55.159 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:44:55.163 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:45:25.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:45:25.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:45:55.433 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:45:55.438 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:46:25.565 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:46:25.571 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:46:55.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:46:55.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:47:25.812 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:47:25.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:47:55.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:47:55.930 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:48:26.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:48:26.066 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:48:56.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:48:56.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:49:26.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:49:26.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:49:56.443 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:49:56.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:50:26.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:50:26.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:50:56.697 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:50:56.701 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:51:26.828 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:51:26.833 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:51:56.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:51:56.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:52:27.091 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:52:27.096 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:52:57.230 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:52:57.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:53:27.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:53:27.349 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:53:57.459 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:53:57.464 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:54:27.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:54:27.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:54:57.706 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:54:57.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:55:27.837 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:55:27.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:55:57.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:55:57.983 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:56:28.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:56:28.121 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:56:58.239 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:56:58.243 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:57:28.361 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:57:28.366 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:57:58.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:57:58.480 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:58:28.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:58:28.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:58:58.736 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:58:58.740 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:59:28.863 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:59:28.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:59:58.986 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T10:59:58.991 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:00:29.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:00:29.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:00:59.241 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:00:59.245 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:01:29.372 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:01:29.376 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:01:59.496 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:01:59.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:02:29.627 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:02:29.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:02:59.741 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:02:59.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:03:29.864 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:03:29.868 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:03:59.978 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:03:59.982 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:04:30.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:04:30.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:05:00.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:05:00.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:05:30.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:05:30.336 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:06:00.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:06:00.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:06:30.577 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:06:30.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:07:00.683 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:07:00.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:07:30.806 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:07:30.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:08:00.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:08:00.934 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:08:31.077 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:08:31.081 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:09:01.192 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:09:01.198 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:09:31.323 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:09:31.327 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:10:01.430 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:10:01.435 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:10:31.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:10:31.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:11:01.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:11:01.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:11:31.833 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:11:31.837 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:12:01.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:12:01.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:12:32.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:12:32.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:13:02.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:13:02.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:13:32.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:13:32.346 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:14:02.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:14:02.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:14:32.713 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:14:32.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:15:02.828 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:15:02.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:15:32.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:15:32.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:16:03.091 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:16:03.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:16:33.217 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:16:33.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:17:03.343 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:17:03.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:17:33.475 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:17:33.480 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:18:03.589 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:18:06.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:18:36.661 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:18:36.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:19:06.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:19:06.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:19:36.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:19:36.903 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:20:07.012 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:20:07.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:20:37.128 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:20:37.132 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:21:07.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:21:07.246 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:21:37.368 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:21:37.372 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:22:07.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:22:07.497 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:22:37.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:22:37.626 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:23:07.736 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:23:07.740 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:23:37.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:23:37.880 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:24:08.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:24:08.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:24:38.155 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:24:38.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:25:08.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:25:08.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:25:38.409 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:25:38.413 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:26:08.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:26:08.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:26:38.672 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:26:38.676 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:27:08.803 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:27:08.808 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:27:38.926 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:27:38.930 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:28:09.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:28:09.053 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:28:39.180 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:28:39.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:29:09.296 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:29:09.300 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:29:39.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:29:39.432 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:30:09.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:30:09.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:30:39.697 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:30:39.701 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:31:09.820 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:31:09.824 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-19T11:31:25.155 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-19T11:31:25.155 DEBUG:teuthology.task.console_log:Killing console logger for smithi008 2023-11-19T11:31:25.156 DEBUG:teuthology.task.console_log:Killing console logger for smithi116 2023-11-19T11:31:25.156 DEBUG:teuthology.exit:Finished running handlers